-- Logs begin at Thu 2022-05-26 15:44:12 UTC, end at Thu 2022-05-26 17:00:35 UTC. -- May 26 16:27:20.035167 dv-cinder-836072-5-smb systemd[1]: Starting Devstack devstack@keystone.service... May 26 16:27:20.045349 dv-cinder-836072-5-smb devstack@keystone.service[80409]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 16:27:20.047425 dv-cinder-836072-5-smb devstack@keystone.service[80409]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 16:27:20 2022] *** May 26 16:27:20.047425 dv-cinder-836072-5-smb devstack@keystone.service[80409]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 16:27:20.047425 dv-cinder-836072-5-smb devstack@keystone.service[80409]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 16:27:20.047425 dv-cinder-836072-5-smb devstack@keystone.service[80409]: nodename: dv-cinder-836072-5-smb May 26 16:27:20.047425 dv-cinder-836072-5-smb devstack@keystone.service[80409]: machine: x86_64 May 26 16:27:20.047425 dv-cinder-836072-5-smb devstack@keystone.service[80409]: clock source: unix May 26 16:27:20.047425 dv-cinder-836072-5-smb devstack@keystone.service[80409]: pcre jit disabled May 26 16:27:20.047425 dv-cinder-836072-5-smb devstack@keystone.service[80409]: detected number of CPU cores: 4 May 26 16:27:20.047425 dv-cinder-836072-5-smb devstack@keystone.service[80409]: current working directory: / May 26 16:27:20.047425 dv-cinder-836072-5-smb devstack@keystone.service[80409]: detected binary path: /usr/bin/uwsgi-core May 26 16:27:20.047425 dv-cinder-836072-5-smb devstack@keystone.service[80409]: your processes number limit is 47680 May 26 16:27:20.048128 dv-cinder-836072-5-smb devstack@keystone.service[80409]: your memory page size is 4096 bytes May 26 16:27:20.048128 dv-cinder-836072-5-smb devstack@keystone.service[80409]: detected max file descriptor number: 2048 May 26 16:27:20.048128 dv-cinder-836072-5-smb devstack@keystone.service[80409]: lock engine: pthread robust mutexes May 26 16:27:20.048128 dv-cinder-836072-5-smb devstack@keystone.service[80409]: thunder lock: enabled May 26 16:27:20.048128 dv-cinder-836072-5-smb devstack@keystone.service[80409]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 16:27:20.048128 dv-cinder-836072-5-smb devstack@keystone.service[80409]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 16:27:20.092836 dv-cinder-836072-5-smb devstack@keystone.service[80409]: Python main interpreter initialized at 0x563bb28ec9c0 May 26 16:27:20.092836 dv-cinder-836072-5-smb devstack@keystone.service[80409]: python threads support enabled May 26 16:27:20.092836 dv-cinder-836072-5-smb devstack@keystone.service[80409]: your server socket listen backlog is limited to 100 connections May 26 16:27:20.092836 dv-cinder-836072-5-smb devstack@keystone.service[80409]: your mercy for graceful operations on workers is 90 seconds May 26 16:27:20.093153 dv-cinder-836072-5-smb devstack@keystone.service[80409]: mapped 403077 bytes (393 KB) for 2 cores May 26 16:27:20.093251 dv-cinder-836072-5-smb devstack@keystone.service[80409]: *** Operational MODE: preforking *** May 26 16:27:20.093522 dv-cinder-836072-5-smb devstack@keystone.service[80409]: *** uWSGI is running in multiple interpreter mode *** May 26 16:27:20.093522 dv-cinder-836072-5-smb devstack@keystone.service[80409]: spawned uWSGI master process (pid: 80409) May 26 16:27:20.093710 dv-cinder-836072-5-smb systemd[1]: Started Devstack devstack@keystone.service. May 26 16:27:20.094867 dv-cinder-836072-5-smb devstack@keystone.service[80409]: spawned uWSGI worker 1 (pid: 80419, cores: 1) May 26 16:27:20.094867 dv-cinder-836072-5-smb devstack@keystone.service[80409]: spawned uWSGI worker 2 (pid: 80420, cores: 1) May 26 16:27:20.094867 dv-cinder-836072-5-smb devstack@keystone.service[80409]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 16:27:25.797613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:27:25.797613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: from cryptography.utils import int_from_bytes May 26 16:27:25.798408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:27:25.798408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: from cryptography.utils import int_from_bytes May 26 16:27:25.806510 dv-cinder-836072-5-smb devstack@keystone.service[80419]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:27:25.806510 dv-cinder-836072-5-smb devstack@keystone.service[80419]: from cryptography.utils import int_from_bytes May 26 16:27:25.807494 dv-cinder-836072-5-smb devstack@keystone.service[80419]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:27:25.807494 dv-cinder-836072-5-smb devstack@keystone.service[80419]: from cryptography.utils import int_from_bytes May 26 16:27:25.848456 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:27:25.848647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:27:25.848841 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] command line args: [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:27:25.849113 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:27:25.849292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ================================================================================ {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:27:25.849563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] admin_token = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.849815 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] config_dir = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.850004 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.850187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] config_source = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.850368 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] debug = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.850588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.850970 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.851151 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.851408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.851837 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.851962 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.852072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_config_append = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.852228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.852407 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_dir = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.852586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_file = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.852827 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.853077 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.853328 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.853580 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.853837 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.854166 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.854245 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:27:25.854419 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:27:25.854527 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.854640 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] command line args: [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:27:25.854710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.854895 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:27:25.854974 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.855090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ================================================================================ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:27:25.855266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.855346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] admin_token = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.855513 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.855640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.855769 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] config_dir = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.855903 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.856025 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.856150 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] config_source = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.856269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.856409 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] debug = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.856542 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.856667 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.856667 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.856935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.857062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.110/identity {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.857195 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.857328 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] publish_errors = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.857328 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.857567 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.857692 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.857822 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.857965 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.858096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_config_append = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.858096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.858344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.858470 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_dir = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.858625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.858705 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_file = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.858782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] standard_threads = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.858858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.858934 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.859004 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.859080 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.859152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.859221 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.859291 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.859368 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] use_journal = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.859439 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.859519 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] use_json = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.859595 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.859673 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] use_stderr = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.859673 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] use_syslog = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.859804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.859892 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.859970 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.860041 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.860116 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.860299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.860386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.860503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.860582 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.860736 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.860814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.860983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.861072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.861221 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.861305 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.861476 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.861560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.861715 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.861966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.862042 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.110/identity {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.862146 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] publish_errors = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.862229 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.862380 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.862460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.862631 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.862724 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.862804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.862949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.863035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.863188 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.863274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.863440 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.863519 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] standard_threads = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.863696 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.863788 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.863937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.864022 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.864144 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.864219 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.864413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_journal = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.864500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.864578 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_json = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.864578 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_stderr = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.864751 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.864828 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_syslog = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.864906 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.865051 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:25.865128 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.865221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.865389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.865468 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.865645 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.865726 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.865898 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.865976 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.866345 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.866465 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.866602 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.866683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.866765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.866844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.866916 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.866986 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.867064 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.867136 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.867303 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.867383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.867536 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.867614 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.867769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.867849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.868020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.868099 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.868271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.868348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.868512 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.868597 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.868757 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.868837 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.868988 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.869066 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.869227 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.869306 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.869982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.870062 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.870217 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.870301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.870455 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.870537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.870695 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.870804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.870929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.871072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.871161 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.871329 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.871408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.871579 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.871657 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.871814 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.871900 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.872047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.872126 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.872287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.872365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.872525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.872609 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.872770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.872847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.873002 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.873085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.873238 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.873316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.873469 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.873547 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.873706 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.873783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.873946 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.874026 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.874181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.874256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.874408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.874484 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.874675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.874767 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.874912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.874990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.875146 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.875250 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.875366 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.875466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.875601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.875709 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.875820 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.875918 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.876028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.876126 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.876253 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.876370 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.876503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.876607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.876736 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.876815 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.876959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.877048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.877189 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.877522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.877684 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.877774 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.877938 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.878025 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.878173 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.878251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.878407 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.878533 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.878669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.878749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.878909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.879001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.879149 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.879240 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.879392 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.879477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.879628 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.879707 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.879861 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.879959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.880095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.880208 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.880333 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.880413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.880570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.880660 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.880805 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.880884 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.881062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.881141 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.881298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.881381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.881532 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.881619 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.881769 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.881848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.882007 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.882093 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.882246 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.882321 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.882469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.882549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.882727 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.882820 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.882961 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.883044 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.883195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.883273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.883433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.883520 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.883666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.883744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.883905 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.884028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.884142 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.884233 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.884381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.884461 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.884619 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.884696 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.884853 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.884939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.885676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.885783 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.885955 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.886080 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.886198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.886285 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.external = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.886437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.886525 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.886724 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.886805 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.886970 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.887059 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.887209 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.password = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.887296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.887442 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.token = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.887522 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.887682 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.887760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.887919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.888005 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.888155 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.888234 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.888389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.888475 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.888618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.888704 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.888847 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.888926 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.889077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.889155 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.889313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.889424 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.889542 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.889632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.889771 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.889846 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.890002 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.890081 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.890249 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.890336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.890485 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.890581 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.890765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.890845 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.891026 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.891119 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.891267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.891356 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.891497 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.external = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.891577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.891729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.891810 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.892025 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.892105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.892266 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.892345 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.892498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.password = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.892580 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.892729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.token = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.892809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.892968 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.893054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.893204 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.893285 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.893448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.893534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.893677 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.893762 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.893925 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.894007 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.894161 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.894239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.894389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.894467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.894646 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.894732 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.894898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.894979 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.895144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.895222 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.895389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.895470 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.895625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.895706 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.895869 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.895950 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.896105 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.896192 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.896353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.896439 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.896604 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.896684 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.896836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.896911 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.897065 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.897145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.897314 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.897396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.897548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.897629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.897786 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.897865 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.898049 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.898129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.898304 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.898385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.898539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.898676 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.898820 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.898901 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.899052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.899133 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.899299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.899379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.899528 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.899607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.899778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.899859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.900015 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.900094 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.900271 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.900379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.900520 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.900599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.900862 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.900941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.901105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.901196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.901341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.901420 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.901576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.901655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.901807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.901894 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.902046 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.902125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.902287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.902364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.902524 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.902642 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.902795 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.902875 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.903026 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.903104 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.903262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.903349 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.903512 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.903598 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.903747 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.903825 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.903985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.904071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.904216 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.904297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.904444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.904523 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.904681 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.904768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.904915 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.904994 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.905153 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.905233 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.905393 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.905480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.905635 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.905714 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.905873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.905952 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.906112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.906200 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.906364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.906444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.906637 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.906722 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.906872 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.906965 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.907105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.907186 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.907355 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.907434 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.907605 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.907698 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.907842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.907922 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.908089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.908168 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.908320 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.908408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.908552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.908630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.908796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.908884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.909033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.909121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.909280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.909358 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.909526 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.909607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.909759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.909851 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.909998 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.910079 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.910230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.910310 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.910458 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.910545 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.910718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.910799 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.910954 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.911032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.911188 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.911280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.911418 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.911497 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.911667 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.911745 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.911911 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.911998 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.912140 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.912219 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.912371 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.912451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.912621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.912714 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.912849 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.912928 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.913091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.913169 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.913327 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.913408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.913562 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.913640 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.913790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.913868 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.914030 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.914110 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.914277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.914356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.914506 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.914603 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.914782 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.914864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.915030 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.915110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.915260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.915339 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.915501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.915582 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.915732 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.915811 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.915966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.916045 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.916206 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.916785 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.917034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.917121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.917278 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.917359 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.917512 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.917618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.917751 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.917871 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.917994 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.918124 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.918345 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.918427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.918619 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.918703 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.918863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.918942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.919109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.919190 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.919349 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.919428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.919587 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.919664 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.919823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.919904 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.920063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.920143 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.920304 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.920382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.920532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] role.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.920609 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.920779 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.920859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] role.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.921010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.921088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.921253 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.921334 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.921498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.921577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.921735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.921813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.921972 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.922053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.922210 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.922289 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.922457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.922535 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.922720 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.922802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.922952 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.923031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.923191 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.923270 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.923428 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.923508 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.923677 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.923755 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.923924 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.924004 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.924172 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.924254 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.924421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.924574 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.924655 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.924819 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.924907 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.925087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.925167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.925346 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.925425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.925584 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.925663 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.925818 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] role.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.925897 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.926065 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] role.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.926145 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.926302 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.926391 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.926551 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.926692 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.926823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.926904 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.927060 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.927140 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.927297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.927376 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.927532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.927612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.927776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.927856 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.928020 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.928099 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.928267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.928346 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.928499 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.928580 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.928735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.928813 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.928970 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.929049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.929211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.929292 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.929452 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.929532 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.929703 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.929844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.929932 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.930080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.930187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.930330 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.930437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.930633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.930732 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.930915 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.930995 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.931161 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.931241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.931396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.931485 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.931660 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.931741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.931960 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.932069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.932260 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.932366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.932491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.932580 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.932722 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.932803 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.932960 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.933040 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.933207 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.933287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.933467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.933545 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.933718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.933800 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.connection = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.933956 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.934046 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.934192 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.934272 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.934422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.934502 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.934680 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.934764 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.934919 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.934999 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.935169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.935248 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.935405 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.935487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.935645 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.935725 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.935893 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.935971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.936130 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.936211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.936372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.936450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.936606 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.936684 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.936857 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.936940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.937091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.937170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.937329 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.937409 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.937560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.937642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.937801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.937881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.938038 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.938117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.938200 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:27:25.938276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.938493 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.938811 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.939072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.939316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.939563 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.939803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.940054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.940290 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.940527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.940763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.941002 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.941247 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.941481 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.941725 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.941959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.942207 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.942440 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.942706 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.942938 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.943178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.943413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:25.943580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:27:25.969474 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:25.969707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:25.969937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:25.970170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:25.970406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:25.970657 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:25.979331 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:25.980094 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.008057 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.008291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.008440 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.008673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.062118 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.062382 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.114110 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.114343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.114669 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.114910 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.182048 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.182279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.182358 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.182513 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.182679 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.182769 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.182848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.182962 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.183049 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.183179 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.183267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.183395 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.206982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.207092 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.207220 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.207306 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.207450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.207535 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.207677 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.207771 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.207900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.207984 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.208115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.208197 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.208327 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.208420 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.219782 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.220100 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.232752 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.233021 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.233213 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.233298 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.233438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.233522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.233657 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.233755 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.233871 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.233955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.234082 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.234165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.234321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.234539 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:26.251172 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.251384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:27:26.251723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.251807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.251925 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:27:26.252009 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:27:26.252195 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.252533 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.252707 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:27:26.252789 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.252963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.253047 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.253215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.253296 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.253471 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.253730 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.265479 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.265757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.266031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.266311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.266484 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.266784 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.267052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.267341 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.274499 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.275469 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.277960 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.278242 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.278524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.278830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.278913 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.279104 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.279187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.279366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.279449 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.279633 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.279716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.279917 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.280000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.280273 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.280355 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.280546 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.280635 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.280813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.280894 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.281084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.281361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.281628 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.308187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.308850 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.309922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.310200 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.310618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.310899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.315583 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.315821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.316107 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.316190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.316442 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.316719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.323608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.323892 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.324106 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.324385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.328423 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.328828 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.328910 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.329112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.329277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.329399 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.329557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.329674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.329836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.329946 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.330110 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.330214 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.330381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.330483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.330675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.330942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.349941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.350207 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.350296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.350486 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.354894 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.355366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.360609 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.360609 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.360783 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.360783 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.363942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.364447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.369149 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.369299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.371870 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.372168 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.372457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.372541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.372748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.372922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.373030 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.373114 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.373314 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.373394 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.373598 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.373882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.393095 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.393372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.393636 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.393895 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.393978 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.394177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.394446 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.394736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.401950 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.403040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.403690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.403971 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.404752 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.405028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.407058 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.407338 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.407619 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.407907 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.408133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.408217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.408414 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.408698 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.408983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.409262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.421657 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.421935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.422219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.422499 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.422803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.422998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.423084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.423280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.423365 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.423571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.423853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.424134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.424418 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.424705 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.441876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.443429 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.445194 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.446737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.449089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.450710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.450798 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.452328 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.452422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.452608 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.452899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.453983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.454266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.454547 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.460338 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.461943 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.462056 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.464354 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.465873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.466162 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.466447 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.466758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.467650 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.467950 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.468234 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.468515 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.476571 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.477054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.477684 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.477897 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.478202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.478671 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.486778 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.487057 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.487339 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.487617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.487892 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.488164 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.488460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.488732 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.489002 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.489278 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.489548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.489808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.490078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.490351 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.492818 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:26.493305 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.493789 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.494276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.495305 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.495787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.496289 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.496800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.497307 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.497810 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.498322 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.498845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.499326 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.499822 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:26.531231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563bb28ec9c0 pid: 80420 (default app) May 26 16:27:26.534485 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f0930-8c2f-4b83-9d9a-222dcf02a97d None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:26.534808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f0930-8c2f-4b83-9d9a-222dcf02a97d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:26.535091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f0930-8c2f-4b83-9d9a-222dcf02a97d None None] PATH_INFO: `/v3` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:26.539430 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1/1] 10.222.0.110 () {50 vars in 796 bytes} [Thu May 26 16:27:26 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:26.540305 dv-cinder-836072-5-smb devstack@keystone.service[80419]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563bb28ec9c0 pid: 80419 (default app) May 26 16:27:34.386933 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4127e31-bf9b-4dc7-bc26-b4642252d2c7 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:34.387416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4127e31-bf9b-4dc7-bc26-b4642252d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:34.387515 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4127e31-bf9b-4dc7-bc26-b4642252d2c7 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:34.388826 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 2/2] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:34.395935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b250d7-fc13-453c-b2a1-4b22d5922978 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:34.396318 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b250d7-fc13-453c-b2a1-4b22d5922978 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:34.396501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b250d7-fc13-453c-b2a1-4b22d5922978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:34.463807 dv-cinder-836072-5-smb devstack@keystone.service[80419]: INFO dbcounter [None req-17b250d7-fc13-453c-b2a1-4b22d5922978 None None] Registered counter for database keystone May 26 16:27:34.485462 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG oslo_db.sqlalchemy.engines [None req-17b250d7-fc13-453c-b2a1-4b22d5922978 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:27:34.491603 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writer thread running {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:27:34.669318 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG passlib.handlers.bcrypt [None req-17b250d7-fc13-453c-b2a1-4b22d5922978 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80419) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 16:27:34.669667 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG passlib.handlers.bcrypt [None req-17b250d7-fc13-453c-b2a1-4b22d5922978 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80419) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 16:27:34.724937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-17b250d7-fc13-453c-b2a1-4b22d5922978 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:34.726547 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-17b250d7-fc13-453c-b2a1-4b22d5922978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:34.851634 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1/3] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:34 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 26 16:27:35.005591 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4127e31-bf9b-4dc7-bc26-b4642252d2c7 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:35.075077 dv-cinder-836072-5-smb devstack@keystone.service[80420]: INFO dbcounter [None req-b4127e31-bf9b-4dc7-bc26-b4642252d2c7 None None] Registered counter for database keystone May 26 16:27:35.094516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG oslo_db.sqlalchemy.engines [None req-b4127e31-bf9b-4dc7-bc26-b4642252d2c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:27:35.100705 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writer thread running {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:27:35.220043 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4127e31-bf9b-4dc7-bc26-b4642252d2c7 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:35.224450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a483755-9209-497e-b8e1-37bb6cefb45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:35.225135 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a483755-9209-497e-b8e1-37bb6cefb45d admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:35.225427 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a483755-9209-497e-b8e1-37bb6cefb45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:35.225711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a483755-9209-497e-b8e1-37bb6cefb45d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:35.234496 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a483755-9209-497e-b8e1-37bb6cefb45d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:35.286278 dv-cinder-836072-5-smb devstack@keystone.service[80420]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5a483755-9209-497e-b8e1-37bb6cefb45d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 16:27:35.286600 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a483755-9209-497e-b8e1-37bb6cefb45d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:35.296951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 3/4] 10.222.0.110 () {58 vars in 1329 bytes} [Thu May 26 16:27:35 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:27:35.303064 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b250d7-fc13-453c-b2a1-4b22d5922978 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:35.317354 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b250d7-fc13-453c-b2a1-4b22d5922978 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:35.321774 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03838fae-fa6a-46f0-ab3e-4a58cdb5154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:35.322930 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03838fae-fa6a-46f0-ab3e-4a58cdb5154c admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:35.323213 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03838fae-fa6a-46f0-ab3e-4a58cdb5154c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:35.323490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03838fae-fa6a-46f0-ab3e-4a58cdb5154c admin admin] PATH_INFO: `/v3/projects/d89de88c67114e9b9382e93ffe6a1176` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:35.325131 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03838fae-fa6a-46f0-ab3e-4a58cdb5154c admin admin] RBAC: Authorizing `identity:get_project(project_id=d89de88c67114e9b9382e93ffe6a1176)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:35.377298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: WARNING keystone.common.rbac_enforcer.enforcer [None req-03838fae-fa6a-46f0-ab3e-4a58cdb5154c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 16:27:35.377656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03838fae-fa6a-46f0-ab3e-4a58cdb5154c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:35.382333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 2/5] 10.222.0.110 () {56 vars in 1212 bytes} [Thu May 26 16:27:35 2022] GET /identity/v3/projects/d89de88c67114e9b9382e93ffe6a1176 => generated 345 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:37.556084 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584be5bb-43af-458f-ab64-a1c4743ecfc4 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:37.557120 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584be5bb-43af-458f-ab64-a1c4743ecfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:37.557203 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584be5bb-43af-458f-ab64-a1c4743ecfc4 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:37.561334 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 4/6] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:37 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:37.566782 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8e945-0ca1-4560-8fab-33668253608b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:37.567159 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8e945-0ca1-4560-8fab-33668253608b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:37.567346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8e945-0ca1-4560-8fab-33668253608b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:37.586512 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b7d8e945-0ca1-4560-8fab-33668253608b None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:37.588224 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b7d8e945-0ca1-4560-8fab-33668253608b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:37.596060 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 3/7] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:37 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 16:27:37.617609 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584be5bb-43af-458f-ab64-a1c4743ecfc4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:37.630404 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584be5bb-43af-458f-ab64-a1c4743ecfc4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:37.635038 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e2ff9-6cd2-4a16-b622-8ab5c38d2387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:37.635667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e2ff9-6cd2-4a16-b622-8ab5c38d2387 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:37.635949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e2ff9-6cd2-4a16-b622-8ab5c38d2387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:37.636221 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e2ff9-6cd2-4a16-b622-8ab5c38d2387 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:37.643773 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e2ff9-6cd2-4a16-b622-8ab5c38d2387 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:37.645539 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e2ff9-6cd2-4a16-b622-8ab5c38d2387 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:37.654150 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 5/8] 10.222.0.110 () {58 vars in 1329 bytes} [Thu May 26 16:27:37 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 16:27:37.659442 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8e945-0ca1-4560-8fab-33668253608b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:37.668472 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8e945-0ca1-4560-8fab-33668253608b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:37.672858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20ffe4-c4e0-4f39-8ad8-91c6e63c221c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:37.673723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20ffe4-c4e0-4f39-8ad8-91c6e63c221c admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:37.674009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20ffe4-c4e0-4f39-8ad8-91c6e63c221c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:37.674285 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20ffe4-c4e0-4f39-8ad8-91c6e63c221c admin admin] PATH_INFO: `/v3/users/eff5fc4521044d4aa5829e339b10b23f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:37.675723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20ffe4-c4e0-4f39-8ad8-91c6e63c221c admin admin] RBAC: Authorizing `identity:get_user(user_id=eff5fc4521044d4aa5829e339b10b23f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:37.677539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20ffe4-c4e0-4f39-8ad8-91c6e63c221c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:37.679125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 4/9] 10.222.0.110 () {56 vars in 1203 bytes} [Thu May 26 16:27:37 2022] GET /identity/v3/users/eff5fc4521044d4aa5829e339b10b23f => generated 248 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:39.914280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015665e1-1d47-4372-8cfc-917ffdf325cb None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:39.914854 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015665e1-1d47-4372-8cfc-917ffdf325cb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:39.914854 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015665e1-1d47-4372-8cfc-917ffdf325cb None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:39.916295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 6/10] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:39.921721 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640b399-5afe-4643-9bf1-9c4d6006efd7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:39.922118 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640b399-5afe-4643-9bf1-9c4d6006efd7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:39.922434 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640b399-5afe-4643-9bf1-9c4d6006efd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:39.939600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0640b399-5afe-4643-9bf1-9c4d6006efd7 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:39.940789 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0640b399-5afe-4643-9bf1-9c4d6006efd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:39.944892 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce00a8-9126-48f4-b3a9-b5b7001ae2bf None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:39.945177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce00a8-9126-48f4-b3a9-b5b7001ae2bf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:39.945453 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce00a8-9126-48f4-b3a9-b5b7001ae2bf None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:39.946875 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 7/11] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:27:39.952414 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064ac48-ca03-4943-bba2-b49d210e9bfb None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:39.952704 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064ac48-ca03-4943-bba2-b49d210e9bfb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:39.952980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064ac48-ca03-4943-bba2-b49d210e9bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:39.991573 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG passlib.handlers.bcrypt [None req-4064ac48-ca03-4943-bba2-b49d210e9bfb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80420) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 16:27:39.992028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG passlib.handlers.bcrypt [None req-4064ac48-ca03-4943-bba2-b49d210e9bfb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80420) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 16:27:40.021934 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 5/12] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:27:40.039329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4064ac48-ca03-4943-bba2-b49d210e9bfb None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:40.041028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4064ac48-ca03-4943-bba2-b49d210e9bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:40.044269 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640b399-5afe-4643-9bf1-9c4d6006efd7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:40.068457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:40.140382 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 8/13] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:27:40.149653 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640b399-5afe-4643-9bf1-9c4d6006efd7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:40.162464 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064ac48-ca03-4943-bba2-b49d210e9bfb None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:40.185424 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e524ea-cb93-40bc-a6f2-d1d7e1f560dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:40.186191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e524ea-cb93-40bc-a6f2-d1d7e1f560dd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:40.186477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e524ea-cb93-40bc-a6f2-d1d7e1f560dd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:40.186808 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e524ea-cb93-40bc-a6f2-d1d7e1f560dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:40.198288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e524ea-cb93-40bc-a6f2-d1d7e1f560dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:40.209693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-39e524ea-cb93-40bc-a6f2-d1d7e1f560dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:40.209693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:40.209693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:40.209693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:40.209693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:40.209693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:40.209693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:40.209693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:40.209693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:40.209693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:40.209693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:40.209693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:40.209693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:40.209693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:40.209693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:40.209693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:40.210898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:40.210898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:40.210898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:40.210898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:40.210898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:40.210898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:40.210898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:40.210898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:40.210898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:40.210898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:40.210898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:40.210898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:27:40.210898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:40.210898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:40.210898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:40.210898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:40.216905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:40.216905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:40.216905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:40.216905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:40.216905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:40.216905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:40.216905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:40.216905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:40.216905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:40.216905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:40.216905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:40.216905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:27:40.216905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 6/14] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:27:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:40.216905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e524ea-cb93-40bc-a6f2-d1d7e1f560dd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:40.378344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064ac48-ca03-4943-bba2-b49d210e9bfb None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:40.380710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:40.416295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99e36b-d2e3-47c9-820d-81e2c60e2280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:40.417196 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99e36b-d2e3-47c9-820d-81e2c60e2280 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:40.417485 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99e36b-d2e3-47c9-820d-81e2c60e2280 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:40.417766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99e36b-d2e3-47c9-820d-81e2c60e2280 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:40.419476 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:40.437347 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e524ea-cb93-40bc-a6f2-d1d7e1f560dd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:40.470832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d3a71-7a04-4d36-a99c-ff46c5e2ca57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:40.471505 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d3a71-7a04-4d36-a99c-ff46c5e2ca57 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:40.471792 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d3a71-7a04-4d36-a99c-ff46c5e2ca57 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:40.472075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d3a71-7a04-4d36-a99c-ff46c5e2ca57 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:40.472826 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d3a71-7a04-4d36-a99c-ff46c5e2ca57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:40.473138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d3a71-7a04-4d36-a99c-ff46c5e2ca57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:40.474589 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d3a71-7a04-4d36-a99c-ff46c5e2ca57 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:40.485916 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99e36b-d2e3-47c9-820d-81e2c60e2280 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:40.486631 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 7/15] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:27:40 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:40.487451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99e36b-d2e3-47c9-820d-81e2c60e2280 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:40.492116 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d3a71-7a04-4d36-a99c-ff46c5e2ca57 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:40.585865 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 9/16] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:27:40 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:27:40.592027 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99e36b-d2e3-47c9-820d-81e2c60e2280 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:40.594815 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d3a71-7a04-4d36-a99c-ff46c5e2ca57 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:40.594935 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:40.629745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99497f1a-b2c3-4792-acbc-f11a8fcb413f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:40.630660 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99497f1a-b2c3-4792-acbc-f11a8fcb413f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:40.630947 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99497f1a-b2c3-4792-acbc-f11a8fcb413f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:40.631223 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99497f1a-b2c3-4792-acbc-f11a8fcb413f None admin] PATH_INFO: `/v3/users/eff5fc4521044d4aa5829e339b10b23f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:40.632419 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99497f1a-b2c3-4792-acbc-f11a8fcb413f None admin] RBAC: Authorizing `identity:get_user(user_id=eff5fc4521044d4aa5829e339b10b23f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:40.633903 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99497f1a-b2c3-4792-acbc-f11a8fcb413f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:40.636092 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 8/17] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:27:40 2022] GET /identity/v3/users/eff5fc4521044d4aa5829e339b10b23f => generated 248 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:40.641382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99497f1a-b2c3-4792-acbc-f11a8fcb413f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:40.655666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:40.703127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99e36b-d2e3-47c9-820d-81e2c60e2280 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:40.736452 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11879039-2e2c-4b29-97ea-e6f27bbb59cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:40.737245 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11879039-2e2c-4b29-97ea-e6f27bbb59cd None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:40.737531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11879039-2e2c-4b29-97ea-e6f27bbb59cd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:40.737807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11879039-2e2c-4b29-97ea-e6f27bbb59cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:40.743047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99497f1a-b2c3-4792-acbc-f11a8fcb413f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:40.757223 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11879039-2e2c-4b29-97ea-e6f27bbb59cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:40.758799 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11879039-2e2c-4b29-97ea-e6f27bbb59cd None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:40.777224 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e60204-9dfc-4e05-bf5e-057de20af079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:40.778027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e60204-9dfc-4e05-bf5e-057de20af079 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:40.778314 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e60204-9dfc-4e05-bf5e-057de20af079 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:40.778623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e60204-9dfc-4e05-bf5e-057de20af079 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:40.779811 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e60204-9dfc-4e05-bf5e-057de20af079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:40.779919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-11879039-2e2c-4b29-97ea-e6f27bbb59cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:40.779919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:40.779919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:40.779919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:40.779919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:40.779919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:40.779919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:40.779919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:40.779919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:40.779919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:40.779919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:40.779919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:40.779919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:40.779919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:40.779919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:40.780813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:40.780813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:40.780813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:40.780813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:40.780813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:40.780813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:40.780813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:40.780813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:40.780813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:27:40.780813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:40.780813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:40.780813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:40.780813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:40.780813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:40.780813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:40.780813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:40.780813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:40.781678 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:40.781678 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:40.781678 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:40.781678 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:27:40.781891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e60204-9dfc-4e05-bf5e-057de20af079 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:40.781954 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 10/18] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:40.782847 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 9/19] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:27:40 2022] GET /identity/v3/domains/default => generated 200 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:40.787171 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11879039-2e2c-4b29-97ea-e6f27bbb59cd None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:40.788262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e60204-9dfc-4e05-bf5e-057de20af079 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:40.843769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:40.870090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:40.889531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11879039-2e2c-4b29-97ea-e6f27bbb59cd None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:40.893220 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e60204-9dfc-4e05-bf5e-057de20af079 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:40.925207 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd891ab3-4c1d-4a7b-bb5f-7eea30f9da96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:40.925876 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd891ab3-4c1d-4a7b-bb5f-7eea30f9da96 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:40.926165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd891ab3-4c1d-4a7b-bb5f-7eea30f9da96 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:40.926452 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd891ab3-4c1d-4a7b-bb5f-7eea30f9da96 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:40.927209 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd891ab3-4c1d-4a7b-bb5f-7eea30f9da96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:40.927522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd891ab3-4c1d-4a7b-bb5f-7eea30f9da96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:40.928402 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2898d-114d-4f6e-93d5-13e3d9e540b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:40.928926 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd891ab3-4c1d-4a7b-bb5f-7eea30f9da96 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:40.929060 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2898d-114d-4f6e-93d5-13e3d9e540b7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:40.929345 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2898d-114d-4f6e-93d5-13e3d9e540b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:40.929623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2898d-114d-4f6e-93d5-13e3d9e540b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:40.930480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2898d-114d-4f6e-93d5-13e3d9e540b7 None admin] RBAC: Adding query filter params (role.id=1393d128d39b4649b6cd71b6609846cb, scope.domain.id=default, user.id=eff5fc4521044d4aa5829e339b10b23f) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:40.930814 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2898d-114d-4f6e-93d5-13e3d9e540b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:40.932255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2898d-114d-4f6e-93d5-13e3d9e540b7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:40.938932 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 10/20] 10.222.0.110 () {56 vars in 1327 bytes} [Thu May 26 16:27:40 2022] GET /identity/v3/role_assignments?user.id=eff5fc4521044d4aa5829e339b10b23f&scope.domain.id=default&role.id=1393d128d39b4649b6cd71b6609846cb => generated 234 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:40.948768 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 11/21] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:27:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:43.481442 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335916a-3b51-4759-aea7-51f546a7397e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:43.481969 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335916a-3b51-4759-aea7-51f546a7397e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:43.482045 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335916a-3b51-4759-aea7-51f546a7397e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:43.483653 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 11/22] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:43.488675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1676a-022c-40a1-bed6-481cfeaa753d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:43.489520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1676a-022c-40a1-bed6-481cfeaa753d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:43.490020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1676a-022c-40a1-bed6-481cfeaa753d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:43.519633 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3fc1676a-022c-40a1-bed6-481cfeaa753d None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:43.521317 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3fc1676a-022c-40a1-bed6-481cfeaa753d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:43.609415 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 12/23] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:43.643245 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335916a-3b51-4759-aea7-51f546a7397e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:43.745970 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b66ed4-99f1-483e-be35-d7aedfeb2240 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:43.746621 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b66ed4-99f1-483e-be35-d7aedfeb2240 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:43.747122 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b66ed4-99f1-483e-be35-d7aedfeb2240 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:43.749804 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 13/24] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:43.753887 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286afc80-f4f8-436c-8b7f-71d8477966fe None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:43.754408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286afc80-f4f8-436c-8b7f-71d8477966fe None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:43.754941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286afc80-f4f8-436c-8b7f-71d8477966fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:43.779126 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-286afc80-f4f8-436c-8b7f-71d8477966fe None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:43.781419 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-286afc80-f4f8-436c-8b7f-71d8477966fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:43.816246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335916a-3b51-4759-aea7-51f546a7397e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:43.869660 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:43.876671 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a6f8d-64b2-43c5-91a1-3092953a8b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:43.877751 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a6f8d-64b2-43c5-91a1-3092953a8b10 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:43.878040 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a6f8d-64b2-43c5-91a1-3092953a8b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:43.878315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a6f8d-64b2-43c5-91a1-3092953a8b10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:43.890351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a6f8d-64b2-43c5-91a1-3092953a8b10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:43.898641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-7b0a6f8d-64b2-43c5-91a1-3092953a8b10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:43.898641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:43.898641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:43.898641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:43.898641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:43.898641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:43.898641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:43.898641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:43.898641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:43.898641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:43.898641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:43.898641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:43.898641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:43.898641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:43.898641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:43.898641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:43.899507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:43.899507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:43.899507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:43.899507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:43.899507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:43.899507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:43.899507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:43.899507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:43.899507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:43.899507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:43.899507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:43.899507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:27:43.899507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:43.899507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:43.899507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:43.899507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:43.901423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:43.901423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:43.901423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:43.901423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:43.901423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:43.901423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:43.901423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:43.901423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:43.901423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:43.901423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:43.901423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:43.901423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:27:43.901423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 12/25] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:27:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:43.902293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e917ead-7d25-4127-a53f-1cebde683c03 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:43.902293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e917ead-7d25-4127-a53f-1cebde683c03 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:43.902293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e917ead-7d25-4127-a53f-1cebde683c03 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:43.903681 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 13/26] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:43.908841 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e917ead-7d25-4127-a53f-1cebde683c03 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:43.912884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:43.926752 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 14/27] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:43.927832 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd728df-0e44-4413-bc3e-84f3b056ea89 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:43.928124 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd728df-0e44-4413-bc3e-84f3b056ea89 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:43.928408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd728df-0e44-4413-bc3e-84f3b056ea89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:43.963122 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4dd728df-0e44-4413-bc3e-84f3b056ea89 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:43.964780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4dd728df-0e44-4413-bc3e-84f3b056ea89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:44.040413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e917ead-7d25-4127-a53f-1cebde683c03 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:44.084363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677f40f-fb9d-453f-959c-527484b0d33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:44.086790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677f40f-fb9d-453f-959c-527484b0d33a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:44.087393 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677f40f-fb9d-453f-959c-527484b0d33a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:44.088618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677f40f-fb9d-453f-959c-527484b0d33a None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:44.089545 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677f40f-fb9d-453f-959c-527484b0d33a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:44.090348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677f40f-fb9d-453f-959c-527484b0d33a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:44.092657 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677f40f-fb9d-453f-959c-527484b0d33a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:44.108557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 15/28] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:44.109714 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd728df-0e44-4413-bc3e-84f3b056ea89 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:44.121683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 14/29] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:27:43 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:44.127642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677f40f-fb9d-453f-959c-527484b0d33a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:44.242994 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:44.311590 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677f40f-fb9d-453f-959c-527484b0d33a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:44.332651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd728df-0e44-4413-bc3e-84f3b056ea89 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:44.341402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:44.353134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3857967-4610-4ab0-86c2-46d33a777183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:44.354237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3857967-4610-4ab0-86c2-46d33a777183 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:44.355076 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3857967-4610-4ab0-86c2-46d33a777183 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:44.355580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3857967-4610-4ab0-86c2-46d33a777183 None admin] PATH_INFO: `/v3/users/eff5fc4521044d4aa5829e339b10b23f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:44.357002 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3857967-4610-4ab0-86c2-46d33a777183 None admin] RBAC: Authorizing `identity:get_user(user_id=eff5fc4521044d4aa5829e339b10b23f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:44.358856 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3857967-4610-4ab0-86c2-46d33a777183 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:44.360767 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 15/30] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:27:44 2022] GET /identity/v3/users/eff5fc4521044d4aa5829e339b10b23f => generated 248 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:44.361764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3857967-4610-4ab0-86c2-46d33a777183 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:44.374479 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4176e-97aa-4acc-bfc7-407a6d056b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:44.375568 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4176e-97aa-4acc-bfc7-407a6d056b0f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:44.375998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4176e-97aa-4acc-bfc7-407a6d056b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:44.376430 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4176e-97aa-4acc-bfc7-407a6d056b0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:44.388425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4176e-97aa-4acc-bfc7-407a6d056b0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:44.390088 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4176e-97aa-4acc-bfc7-407a6d056b0f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:44.408914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-4dc4176e-97aa-4acc-bfc7-407a6d056b0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:44.408914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:44.408914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:44.408914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:44.408914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:44.408914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:44.408914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:44.408914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:44.408914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:44.408914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:44.408914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:44.408914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:44.408914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:44.408914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:44.408914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:44.409788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:44.409788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:44.409788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:44.409788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:44.409788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:44.409788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:44.409788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:44.409788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:44.409788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:27:44.409788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:44.409788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:44.409788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:44.409788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:44.409788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:44.409788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:44.409788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:44.409788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:44.410608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:44.410608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:44.410608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:44.410608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:27:44.412393 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 16/31] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:44.413794 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac5d5c-011f-4a7e-8091-4c15d3e3842a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:44.414225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac5d5c-011f-4a7e-8091-4c15d3e3842a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:44.414724 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac5d5c-011f-4a7e-8091-4c15d3e3842a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:44.416711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 17/32] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:44.417548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac5d5c-011f-4a7e-8091-4c15d3e3842a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:44.492461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3857967-4610-4ab0-86c2-46d33a777183 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:44.525562 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac5d5c-011f-4a7e-8091-4c15d3e3842a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:44.532279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5e5ee-88fe-4d21-a15a-d0335fb32a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:44.533150 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5e5ee-88fe-4d21-a15a-d0335fb32a46 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:44.533586 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5e5ee-88fe-4d21-a15a-d0335fb32a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:44.534035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5e5ee-88fe-4d21-a15a-d0335fb32a46 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:44.535045 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5e5ee-88fe-4d21-a15a-d0335fb32a46 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:44.536681 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5e5ee-88fe-4d21-a15a-d0335fb32a46 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:44.539573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:44.564192 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8675e-3734-440e-b717-81012896d6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:44.565000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8675e-3734-440e-b717-81012896d6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:44.565287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8675e-3734-440e-b717-81012896d6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:44.565569 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8675e-3734-440e-b717-81012896d6e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:44.567058 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8675e-3734-440e-b717-81012896d6e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:44.568492 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8675e-3734-440e-b717-81012896d6e7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:44.570112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 18/33] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:27:44 2022] GET /identity/v3/domains/default => generated 200 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:44.571190 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8675e-3734-440e-b717-81012896d6e7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:44.612033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:44.694980 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 16/34] 10.222.0.110 () {60 vars in 1136 bytes} [Thu May 26 16:27:44 2022] POST /identity/v3/roles => generated 220 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:27:44.700783 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8675e-3734-440e-b717-81012896d6e7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:44.700979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1689283-c766-437f-b5fc-87595544ea22 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:44.700979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1689283-c766-437f-b5fc-87595544ea22 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:44.700979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1689283-c766-437f-b5fc-87595544ea22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:44.735032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b1689283-c766-437f-b5fc-87595544ea22 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:44.736673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b1689283-c766-437f-b5fc-87595544ea22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:44.794287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4d068-2103-4b6e-93bc-0b8361079ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:44.794923 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4d068-2103-4b6e-93bc-0b8361079ace None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:44.795210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4d068-2103-4b6e-93bc-0b8361079ace None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:44.795489 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4d068-2103-4b6e-93bc-0b8361079ace None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:44.796234 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4d068-2103-4b6e-93bc-0b8361079ace None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:44.796552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4d068-2103-4b6e-93bc-0b8361079ace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:44.797950 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4d068-2103-4b6e-93bc-0b8361079ace None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:44.822251 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 19/35] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:27:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:44.823549 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4d068-2103-4b6e-93bc-0b8361079ace None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:44.921633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 17/36] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:44.922486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1689283-c766-437f-b5fc-87595544ea22 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:44.985329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:44.996558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4d068-2103-4b6e-93bc-0b8361079ace None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:45.038878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f24d1-e240-4813-9233-45243e5d1b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:45.039767 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f24d1-e240-4813-9233-45243e5d1b4e None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:45.040237 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f24d1-e240-4813-9233-45243e5d1b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:45.040597 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f24d1-e240-4813-9233-45243e5d1b4e None admin] PATH_INFO: `/v3/domains/default/users/eff5fc4521044d4aa5829e339b10b23f/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:45.042919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f24d1-e240-4813-9233-45243e5d1b4e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=eff5fc4521044d4aa5829e339b10b23f, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:45.044667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f24d1-e240-4813-9233-45243e5d1b4e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:45.053174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1689283-c766-437f-b5fc-87595544ea22 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:45.082153 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:45.103902 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b46b74-f8f8-464c-a149-a2dff2f65228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:45.105308 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b46b74-f8f8-464c-a149-a2dff2f65228 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:45.105580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b46b74-f8f8-464c-a149-a2dff2f65228 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:45.105900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b46b74-f8f8-464c-a149-a2dff2f65228 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:45.109218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b46b74-f8f8-464c-a149-a2dff2f65228 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:45.109218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b46b74-f8f8-464c-a149-a2dff2f65228 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:45.141492 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 18/37] 10.222.0.110 () {60 vars in 1146 bytes} [Thu May 26 16:27:44 2022] POST /identity/v3/projects => generated 302 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:27:45.141492 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b46b74-f8f8-464c-a149-a2dff2f65228 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:45.171943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 20/38] 10.222.0.110 () {58 vars in 1366 bytes} [Thu May 26 16:27:44 2022] PUT /identity/v3/domains/default/users/eff5fc4521044d4aa5829e339b10b23f/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:27:45.173784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec7b8e-6110-495e-8df8-7d8268f12537 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:45.174086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec7b8e-6110-495e-8df8-7d8268f12537 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:45.174370 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec7b8e-6110-495e-8df8-7d8268f12537 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:45.178974 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 21/39] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:45 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:45.190702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c2dab-0aa5-4dc6-87a0-310e7e4cdc69 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:45.191033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c2dab-0aa5-4dc6-87a0-310e7e4cdc69 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:45.191319 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c2dab-0aa5-4dc6-87a0-310e7e4cdc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:45.219319 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1d6c2dab-0aa5-4dc6-87a0-310e7e4cdc69 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:45.221200 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1d6c2dab-0aa5-4dc6-87a0-310e7e4cdc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:45.278912 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b46b74-f8f8-464c-a149-a2dff2f65228 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:45.310932 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 22/40] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:45.314627 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793c7a4-33b6-4f11-9882-983f36e57618 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:45.314627 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793c7a4-33b6-4f11-9882-983f36e57618 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:45.314627 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793c7a4-33b6-4f11-9882-983f36e57618 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:45.314627 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 23/41] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:45.320201 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee5489-db2b-44d6-a71b-40eb14489dcb None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:45.320589 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee5489-db2b-44d6-a71b-40eb14489dcb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:45.320779 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee5489-db2b-44d6-a71b-40eb14489dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:45.330293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec992f8-3de9-4e9b-9493-b8cdbfbff137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:45.331497 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec992f8-3de9-4e9b-9493-b8cdbfbff137 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:45.332041 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec992f8-3de9-4e9b-9493-b8cdbfbff137 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:45.332570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec992f8-3de9-4e9b-9493-b8cdbfbff137 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:45.333594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec992f8-3de9-4e9b-9493-b8cdbfbff137 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:45.335582 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec992f8-3de9-4e9b-9493-b8cdbfbff137 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:45.360780 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 19/42] 10.222.0.110 () {60 vars in 1136 bytes} [Thu May 26 16:27:45 2022] POST /identity/v3/roles => generated 226 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:27:45.362380 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec992f8-3de9-4e9b-9493-b8cdbfbff137 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:45.362488 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-04ee5489-db2b-44d6-a71b-40eb14489dcb None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:45.363868 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-04ee5489-db2b-44d6-a71b-40eb14489dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:45.414390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:45.457002 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 24/43] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:27:45.490500 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec992f8-3de9-4e9b-9493-b8cdbfbff137 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:45.491010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee5489-db2b-44d6-a71b-40eb14489dcb None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:45.503240 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:45.552535 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1e227-9e47-479b-86d1-e61e4237caed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:45.553316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1e227-9e47-479b-86d1-e61e4237caed None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:45.553663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1e227-9e47-479b-86d1-e61e4237caed None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:45.554006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1e227-9e47-479b-86d1-e61e4237caed None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:45.554864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1e227-9e47-479b-86d1-e61e4237caed None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:45.556386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1e227-9e47-479b-86d1-e61e4237caed None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:45.577075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 20/44] 10.222.0.110 () {60 vars in 1136 bytes} [Thu May 26 16:27:45 2022] POST /identity/v3/roles => generated 224 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:27:45.633823 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee5489-db2b-44d6-a71b-40eb14489dcb None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:45.675320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4249f-b47b-4247-a761-00eab659256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:45.676144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4249f-b47b-4247-a761-00eab659256c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:45.676430 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4249f-b47b-4247-a761-00eab659256c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:45.676709 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4249f-b47b-4247-a761-00eab659256c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:45.677940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4249f-b47b-4247-a761-00eab659256c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:45.679599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4249f-b47b-4247-a761-00eab659256c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:45.681873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 25/45] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:27:45 2022] GET /identity/v3/domains/default => generated 200 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:45.687527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1e227-9e47-479b-86d1-e61e4237caed None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:45.811199 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:45.818043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1e227-9e47-479b-86d1-e61e4237caed None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:45.852998 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f289d-d4e2-4313-983e-a8aa87cef555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:45.854094 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f289d-d4e2-4313-983e-a8aa87cef555 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:45.854386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f289d-d4e2-4313-983e-a8aa87cef555 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:45.854702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f289d-d4e2-4313-983e-a8aa87cef555 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:45.855447 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f289d-d4e2-4313-983e-a8aa87cef555 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:45.856912 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f289d-d4e2-4313-983e-a8aa87cef555 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:45.881814 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 21/46] 10.222.0.110 () {60 vars in 1146 bytes} [Thu May 26 16:27:45 2022] POST /identity/v3/projects => generated 313 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:27:47.525086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5021152-ccea-40dd-a29d-33a76abc24ab None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:47.525597 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5021152-ccea-40dd-a29d-33a76abc24ab None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:47.525698 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5021152-ccea-40dd-a29d-33a76abc24ab None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:47.527072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 26/47] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:47.532598 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f4180-0c3d-4e3d-8507-8e41573f7158 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:47.532995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f4180-0c3d-4e3d-8507-8e41573f7158 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:47.533177 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f4180-0c3d-4e3d-8507-8e41573f7158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:47.550950 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-142f4180-0c3d-4e3d-8507-8e41573f7158 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:47.552161 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-142f4180-0c3d-4e3d-8507-8e41573f7158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:47.618185 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 22/48] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:47.641175 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5021152-ccea-40dd-a29d-33a76abc24ab None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:47.717073 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:47.742279 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5021152-ccea-40dd-a29d-33a76abc24ab None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:47.776376 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b8312-477d-4b4b-8b22-fdb186d835e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:47.777174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b8312-477d-4b4b-8b22-fdb186d835e5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:47.777464 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b8312-477d-4b4b-8b22-fdb186d835e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:47.777744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b8312-477d-4b4b-8b22-fdb186d835e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:47.788622 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b8312-477d-4b4b-8b22-fdb186d835e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:47.798086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-907b8312-477d-4b4b-8b22-fdb186d835e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:47.798086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:47.798086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:47.798086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:47.798086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:47.798086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:47.798086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:47.798086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:47.798086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:47.798086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:47.798086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:47.798086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:47.798086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:47.798086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:47.798086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:47.798086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:47.798981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:47.798981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:47.798981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:47.798981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:47.798981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:47.798981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:47.798981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:47.798981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:47.798981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:47.798981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:47.798981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:47.798981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:27:47.798981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:47.798981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:47.798981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:47.798981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:47.799782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:47.799782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:47.799782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:47.799782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:47.799782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:47.799782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:47.799782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:47.799782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:47.799782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:47.799782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:47.799782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:47.799782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:27:47.799782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 27/49] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:27:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:47.805074 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f4180-0c3d-4e3d-8507-8e41573f7158 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:47.880806 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:47.904202 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f4180-0c3d-4e3d-8507-8e41573f7158 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:47.941636 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30425c76-9b84-451b-962a-0d4bde9d2fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:47.942323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30425c76-9b84-451b-962a-0d4bde9d2fad None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:47.942641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30425c76-9b84-451b-962a-0d4bde9d2fad None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:47.942930 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30425c76-9b84-451b-962a-0d4bde9d2fad None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:47.943690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30425c76-9b84-451b-962a-0d4bde9d2fad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:47.944012 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30425c76-9b84-451b-962a-0d4bde9d2fad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:47.945411 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30425c76-9b84-451b-962a-0d4bde9d2fad None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:47.954059 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 23/50] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:27:47 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:47.959656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b8312-477d-4b4b-8b22-fdb186d835e5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:48.059329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b8312-477d-4b4b-8b22-fdb186d835e5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:48.092189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41204816-c605-4b9e-ab3b-5e58cbeda155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:48.093067 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41204816-c605-4b9e-ab3b-5e58cbeda155 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:48.093357 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41204816-c605-4b9e-ab3b-5e58cbeda155 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:48.093641 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41204816-c605-4b9e-ab3b-5e58cbeda155 None admin] PATH_INFO: `/v3/users/eff5fc4521044d4aa5829e339b10b23f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:48.094871 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41204816-c605-4b9e-ab3b-5e58cbeda155 None admin] RBAC: Authorizing `identity:get_user(user_id=eff5fc4521044d4aa5829e339b10b23f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:48.096278 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef01b75-ac47-46e1-87ee-f1342b804169 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:48.096381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41204816-c605-4b9e-ab3b-5e58cbeda155 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:48.096579 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef01b75-ac47-46e1-87ee-f1342b804169 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:48.096869 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef01b75-ac47-46e1-87ee-f1342b804169 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:48.097953 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 28/51] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:27:47 2022] GET /identity/v3/users/eff5fc4521044d4aa5829e339b10b23f => generated 248 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:48.098250 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 24/52] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:27:48.103303 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41204816-c605-4b9e-ab3b-5e58cbeda155 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:48.103835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e339460-5337-422b-8f37-2649b1f2c92c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:48.104163 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e339460-5337-422b-8f37-2649b1f2c92c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:48.104523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e339460-5337-422b-8f37-2649b1f2c92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:48.106805 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:48.125218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0e339460-5337-422b-8f37-2649b1f2c92c None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:48.126706 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0e339460-5337-422b-8f37-2649b1f2c92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:48.196456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 25/53] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:48.203539 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41204816-c605-4b9e-ab3b-5e58cbeda155 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:48.219575 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e339460-5337-422b-8f37-2649b1f2c92c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:48.237377 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbbac9-2987-4ab0-95eb-8f3cc7199e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:48.238394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbbac9-2987-4ab0-95eb-8f3cc7199e2c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:48.238720 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbbac9-2987-4ab0-95eb-8f3cc7199e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:48.239004 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbbac9-2987-4ab0-95eb-8f3cc7199e2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:48.240189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbbac9-2987-4ab0-95eb-8f3cc7199e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:48.241653 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbbac9-2987-4ab0-95eb-8f3cc7199e2c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:48.243428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 29/54] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:27:48 2022] GET /identity/v3/domains/default => generated 200 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:48.248938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbbac9-2987-4ab0-95eb-8f3cc7199e2c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:48.287920 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:48.318978 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:48.319128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e339460-5337-422b-8f37-2649b1f2c92c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:48.351216 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbbac9-2987-4ab0-95eb-8f3cc7199e2c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:48.355970 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955c2c3-78b8-465e-8c7b-4f459df22999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:48.356772 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955c2c3-78b8-465e-8c7b-4f459df22999 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:48.357058 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955c2c3-78b8-465e-8c7b-4f459df22999 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:48.357335 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955c2c3-78b8-465e-8c7b-4f459df22999 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:48.358526 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955c2c3-78b8-465e-8c7b-4f459df22999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:48.360040 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955c2c3-78b8-465e-8c7b-4f459df22999 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:48.361849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 26/55] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:27:48 2022] GET /identity/v3/domains/default => generated 200 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:48.367174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955c2c3-78b8-465e-8c7b-4f459df22999 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:48.388682 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6d0e7-3046-4980-8c3b-1d4ccf6eff9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:48.389352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6d0e7-3046-4980-8c3b-1d4ccf6eff9f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:48.389647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6d0e7-3046-4980-8c3b-1d4ccf6eff9f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:48.389935 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6d0e7-3046-4980-8c3b-1d4ccf6eff9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:48.390803 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6d0e7-3046-4980-8c3b-1d4ccf6eff9f None admin] RBAC: Adding query filter params (role.id=1393d128d39b4649b6cd71b6609846cb, scope.domain.id=default, user.id=eff5fc4521044d4aa5829e339b10b23f) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:48.391122 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6d0e7-3046-4980-8c3b-1d4ccf6eff9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:48.392586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6d0e7-3046-4980-8c3b-1d4ccf6eff9f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:48.401214 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 30/56] 10.222.0.110 () {56 vars in 1327 bytes} [Thu May 26 16:27:48 2022] GET /identity/v3/role_assignments?user.id=eff5fc4521044d4aa5829e339b10b23f&scope.domain.id=default&role.id=1393d128d39b4649b6cd71b6609846cb => generated 532 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:48.470632 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955c2c3-78b8-465e-8c7b-4f459df22999 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:48.505801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63e2e1-7ced-4a59-bb2d-44dd01e6a756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:48.506482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63e2e1-7ced-4a59-bb2d-44dd01e6a756 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:48.506794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63e2e1-7ced-4a59-bb2d-44dd01e6a756 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:48.507073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63e2e1-7ced-4a59-bb2d-44dd01e6a756 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:48.507791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63e2e1-7ced-4a59-bb2d-44dd01e6a756 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:48.509784 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63e2e1-7ced-4a59-bb2d-44dd01e6a756 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:48.518524 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:48.537233 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 27/57] 10.222.0.110 () {60 vars in 1145 bytes} [Thu May 26 16:27:48 2022] POST /identity/v3/projects => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:27:50.746199 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfae28-2ec0-4dcc-962b-226645975f77 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:50.746721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfae28-2ec0-4dcc-962b-226645975f77 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:50.746821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfae28-2ec0-4dcc-962b-226645975f77 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:50.748166 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 31/58] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:50.753758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474eeb6-ca16-496f-9876-7f6edf4a1325 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:50.754154 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474eeb6-ca16-496f-9876-7f6edf4a1325 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:50.754321 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474eeb6-ca16-496f-9876-7f6edf4a1325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:50.770802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6474eeb6-ca16-496f-9876-7f6edf4a1325 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:50.772002 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6474eeb6-ca16-496f-9876-7f6edf4a1325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:50.836232 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 28/59] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:50.860331 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfae28-2ec0-4dcc-962b-226645975f77 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:50.959744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfae28-2ec0-4dcc-962b-226645975f77 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:50.991908 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699411f-1b4c-4323-ab8d-eba94cfc0de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:50.992767 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699411f-1b4c-4323-ab8d-eba94cfc0de5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:50.993595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699411f-1b4c-4323-ab8d-eba94cfc0de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:50.993872 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699411f-1b4c-4323-ab8d-eba94cfc0de5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:50.995057 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699411f-1b4c-4323-ab8d-eba94cfc0de5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:50.996549 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699411f-1b4c-4323-ab8d-eba94cfc0de5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:50.998092 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 32/60] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:27:50 2022] GET /identity/v3/domains/default => generated 200 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:51.003787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474eeb6-ca16-496f-9876-7f6edf4a1325 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:51.099758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474eeb6-ca16-496f-9876-7f6edf4a1325 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:51.119818 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:51.134638 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803263d-0a36-4fc8-a9cc-f3d638d6478a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:51.135803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803263d-0a36-4fc8-a9cc-f3d638d6478a None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:51.136093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803263d-0a36-4fc8-a9cc-f3d638d6478a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:51.136379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803263d-0a36-4fc8-a9cc-f3d638d6478a None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:51.137107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803263d-0a36-4fc8-a9cc-f3d638d6478a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:51.138580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803263d-0a36-4fc8-a9cc-f3d638d6478a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:51.162655 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 29/61] 10.222.0.110 () {60 vars in 1137 bytes} [Thu May 26 16:27:51 2022] POST /identity/v3/users => generated 276 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:27:54.354003 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c77e2-9949-4279-b82c-3fe0e14baa00 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:54.355052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c77e2-9949-4279-b82c-3fe0e14baa00 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:54.355547 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c77e2-9949-4279-b82c-3fe0e14baa00 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:54.357396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 33/62] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:54 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:54.363299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf825c96-c45f-415d-b711-a9dd4bb51600 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:54.364189 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf825c96-c45f-415d-b711-a9dd4bb51600 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:54.364692 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf825c96-c45f-415d-b711-a9dd4bb51600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:54.388343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bf825c96-c45f-415d-b711-a9dd4bb51600 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:54.389554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bf825c96-c45f-415d-b711-a9dd4bb51600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:54.482420 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 30/63] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:54.506664 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c77e2-9949-4279-b82c-3fe0e14baa00 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:54.509766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:54.635727 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c77e2-9949-4279-b82c-3fe0e14baa00 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:54.690593 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3f7a6-a275-4299-a75d-9a2e22b996db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:54.691405 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3f7a6-a275-4299-a75d-9a2e22b996db None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:54.691696 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3f7a6-a275-4299-a75d-9a2e22b996db None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:54.691976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3f7a6-a275-4299-a75d-9a2e22b996db None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:54.703690 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3f7a6-a275-4299-a75d-9a2e22b996db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:54.711629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-b1e3f7a6-a275-4299-a75d-9a2e22b996db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:27:54.711629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:54.711629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:54.711629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:54.711629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:54.711629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:54.711629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:54.711629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:54.711629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:54.711629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:54.711629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:54.711629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:54.711629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:54.711629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:54.711629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:54.711629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:54.712558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:54.712558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:54.712558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:54.712558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:54.712558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:54.712558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:54.712558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:54.712558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:54.712558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:54.712558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:54.712558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:54.712558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:27:54.712558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:54.712558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:54.712558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:54.712558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:54.713312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:54.713312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:54.713312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:54.713312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:54.713312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:54.713312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:54.713312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:54.713312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:54.713312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:54.713312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:54.713312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:27:54.713312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:27:54.713312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 34/64] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:27:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:54.719798 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf825c96-c45f-415d-b711-a9dd4bb51600 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:54.799253 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668453ab-d24f-47ce-946d-91a980684cb9 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:54.799540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668453ab-d24f-47ce-946d-91a980684cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:54.800013 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668453ab-d24f-47ce-946d-91a980684cb9 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:54.801383 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 35/65] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:27:54.810789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0d053-6a6a-4f1b-9b51-0b10989ada43 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:54.811355 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0d053-6a6a-4f1b-9b51-0b10989ada43 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:54.811829 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0d053-6a6a-4f1b-9b51-0b10989ada43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:54.842616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1eb0d053-6a6a-4f1b-9b51-0b10989ada43 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:54.843827 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1eb0d053-6a6a-4f1b-9b51-0b10989ada43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:54.865943 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf825c96-c45f-415d-b711-a9dd4bb51600 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:54.877455 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:54.919112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d334c0-0dc7-4ab5-9f05-0ae84e56cf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:54.919810 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:54.920178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d334c0-0dc7-4ab5-9f05-0ae84e56cf93 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:54.920951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d334c0-0dc7-4ab5-9f05-0ae84e56cf93 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:54.921530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d334c0-0dc7-4ab5-9f05-0ae84e56cf93 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:54.922539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d334c0-0dc7-4ab5-9f05-0ae84e56cf93 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:54.923028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d334c0-0dc7-4ab5-9f05-0ae84e56cf93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:54.925066 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d334c0-0dc7-4ab5-9f05-0ae84e56cf93 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:54.942613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 36/66] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:27:54.942613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c0332-fbb6-4ee2-8254-b0c55a5fa59d None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:54.942613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c0332-fbb6-4ee2-8254-b0c55a5fa59d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:54.942613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c0332-fbb6-4ee2-8254-b0c55a5fa59d None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:54.942613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 37/67] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:54.943311 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 31/68] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:27:54 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:54.946984 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c0332-fbb6-4ee2-8254-b0c55a5fa59d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:54.959743 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0864f-fe07-452e-bc67-e3abae920644 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:54.960197 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0864f-fe07-452e-bc67-e3abae920644 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:54.960346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0864f-fe07-452e-bc67-e3abae920644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:54.984733 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ddf0864f-fe07-452e-bc67-e3abae920644 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:54.986797 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ddf0864f-fe07-452e-bc67-e3abae920644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:55.082057 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c0332-fbb6-4ee2-8254-b0c55a5fa59d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:55.082763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 32/69] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:27:55.084047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0864f-fe07-452e-bc67-e3abae920644 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:55.119921 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea931322-b304-4ff8-8560-166d81e53027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:55.120808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea931322-b304-4ff8-8560-166d81e53027 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.121097 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea931322-b304-4ff8-8560-166d81e53027 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.121508 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea931322-b304-4ff8-8560-166d81e53027 None admin] PATH_INFO: `/v3/users/a2fade2221bd4e6ca9ea62551c3c1ec6` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.139075 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea931322-b304-4ff8-8560-166d81e53027 None admin] RBAC: Authorizing `identity:get_user(user_id=a2fade2221bd4e6ca9ea62551c3c1ec6)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:55.140562 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea931322-b304-4ff8-8560-166d81e53027 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:55.142307 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 38/70] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:27:54 2022] GET /identity/v3/users/a2fade2221bd4e6ca9ea62551c3c1ec6 => generated 276 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:55.143650 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf148c-0afb-4ece-824c-6afd695bfe01 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.143903 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf148c-0afb-4ece-824c-6afd695bfe01 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.144156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf148c-0afb-4ece-824c-6afd695bfe01 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.145531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 39/71] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:55.146100 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf148c-0afb-4ece-824c-6afd695bfe01 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:55.197481 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:55.198813 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:55.203038 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0864f-fe07-452e-bc67-e3abae920644 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:55.237445 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11868419-6843-441f-ae1f-27970c9bbdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:55.238252 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11868419-6843-441f-ae1f-27970c9bbdd8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.238543 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11868419-6843-441f-ae1f-27970c9bbdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.238860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11868419-6843-441f-ae1f-27970c9bbdd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.247671 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf148c-0afb-4ece-824c-6afd695bfe01 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:55.249107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11868419-6843-441f-ae1f-27970c9bbdd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:55.257229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-11868419-6843-441f-ae1f-27970c9bbdd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:55.257229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:55.257229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:55.257229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:55.257229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:55.257229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:55.257229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:55.257229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:55.257229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:55.257229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:55.257229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:55.257229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:55.257229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:55.257229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:55.257229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:55.257229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:55.258112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:55.258112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:55.258112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:55.258112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:55.258112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:55.258112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:55.258112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:55.258112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:55.258112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:55.258112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:55.258112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:55.258112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:27:55.258112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:55.258112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:55.258112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:55.258112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:55.259401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:55.259401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:55.259401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:55.259401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:55.259401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:55.259401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:55.259401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:55.259401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:55.259401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:55.259401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:55.259401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:55.259401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:27:55.259401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 33/72] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:27:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:55.260492 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fc828-85e1-4c85-80bb-0d4a9631741f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.260782 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fc828-85e1-4c85-80bb-0d4a9631741f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.261065 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fc828-85e1-4c85-80bb-0d4a9631741f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.262344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 34/73] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:55.266721 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fc828-85e1-4c85-80bb-0d4a9631741f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:55.287023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8b2dc-10d0-4d3c-8756-d3efa5d58e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:55.287832 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8b2dc-10d0-4d3c-8756-d3efa5d58e2b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.288121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8b2dc-10d0-4d3c-8756-d3efa5d58e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.288401 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8b2dc-10d0-4d3c-8756-d3efa5d58e2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.298223 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8b2dc-10d0-4d3c-8756-d3efa5d58e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:55.306292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-46d8b2dc-10d0-4d3c-8756-d3efa5d58e2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:27:55.306292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:55.306292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:55.306292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:55.306292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:55.306292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:55.306292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:55.306292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:55.306292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:55.306292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:55.306292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:55.306292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:55.306292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:55.306292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:55.306292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:55.306292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:55.307180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:55.307180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:55.307180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:55.307180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:55.307180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:55.307180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:55.307180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:55.307180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:55.307180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:55.307180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:55.307180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:55.307180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:27:55.307180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:55.307180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:55.307180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:55.307180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:55.308255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:55.308255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:55.308255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:55.308255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:55.308255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:55.308255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:55.308255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:55.308255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:55.308255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:55.308255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:55.308255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:27:55.308255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:27:55.308255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 40/74] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:27:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:55.309129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e932f2-8bbe-4868-a72d-9e6911de0a05 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.309129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e932f2-8bbe-4868-a72d-9e6911de0a05 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.309264 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e932f2-8bbe-4868-a72d-9e6911de0a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.325908 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d9e932f2-8bbe-4868-a72d-9e6911de0a05 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:55.327150 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d9e932f2-8bbe-4868-a72d-9e6911de0a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:55.369631 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fc828-85e1-4c85-80bb-0d4a9631741f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:55.396326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 41/75] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:55.397254 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e932f2-8bbe-4868-a72d-9e6911de0a05 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:55.407992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a29b7-6a59-40fc-82be-7bc4e007a5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:55.408655 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a29b7-6a59-40fc-82be-7bc4e007a5cb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.408952 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a29b7-6a59-40fc-82be-7bc4e007a5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.409236 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a29b7-6a59-40fc-82be-7bc4e007a5cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.437065 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:55.441050 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:55.479791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a29b7-6a59-40fc-82be-7bc4e007a5cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:55.481210 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a29b7-6a59-40fc-82be-7bc4e007a5cb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:55.498340 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e932f2-8bbe-4868-a72d-9e6911de0a05 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:55.532317 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d183da-a51a-4b19-9a01-75c16e9316ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:55.532992 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d183da-a51a-4b19-9a01-75c16e9316ba None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.533289 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d183da-a51a-4b19-9a01-75c16e9316ba None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.533569 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d183da-a51a-4b19-9a01-75c16e9316ba None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.534320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d183da-a51a-4b19-9a01-75c16e9316ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:55.534663 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d183da-a51a-4b19-9a01-75c16e9316ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:55.536038 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d183da-a51a-4b19-9a01-75c16e9316ba None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:55.547328 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 42/76] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:27:55 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:55.548533 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1843f-31ee-4401-ad1c-a71cf8d9bdde None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.548833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1843f-31ee-4401-ad1c-a71cf8d9bdde None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.549115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1843f-31ee-4401-ad1c-a71cf8d9bdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.565675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c2d1843f-31ee-4401-ad1c-a71cf8d9bdde None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:55.566917 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c2d1843f-31ee-4401-ad1c-a71cf8d9bdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:55.579068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 35/77] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:27:55 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:27:55.579913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a29b7-6a59-40fc-82be-7bc4e007a5cb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:55.635112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 43/78] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:55.636431 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1843f-31ee-4401-ad1c-a71cf8d9bdde None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:55.641703 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:55.668759 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:55.685527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a29b7-6a59-40fc-82be-7bc4e007a5cb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:55.720017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e374721-5956-470f-9c79-352a02a3134e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:55.721043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e374721-5956-470f-9c79-352a02a3134e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.721473 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e374721-5956-470f-9c79-352a02a3134e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.721754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e374721-5956-470f-9c79-352a02a3134e None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.722497 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e374721-5956-470f-9c79-352a02a3134e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:55.722835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e374721-5956-470f-9c79-352a02a3134e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:55.724204 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e374721-5956-470f-9c79-352a02a3134e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:55.732054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 36/79] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:27:55 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:55.732834 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e374721-5956-470f-9c79-352a02a3134e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:55.742170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1843f-31ee-4401-ad1c-a71cf8d9bdde None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:55.777361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ebecf-24dd-4bbc-8c13-97f590499fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:55.778383 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ebecf-24dd-4bbc-8c13-97f590499fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.778708 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ebecf-24dd-4bbc-8c13-97f590499fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.778991 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ebecf-24dd-4bbc-8c13-97f590499fb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.791432 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ebecf-24dd-4bbc-8c13-97f590499fb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:55.799741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-9b0ebecf-24dd-4bbc-8c13-97f590499fb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:27:55.799741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:55.799741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:55.799741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:55.799741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:55.799741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:55.799741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:55.799741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:55.799741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:55.799741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:55.799741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:55.799741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:55.799741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:55.799741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:55.799741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:55.799741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:55.800571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:55.800571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:55.800571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:55.800571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:55.800571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:55.800571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:55.800571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:55.800571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:55.800571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:55.800571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:55.800571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:55.800571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:27:55.800571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:55.800571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:55.800571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:55.800571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:55.801316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:55.801316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:55.801316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:55.801316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:55.801316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:55.801316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:55.801316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:55.801316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:55.801316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:55.801316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:55.801316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:27:55.801316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:27:55.801886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 44/80] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:27:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:55.802455 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ebecf-24dd-4bbc-8c13-97f590499fb4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:55.839532 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e374721-5956-470f-9c79-352a02a3134e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:55.859502 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:55.874019 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfb71e-3057-4647-84a1-b4137c9c85b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:55.874932 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfb71e-3057-4647-84a1-b4137c9c85b1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.875222 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfb71e-3057-4647-84a1-b4137c9c85b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.875502 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfb71e-3057-4647-84a1-b4137c9c85b1 None admin] PATH_INFO: `/v3/users/eff5fc4521044d4aa5829e339b10b23f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.876951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfb71e-3057-4647-84a1-b4137c9c85b1 None admin] RBAC: Authorizing `identity:get_user(user_id=eff5fc4521044d4aa5829e339b10b23f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:55.878398 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfb71e-3057-4647-84a1-b4137c9c85b1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:55.880078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 37/81] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:27:55 2022] GET /identity/v3/users/eff5fc4521044d4aa5829e339b10b23f => generated 248 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:55.880836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfb71e-3057-4647-84a1-b4137c9c85b1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:55.894684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:55.904341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ebecf-24dd-4bbc-8c13-97f590499fb4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:55.941658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f664fc2-689e-4adf-b2de-fbee8502fdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:55.942536 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f664fc2-689e-4adf-b2de-fbee8502fdfb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.942855 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f664fc2-689e-4adf-b2de-fbee8502fdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.943153 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f664fc2-689e-4adf-b2de-fbee8502fdfb None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.944381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f664fc2-689e-4adf-b2de-fbee8502fdfb None admin] RBAC: Authorizing `identity:get_project(project_id=24bc5f74b0d84b00b6067c0fbd6e896e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:55.946368 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f664fc2-689e-4adf-b2de-fbee8502fdfb None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:55.948132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 45/82] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:27:55 2022] GET /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e => generated 299 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:55.948903 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f664fc2-689e-4adf-b2de-fbee8502fdfb None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:56.000474 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfb71e-3057-4647-84a1-b4137c9c85b1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:56.035064 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e16128-94df-4124-b2cc-ae27040f0386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:56.035868 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e16128-94df-4124-b2cc-ae27040f0386 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:56.036161 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e16128-94df-4124-b2cc-ae27040f0386 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:56.036446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e16128-94df-4124-b2cc-ae27040f0386 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:56.037624 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e16128-94df-4124-b2cc-ae27040f0386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:56.039157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e16128-94df-4124-b2cc-ae27040f0386 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:56.040790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 38/83] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:27:55 2022] GET /identity/v3/domains/default => generated 200 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:56.043713 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e16128-94df-4124-b2cc-ae27040f0386 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:56.059302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f664fc2-689e-4adf-b2de-fbee8502fdfb None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:56.093204 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5556af5-3689-4f85-b658-033885346e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:56.094084 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5556af5-3689-4f85-b658-033885346e49 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:56.094372 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5556af5-3689-4f85-b658-033885346e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:56.094678 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5556af5-3689-4f85-b658-033885346e49 None admin] PATH_INFO: `/v3/users/a2fade2221bd4e6ca9ea62551c3c1ec6` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:56.095878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5556af5-3689-4f85-b658-033885346e49 None admin] RBAC: Authorizing `identity:get_user(user_id=a2fade2221bd4e6ca9ea62551c3c1ec6)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:56.097321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5556af5-3689-4f85-b658-033885346e49 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:56.098869 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:56.098973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 46/84] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:27:55 2022] GET /identity/v3/users/a2fade2221bd4e6ca9ea62551c3c1ec6 => generated 276 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:56.100067 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5556af5-3689-4f85-b658-033885346e49 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:56.129485 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:56.149318 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e16128-94df-4124-b2cc-ae27040f0386 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:56.183171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f356a-2884-4bc7-b865-51c8d6b442cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:56.183844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f356a-2884-4bc7-b865-51c8d6b442cb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:56.184134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f356a-2884-4bc7-b865-51c8d6b442cb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:56.184419 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f356a-2884-4bc7-b865-51c8d6b442cb None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:56.185167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f356a-2884-4bc7-b865-51c8d6b442cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:56.185478 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f356a-2884-4bc7-b865-51c8d6b442cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:56.186865 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f356a-2884-4bc7-b865-51c8d6b442cb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:56.194766 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 39/85] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:27:56 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:56.195547 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f356a-2884-4bc7-b865-51c8d6b442cb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:56.208228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5556af5-3689-4f85-b658-033885346e49 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:56.246257 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a912f-8ec1-4223-8aef-66e81d2a3896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:56.246941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a912f-8ec1-4223-8aef-66e81d2a3896 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:56.247234 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a912f-8ec1-4223-8aef-66e81d2a3896 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:56.247519 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a912f-8ec1-4223-8aef-66e81d2a3896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:56.294423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f356a-2884-4bc7-b865-51c8d6b442cb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:56.310393 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:56.314899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a912f-8ec1-4223-8aef-66e81d2a3896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:56.316391 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a912f-8ec1-4223-8aef-66e81d2a3896 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:56.326909 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a9380-13be-4407-861c-53c5946a1670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:56.327576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a9380-13be-4407-861c-53c5946a1670 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:56.327866 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a9380-13be-4407-861c-53c5946a1670 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:56.328164 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a9380-13be-4407-861c-53c5946a1670 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:56.328976 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a9380-13be-4407-861c-53c5946a1670 None admin] RBAC: Adding query filter params (role.id=1fdf01beb7394da2a4ea549a7d1bccf1, scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e, user.id=a2fade2221bd4e6ca9ea62551c3c1ec6) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:56.329296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a9380-13be-4407-861c-53c5946a1670 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:56.330773 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a9380-13be-4407-861c-53c5946a1670 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:56.336157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 40/86] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:27:56 2022] GET /identity/v3/role_assignments?user.id=a2fade2221bd4e6ca9ea62551c3c1ec6&scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e&role.id=1fdf01beb7394da2a4ea549a7d1bccf1 => generated 260 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:56.337444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a9380-13be-4407-861c-53c5946a1670 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:56.348697 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:56.440588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 47/87] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:27:56 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:27:56.442144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a912f-8ec1-4223-8aef-66e81d2a3896 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:56.462005 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a9380-13be-4407-861c-53c5946a1670 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:56.500457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba32f82-35c8-402f-8184-819f64159c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:56.501152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba32f82-35c8-402f-8184-819f64159c3c None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:56.501439 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba32f82-35c8-402f-8184-819f64159c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:56.501976 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba32f82-35c8-402f-8184-819f64159c3c None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:56.502733 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba32f82-35c8-402f-8184-819f64159c3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:56.504247 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba32f82-35c8-402f-8184-819f64159c3c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:56.527700 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 41/88] 10.222.0.110 () {60 vars in 1137 bytes} [Thu May 26 16:27:56 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:27:56.528318 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba32f82-35c8-402f-8184-819f64159c3c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:56.567036 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a912f-8ec1-4223-8aef-66e81d2a3896 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:56.586172 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:56.611768 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:56.625009 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2a2bc-ce9a-4150-95ac-3eb88a11e743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:56.625958 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2a2bc-ce9a-4150-95ac-3eb88a11e743 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:56.626964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2a2bc-ce9a-4150-95ac-3eb88a11e743 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:56.627395 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2a2bc-ce9a-4150-95ac-3eb88a11e743 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:56.676592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba32f82-35c8-402f-8184-819f64159c3c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:56.725107 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2a2bc-ce9a-4150-95ac-3eb88a11e743 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:56.726622 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2a2bc-ce9a-4150-95ac-3eb88a11e743 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:56.728395 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c990f-1b43-4274-9b21-09c564f957fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:56.729632 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c990f-1b43-4274-9b21-09c564f957fa None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:56.729936 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c990f-1b43-4274-9b21-09c564f957fa None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:56.730970 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c990f-1b43-4274-9b21-09c564f957fa None admin] PATH_INFO: `/v3/users/a2fade2221bd4e6ca9ea62551c3c1ec6` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:56.734046 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c990f-1b43-4274-9b21-09c564f957fa None admin] RBAC: Authorizing `identity:get_user(user_id=a2fade2221bd4e6ca9ea62551c3c1ec6)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:56.734046 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c990f-1b43-4274-9b21-09c564f957fa None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:56.736284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 42/89] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:27:56 2022] GET /identity/v3/users/a2fade2221bd4e6ca9ea62551c3c1ec6 => generated 276 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:56.740978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c990f-1b43-4274-9b21-09c564f957fa None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:56.867122 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 48/90] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:27:56 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:27:56.868037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2a2bc-ce9a-4150-95ac-3eb88a11e743 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:56.875157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c990f-1b43-4274-9b21-09c564f957fa None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:56.886207 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:56.907731 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:56.931161 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298e8cb-b05a-42f6-ad48-f033a8e3fbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:56.932845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298e8cb-b05a-42f6-ad48-f033a8e3fbfa None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:56.933191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298e8cb-b05a-42f6-ad48-f033a8e3fbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:56.933479 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298e8cb-b05a-42f6-ad48-f033a8e3fbfa None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:56.935369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298e8cb-b05a-42f6-ad48-f033a8e3fbfa None admin] RBAC: Authorizing `identity:get_project(project_id=24bc5f74b0d84b00b6067c0fbd6e896e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:56.936950 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298e8cb-b05a-42f6-ad48-f033a8e3fbfa None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:56.942625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 43/91] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:27:56 2022] GET /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e => generated 299 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:56.942625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298e8cb-b05a-42f6-ad48-f033a8e3fbfa None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:57.012345 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2a2bc-ce9a-4150-95ac-3eb88a11e743 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:57.057226 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624a300-6b4a-4276-88be-97bfb2f4adcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:57.057900 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624a300-6b4a-4276-88be-97bfb2f4adcc None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:57.058187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624a300-6b4a-4276-88be-97bfb2f4adcc None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:57.058467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624a300-6b4a-4276-88be-97bfb2f4adcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:57.070949 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298e8cb-b05a-42f6-ad48-f033a8e3fbfa None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:57.139663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd104b5-f202-4f37-beb9-fb80478d4b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:57.140465 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd104b5-f202-4f37-beb9-fb80478d4b9c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:57.140747 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd104b5-f202-4f37-beb9-fb80478d4b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:57.141019 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd104b5-f202-4f37-beb9-fb80478d4b9c None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:57.142303 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd104b5-f202-4f37-beb9-fb80478d4b9c None admin] RBAC: Authorizing `identity:get_project(project_id=24bc5f74b0d84b00b6067c0fbd6e896e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:57.143773 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd104b5-f202-4f37-beb9-fb80478d4b9c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:57.145779 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 44/92] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:27:56 2022] GET /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e => generated 299 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:57.146348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd104b5-f202-4f37-beb9-fb80478d4b9c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:57.197790 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624a300-6b4a-4276-88be-97bfb2f4adcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:57.200069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624a300-6b4a-4276-88be-97bfb2f4adcc None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:57.250478 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:57.251343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:57.331439 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd104b5-f202-4f37-beb9-fb80478d4b9c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:57.368423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6898d-fb09-406f-a037-775b91a778da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:57.369107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6898d-fb09-406f-a037-775b91a778da None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:57.369392 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6898d-fb09-406f-a037-775b91a778da None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:57.369672 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6898d-fb09-406f-a037-775b91a778da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:57.370510 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6898d-fb09-406f-a037-775b91a778da None admin] RBAC: Adding query filter params (role.id=1393d128d39b4649b6cd71b6609846cb, scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e, user.id=eff5fc4521044d4aa5829e339b10b23f) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:57.370854 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6898d-fb09-406f-a037-775b91a778da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:57.372551 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6898d-fb09-406f-a037-775b91a778da None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:57.378516 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 45/93] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:27:57 2022] GET /identity/v3/role_assignments?user.id=eff5fc4521044d4aa5829e339b10b23f&scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e&role.id=1393d128d39b4649b6cd71b6609846cb => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:57.384304 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6898d-fb09-406f-a037-775b91a778da None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:57.400009 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 49/94] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:27:56 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:27:57.407614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624a300-6b4a-4276-88be-97bfb2f4adcc None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:57.589715 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624a300-6b4a-4276-88be-97bfb2f4adcc None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:57.637213 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:57.656502 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26540fd-78a5-4202-b521-f66be144e700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:57.657314 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26540fd-78a5-4202-b521-f66be144e700 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:57.657608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26540fd-78a5-4202-b521-f66be144e700 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:57.657892 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26540fd-78a5-4202-b521-f66be144e700 None admin] PATH_INFO: `/v3/projects/b3e2abbf88db47f5a08249584a594cbd` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:57.663497 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26540fd-78a5-4202-b521-f66be144e700 None admin] RBAC: Authorizing `identity:get_project(project_id=b3e2abbf88db47f5a08249584a594cbd)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:57.665146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26540fd-78a5-4202-b521-f66be144e700 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:57.667009 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 50/95] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:27:57 2022] GET /identity/v3/projects/b3e2abbf88db47f5a08249584a594cbd => generated 313 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:57.674220 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6898d-fb09-406f-a037-775b91a778da None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:57.674971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26540fd-78a5-4202-b521-f66be144e700 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:57.686940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:57.739056 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd0a23-a7c8-455f-93e3-037d176cd599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:57.739768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd0a23-a7c8-455f-93e3-037d176cd599 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:57.740055 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd0a23-a7c8-455f-93e3-037d176cd599 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:57.740329 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd0a23-a7c8-455f-93e3-037d176cd599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:57.741165 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd0a23-a7c8-455f-93e3-037d176cd599 None admin] RBAC: Adding query filter params (role.id=634cfaacf2e444359b518d8dc7ed122b, scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e, user.id=a2fade2221bd4e6ca9ea62551c3c1ec6) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:57.741499 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd0a23-a7c8-455f-93e3-037d176cd599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:57.743315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd0a23-a7c8-455f-93e3-037d176cd599 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:57.761319 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 46/96] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:27:57 2022] GET /identity/v3/role_assignments?user.id=a2fade2221bd4e6ca9ea62551c3c1ec6&scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e&role.id=634cfaacf2e444359b518d8dc7ed122b => generated 260 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:57.833371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26540fd-78a5-4202-b521-f66be144e700 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:57.871121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602e9e3-e84d-4aec-84ba-c30389c23c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:57.871835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602e9e3-e84d-4aec-84ba-c30389c23c66 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:57.872127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602e9e3-e84d-4aec-84ba-c30389c23c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:57.872406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602e9e3-e84d-4aec-84ba-c30389c23c66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:57.873299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602e9e3-e84d-4aec-84ba-c30389c23c66 None admin] RBAC: Adding query filter params (role.id=1fdf01beb7394da2a4ea549a7d1bccf1, scope.project.id=b3e2abbf88db47f5a08249584a594cbd, user.id=a2fade2221bd4e6ca9ea62551c3c1ec6) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:57.873616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602e9e3-e84d-4aec-84ba-c30389c23c66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:57.875092 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602e9e3-e84d-4aec-84ba-c30389c23c66 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:57.881642 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 51/97] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:27:57 2022] GET /identity/v3/role_assignments?user.id=a2fade2221bd4e6ca9ea62551c3c1ec6&scope.project.id=b3e2abbf88db47f5a08249584a594cbd&role.id=1fdf01beb7394da2a4ea549a7d1bccf1 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:58.825072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fb02d-701c-4ae1-b930-aa3d87c2f488 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:58.825674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fb02d-701c-4ae1-b930-aa3d87c2f488 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:58.825674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fb02d-701c-4ae1-b930-aa3d87c2f488 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:58.827157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 47/98] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:58.832606 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb059d-21d4-44e9-a051-22048e5b497f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:58.833019 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb059d-21d4-44e9-a051-22048e5b497f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:58.833226 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb059d-21d4-44e9-a051-22048e5b497f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:58.856153 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b5eb059d-21d4-44e9-a051-22048e5b497f None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:58.857342 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b5eb059d-21d4-44e9-a051-22048e5b497f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:58.928335 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:58.940981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 52/99] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:58.975752 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fb02d-701c-4ae1-b930-aa3d87c2f488 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:59.110310 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fb02d-701c-4ae1-b930-aa3d87c2f488 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:59.146642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69be9a9-d0b4-43d8-92d7-eb5aeadf20ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:59.147454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69be9a9-d0b4-43d8-92d7-eb5aeadf20ca None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:59.147782 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69be9a9-d0b4-43d8-92d7-eb5aeadf20ca None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:59.148064 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69be9a9-d0b4-43d8-92d7-eb5aeadf20ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:59.158751 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69be9a9-d0b4-43d8-92d7-eb5aeadf20ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:59.167198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a69be9a9-d0b4-43d8-92d7-eb5aeadf20ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:27:59.167198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:59.167198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:59.167198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:59.167198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:59.167198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:59.167198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:59.167198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:59.167198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:59.167198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:59.167198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:59.167198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:59.167198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:59.167198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:59.167198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:59.167198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:59.168219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:59.168219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:59.168219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:59.168219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:59.168219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:59.168219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:59.168219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:59.168219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:59.168219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:59.168219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:59.168219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:59.168219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:27:59.168219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:59.168219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:59.168219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:59.168219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:59.169246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:59.169246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:59.169246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:59.169246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:59.169246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:59.169246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:59.169246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:59.169246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:59.169246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:59.169246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:59.169246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:27:59.169246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:27:59.169246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 48/100] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:27:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:59.174247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb059d-21d4-44e9-a051-22048e5b497f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:59.333119 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb059d-21d4-44e9-a051-22048e5b497f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:59.394150 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb80a6-ae68-4333-bb79-511d5781f815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:59.394898 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb80a6-ae68-4333-bb79-511d5781f815 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:59.395189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb80a6-ae68-4333-bb79-511d5781f815 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:59.395473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb80a6-ae68-4333-bb79-511d5781f815 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:59.396251 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb80a6-ae68-4333-bb79-511d5781f815 None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:59.396563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb80a6-ae68-4333-bb79-511d5781f815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:59.397993 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb80a6-ae68-4333-bb79-511d5781f815 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:59.411691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 53/101] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:27:59 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:59.417800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69be9a9-d0b4-43d8-92d7-eb5aeadf20ca None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:59.472174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:59.579002 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69be9a9-d0b4-43d8-92d7-eb5aeadf20ca None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:59.630187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845a4c8-6088-461d-9751-649d38a66bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:59.631384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a4c8-6088-461d-9751-649d38a66bfc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:59.631873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a4c8-6088-461d-9751-649d38a66bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:59.632338 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a4c8-6088-461d-9751-649d38a66bfc None admin] PATH_INFO: `/v3/users/a2fade2221bd4e6ca9ea62551c3c1ec6` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:59.633895 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845a4c8-6088-461d-9751-649d38a66bfc None admin] RBAC: Authorizing `identity:get_user(user_id=a2fade2221bd4e6ca9ea62551c3c1ec6)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:59.636068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845a4c8-6088-461d-9751-649d38a66bfc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:59.637894 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 49/102] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:27:59 2022] GET /identity/v3/users/a2fade2221bd4e6ca9ea62551c3c1ec6 => generated 276 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:59.643519 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb80a6-ae68-4333-bb79-511d5781f815 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:59.649791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8123b04-50e6-4d5c-8e0b-f822f3860e19 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:59.650079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8123b04-50e6-4d5c-8e0b-f822f3860e19 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:59.650360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8123b04-50e6-4d5c-8e0b-f822f3860e19 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:59.651760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 50/103] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:27:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:27:59.657772 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaab57c-9355-45a9-9a20-c59331bd1dc4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:59.658062 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaab57c-9355-45a9-9a20-c59331bd1dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:59.658340 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaab57c-9355-45a9-9a20-c59331bd1dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:59.676089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-acaab57c-9355-45a9-9a20-c59331bd1dc4 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:59.677506 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-acaab57c-9355-45a9-9a20-c59331bd1dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:59.750914 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 51/104] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:27:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:59.766083 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:59.820245 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaab57c-9355-45a9-9a20-c59331bd1dc4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:59.878516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb80a6-ae68-4333-bb79-511d5781f815 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:59.880129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:59.960347 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03567520-86d4-40a5-ac9b-c223296f384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:59.961205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03567520-86d4-40a5-ac9b-c223296f384c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:59.961499 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03567520-86d4-40a5-ac9b-c223296f384c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:59.961780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03567520-86d4-40a5-ac9b-c223296f384c None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:59.967296 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03567520-86d4-40a5-ac9b-c223296f384c None admin] RBAC: Authorizing `identity:get_project(project_id=24bc5f74b0d84b00b6067c0fbd6e896e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:59.968778 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03567520-86d4-40a5-ac9b-c223296f384c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:59.970508 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 54/105] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:27:59 2022] GET /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e => generated 299 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:59.975965 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03567520-86d4-40a5-ac9b-c223296f384c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.046695 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaab57c-9355-45a9-9a20-c59331bd1dc4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:00.124182 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec03c25-a44a-41cb-a42e-d5f63f4a4e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:00.125358 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec03c25-a44a-41cb-a42e-d5f63f4a4e29 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.125879 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec03c25-a44a-41cb-a42e-d5f63f4a4e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.126370 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec03c25-a44a-41cb-a42e-d5f63f4a4e29 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.145455 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec03c25-a44a-41cb-a42e-d5f63f4a4e29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:00.161415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5ec03c25-a44a-41cb-a42e-d5f63f4a4e29 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:00.161415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:00.161415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:00.161415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:00.161415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:00.161415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:00.161415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:00.161415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:00.161415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:00.161415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:00.161415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:00.161415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:00.161415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:00.161415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:00.161415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:00.161415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:00.162297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:00.162297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:00.162297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:00.162297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:00.162297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:00.162297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:00.162297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:00.162297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:00.162297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:00.162297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:00.162297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:00.162297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:00.162297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:00.162297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:00.162297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:00.162297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:00.163530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:00.163530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:00.163530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:00.163530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:00.163530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:00.163530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:00.163530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:00.163530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:00.163530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:00.163530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:00.163530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:00.163530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:00.163530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 52/106] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:27:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:00.168853 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec03c25-a44a-41cb-a42e-d5f63f4a4e29 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.286978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:00.292586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03567520-86d4-40a5-ac9b-c223296f384c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:00.306936 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec03c25-a44a-41cb-a42e-d5f63f4a4e29 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:00.330644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:00.373427 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b659feb-4ad4-4e07-81a1-929c65a92de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:00.374355 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b659feb-4ad4-4e07-81a1-929c65a92de5 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.374680 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b659feb-4ad4-4e07-81a1-929c65a92de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.374965 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b659feb-4ad4-4e07-81a1-929c65a92de5 None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e/users/a2fade2221bd4e6ca9ea62551c3c1ec6/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.378353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b659feb-4ad4-4e07-81a1-929c65a92de5 None admin] RBAC: Authorizing `identity:create_grant(project_id=24bc5f74b0d84b00b6067c0fbd6e896e, user_id=a2fade2221bd4e6ca9ea62551c3c1ec6, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:00.379855 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b659feb-4ad4-4e07-81a1-929c65a92de5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:00.387650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467d0f5-07c3-4d08-a54b-ed86b3e6b6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:00.388338 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467d0f5-07c3-4d08-a54b-ed86b3e6b6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.388627 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467d0f5-07c3-4d08-a54b-ed86b3e6b6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.388909 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467d0f5-07c3-4d08-a54b-ed86b3e6b6c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.389663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467d0f5-07c3-4d08-a54b-ed86b3e6b6c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:00.389980 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467d0f5-07c3-4d08-a54b-ed86b3e6b6c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:00.391387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467d0f5-07c3-4d08-a54b-ed86b3e6b6c7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:00.404679 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 55/107] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:27:59 2022] PUT /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e/users/a2fade2221bd4e6ca9ea62551c3c1ec6/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:00.406274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54215c9c-678c-49e0-b365-c0ac0c2bd2db None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.406583 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54215c9c-678c-49e0-b365-c0ac0c2bd2db None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.406875 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54215c9c-678c-49e0-b365-c0ac0c2bd2db None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.415461 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 56/108] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:00 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:00.417207 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 53/109] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:00 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:00.423612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467d0f5-07c3-4d08-a54b-ed86b3e6b6c7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.424069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3affa6-4099-4d4e-850e-01a8cf539fa0 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.424372 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3affa6-4099-4d4e-850e-01a8cf539fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.424661 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3affa6-4099-4d4e-850e-01a8cf539fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.459725 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0b3affa6-4099-4d4e-850e-01a8cf539fa0 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:00.460959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0b3affa6-4099-4d4e-850e-01a8cf539fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:00.563494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 57/110] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:00.609373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3affa6-4099-4d4e-850e-01a8cf539fa0 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.643478 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467d0f5-07c3-4d08-a54b-ed86b3e6b6c7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:00.752198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e66e3-a0d0-4a5a-b778-53cb9b06a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:00.753113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e66e3-a0d0-4a5a-b778-53cb9b06a9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.753403 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e66e3-a0d0-4a5a-b778-53cb9b06a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.753685 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e66e3-a0d0-4a5a-b778-53cb9b06a9b7 None admin] PATH_INFO: `/v3/users/7ddb3b82f68f4c34afae7180ff5aa5bd` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.763891 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3affa6-4099-4d4e-850e-01a8cf539fa0 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:00.775825 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:00.800047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e66e3-a0d0-4a5a-b778-53cb9b06a9b7 None admin] RBAC: Authorizing `identity:get_user(user_id=7ddb3b82f68f4c34afae7180ff5aa5bd)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:00.801533 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e66e3-a0d0-4a5a-b778-53cb9b06a9b7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:00.803333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 54/111] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:00 2022] GET /identity/v3/users/7ddb3b82f68f4c34afae7180ff5aa5bd => generated 290 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:00.811557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e66e3-a0d0-4a5a-b778-53cb9b06a9b7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.814453 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09789e2e-7221-43fa-9c80-56b705ff0d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:00.815477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09789e2e-7221-43fa-9c80-56b705ff0d5a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.815854 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09789e2e-7221-43fa-9c80-56b705ff0d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.816215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09789e2e-7221-43fa-9c80-56b705ff0d5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.823898 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09789e2e-7221-43fa-9c80-56b705ff0d5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:00.825524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09789e2e-7221-43fa-9c80-56b705ff0d5a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:00.827372 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 58/112] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:00 2022] GET /identity/v3/domains/default => generated 200 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:00.829250 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:00.834115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09789e2e-7221-43fa-9c80-56b705ff0d5a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:01.032883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09789e2e-7221-43fa-9c80-56b705ff0d5a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:01.107131 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba787646-ece6-4169-87d2-5a76f53d0ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:01.107738 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba787646-ece6-4169-87d2-5a76f53d0ec8 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.108052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba787646-ece6-4169-87d2-5a76f53d0ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.108340 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba787646-ece6-4169-87d2-5a76f53d0ec8 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.109085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba787646-ece6-4169-87d2-5a76f53d0ec8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:01.110757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba787646-ece6-4169-87d2-5a76f53d0ec8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:01.132381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e66e3-a0d0-4a5a-b778-53cb9b06a9b7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:01.143415 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 59/113] 10.222.0.110 () {60 vars in 1146 bytes} [Thu May 26 16:28:00 2022] POST /identity/v3/projects => generated 303 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:28:01.145195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f6ab6-3309-405d-b306-a14c4172d46d None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.145777 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f6ab6-3309-405d-b306-a14c4172d46d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.146272 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f6ab6-3309-405d-b306-a14c4172d46d None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.147812 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 60/114] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:01.149286 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaec28-14db-48e6-8c60-f034f26b05d0 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.149813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaec28-14db-48e6-8c60-f034f26b05d0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.150318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaec28-14db-48e6-8c60-f034f26b05d0 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.151948 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 61/115] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:01.154756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4376d-8cb8-4b93-9afd-015cbf72b1c4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.155288 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4376d-8cb8-4b93-9afd-015cbf72b1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.155765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4376d-8cb8-4b93-9afd-015cbf72b1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.179299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ace4376d-8cb8-4b93-9afd-015cbf72b1c4 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:01.181701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ace4376d-8cb8-4b93-9afd-015cbf72b1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:01.194128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72dc19-e577-483b-b0ba-cd9704c900b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:01.194666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72dc19-e577-483b-b0ba-cd9704c900b0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.194963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72dc19-e577-483b-b0ba-cd9704c900b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.195302 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72dc19-e577-483b-b0ba-cd9704c900b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.212253 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:01.265897 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 62/116] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:01.273205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb6ebf-7752-4f3e-8dad-f0b9c740a1b4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.273570 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb6ebf-7752-4f3e-8dad-f0b9c740a1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.274351 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb6ebf-7752-4f3e-8dad-f0b9c740a1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.298854 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72dc19-e577-483b-b0ba-cd9704c900b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:01.300882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72dc19-e577-483b-b0ba-cd9704c900b0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:01.304239 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3abb6ebf-7752-4f3e-8dad-f0b9c740a1b4 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:01.305494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3abb6ebf-7752-4f3e-8dad-f0b9c740a1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:01.313256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:01.396068 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 63/117] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:01.397604 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3b96b-6897-4af8-8d3c-b79fc98f7c26 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.397979 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3b96b-6897-4af8-8d3c-b79fc98f7c26 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.398320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3b96b-6897-4af8-8d3c-b79fc98f7c26 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.399873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 64/118] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:01.400673 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3b96b-6897-4af8-8d3c-b79fc98f7c26 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:01.439032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 55/119] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:00 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:01.440802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b0d07-8d3a-43e3-8679-52cac43e1051 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.441103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b0d07-8d3a-43e3-8679-52cac43e1051 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.441388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b0d07-8d3a-43e3-8679-52cac43e1051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.464283 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-315b0d07-8d3a-43e3-8679-52cac43e1051 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:01.465490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-315b0d07-8d3a-43e3-8679-52cac43e1051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:01.527257 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:01.542816 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 56/120] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:01.543123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3b96b-6897-4af8-8d3c-b79fc98f7c26 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:01.544238 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b0d07-8d3a-43e3-8679-52cac43e1051 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:01.589785 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:01.589975 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dd81c-c050-40a3-a53b-0c519d519c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:01.590933 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dd81c-c050-40a3-a53b-0c519d519c38 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.591315 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dd81c-c050-40a3-a53b-0c519d519c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.591710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dd81c-c050-40a3-a53b-0c519d519c38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.604059 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00dd81c-c050-40a3-a53b-0c519d519c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:01.612588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-b00dd81c-c050-40a3-a53b-0c519d519c38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:01.612588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:01.612588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:01.612588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:01.612588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:01.612588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:01.612588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:01.612588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:01.612588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:01.612588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:01.612588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:01.612588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:01.612588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:01.612588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:01.612588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:01.612588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:01.613644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:01.613644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:01.613644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:01.613644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:01.613644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:01.613644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:01.613644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:01.613644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:01.613644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:01.613644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:01.613644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:01.613644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:01.613644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:01.613644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:01.613644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:01.613644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:01.614614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:01.614614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:01.614614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:01.614614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:01.614614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:01.614614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:01.614614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:01.614614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:01.614614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:01.614614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:01.614614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:01.614614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:01.616629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 65/121] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:01.617986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dd81c-c050-40a3-a53b-0c519d519c38 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:01.660597 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b0d07-8d3a-43e3-8679-52cac43e1051 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:01.698308 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f51fe4-9086-4d19-bce4-f1f1ecc3a06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:01.699302 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f51fe4-9086-4d19-bce4-f1f1ecc3a06d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.699705 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f51fe4-9086-4d19-bce4-f1f1ecc3a06d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.700092 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f51fe4-9086-4d19-bce4-f1f1ecc3a06d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.718494 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f51fe4-9086-4d19-bce4-f1f1ecc3a06d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:01.727273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-97f51fe4-9086-4d19-bce4-f1f1ecc3a06d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:01.727273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:01.727273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:01.727273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:01.727273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:01.727273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:01.727273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:01.727273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:01.727273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:01.727273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:01.727273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:01.727273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:01.727273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:01.727273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:01.727273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:01.727273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:01.728333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:01.728333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:01.728333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:01.728333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:01.728333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:01.728333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:01.728333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:01.728333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:01.728333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:01.728333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:01.728333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:01.728333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:01.728333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:01.728333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:01.728333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:01.728333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:01.729276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:01.729276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:01.729276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:01.729276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:01.729276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:01.729276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:01.729276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:01.729276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:01.729276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:01.729276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:01.729276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:01.729276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:01.736044 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 57/122] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:28:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:01.737023 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f51fe4-9086-4d19-bce4-f1f1ecc3a06d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:01.756365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dd81c-c050-40a3-a53b-0c519d519c38 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:01.799735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb38a7-b428-4b1f-ba80-96948b9dbd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:01.800467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb38a7-b428-4b1f-ba80-96948b9dbd41 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.800851 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb38a7-b428-4b1f-ba80-96948b9dbd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.801305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb38a7-b428-4b1f-ba80-96948b9dbd41 None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.802534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb38a7-b428-4b1f-ba80-96948b9dbd41 None admin] RBAC: Authorizing `identity:get_project(project_id=24bc5f74b0d84b00b6067c0fbd6e896e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:01.804453 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb38a7-b428-4b1f-ba80-96948b9dbd41 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:01.806801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 66/123] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:01 2022] GET /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e => generated 299 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:01.807873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb38a7-b428-4b1f-ba80-96948b9dbd41 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:01.828923 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:01.857005 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:01.862238 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f51fe4-9086-4d19-bce4-f1f1ecc3a06d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:01.907401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f6102-b2d1-4476-8918-62acd0456bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:01.908487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f6102-b2d1-4476-8918-62acd0456bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.908926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f6102-b2d1-4476-8918-62acd0456bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.909360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f6102-b2d1-4476-8918-62acd0456bb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.922977 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb38a7-b428-4b1f-ba80-96948b9dbd41 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:01.923837 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f6102-b2d1-4476-8918-62acd0456bb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:01.934882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-206f6102-b2d1-4476-8918-62acd0456bb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:01.934882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:01.934882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:01.934882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:01.934882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:01.934882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:01.934882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:01.934882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:01.934882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:01.934882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:01.934882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:01.934882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:01.934882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:01.934882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:01.934882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:01.934882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:01.935760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:01.935760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:01.935760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:01.935760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:01.935760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:01.935760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:01.935760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:01.935760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:01.935760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:01.935760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:01.935760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:01.935760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:01.935760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:01.935760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:01.935760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:01.935760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:01.936534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:01.936534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:01.936534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:01.936534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:01.936534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:01.936534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:01.936534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:01.936534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:01.936534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:01.936534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:01.936534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:01.936534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:01.939071 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 58/124] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:28:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:01.940007 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f6102-b2d1-4476-8918-62acd0456bb1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:01.969166 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da8e80-afdf-4987-97f5-5b1a50c5cb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:01.969941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da8e80-afdf-4987-97f5-5b1a50c5cb0a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.970327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da8e80-afdf-4987-97f5-5b1a50c5cb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.970726 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da8e80-afdf-4987-97f5-5b1a50c5cb0a None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.971545 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da8e80-afdf-4987-97f5-5b1a50c5cb0a None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:01.971922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da8e80-afdf-4987-97f5-5b1a50c5cb0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:01.973488 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da8e80-afdf-4987-97f5-5b1a50c5cb0a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:01.983953 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 67/125] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:01 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:01.984539 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da8e80-afdf-4987-97f5-5b1a50c5cb0a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:02.071078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f6102-b2d1-4476-8918-62acd0456bb1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:02.085915 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:02.108674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f443ede-aff4-48b9-a84a-fe2417b3636d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:02.109702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f443ede-aff4-48b9-a84a-fe2417b3636d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:02.110017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f443ede-aff4-48b9-a84a-fe2417b3636d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:02.110529 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f443ede-aff4-48b9-a84a-fe2417b3636d None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:02.111419 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f443ede-aff4-48b9-a84a-fe2417b3636d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:02.111834 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f443ede-aff4-48b9-a84a-fe2417b3636d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:02.113231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da8e80-afdf-4987-97f5-5b1a50c5cb0a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:02.113471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f443ede-aff4-48b9-a84a-fe2417b3636d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:02.123181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 59/126] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:01 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:02.124142 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f443ede-aff4-48b9-a84a-fe2417b3636d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:02.149608 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:02.160977 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e1dd9-0552-45a9-b0de-5cb235b1c2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:02.162183 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e1dd9-0552-45a9-b0de-5cb235b1c2cb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:02.162644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e1dd9-0552-45a9-b0de-5cb235b1c2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:02.163070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e1dd9-0552-45a9-b0de-5cb235b1c2cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:02.164833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e1dd9-0552-45a9-b0de-5cb235b1c2cb None admin] RBAC: Adding query filter params (role.id=2c812f60cda548deb1893180061ff8e5, scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e, user.id=7ddb3b82f68f4c34afae7180ff5aa5bd) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:02.166144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e1dd9-0552-45a9-b0de-5cb235b1c2cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:02.167770 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e1dd9-0552-45a9-b0de-5cb235b1c2cb None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:02.175032 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 68/127] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:28:01 2022] GET /identity/v3/role_assignments?user.id=7ddb3b82f68f4c34afae7180ff5aa5bd&scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e&role.id=2c812f60cda548deb1893180061ff8e5 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:02.176285 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e1dd9-0552-45a9-b0de-5cb235b1c2cb None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:02.302963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f443ede-aff4-48b9-a84a-fe2417b3636d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:02.349053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d682fdb-6b9e-41ba-a414-c2a3a524f946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:02.349760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d682fdb-6b9e-41ba-a414-c2a3a524f946 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:02.350052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d682fdb-6b9e-41ba-a414-c2a3a524f946 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:02.353592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d682fdb-6b9e-41ba-a414-c2a3a524f946 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:02.354703 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d682fdb-6b9e-41ba-a414-c2a3a524f946 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:02.355029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d682fdb-6b9e-41ba-a414-c2a3a524f946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:02.356450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d682fdb-6b9e-41ba-a414-c2a3a524f946 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:02.378908 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 60/128] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:28:02 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:02.380130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d682fdb-6b9e-41ba-a414-c2a3a524f946 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:02.415449 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e1dd9-0552-45a9-b0de-5cb235b1c2cb None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:02.466760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3b368-592c-499a-b03c-cf2fe11de524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:02.467573 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3b368-592c-499a-b03c-cf2fe11de524 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:02.467864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3b368-592c-499a-b03c-cf2fe11de524 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:02.468149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3b368-592c-499a-b03c-cf2fe11de524 None admin] PATH_INFO: `/v3/users/a2fade2221bd4e6ca9ea62551c3c1ec6` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:02.471402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3b368-592c-499a-b03c-cf2fe11de524 None admin] RBAC: Authorizing `identity:get_user(user_id=a2fade2221bd4e6ca9ea62551c3c1ec6)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:02.472882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3b368-592c-499a-b03c-cf2fe11de524 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:02.474537 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 69/129] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:02 2022] GET /identity/v3/users/a2fade2221bd4e6ca9ea62551c3c1ec6 => generated 276 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:02.475332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3b368-592c-499a-b03c-cf2fe11de524 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:02.513784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:02.517374 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:02.553030 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d682fdb-6b9e-41ba-a414-c2a3a524f946 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:02.629394 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f8ad1-4356-4f95-a85e-2aa6f4456b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:02.630310 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f8ad1-4356-4f95-a85e-2aa6f4456b93 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:02.630613 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f8ad1-4356-4f95-a85e-2aa6f4456b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:02.630895 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f8ad1-4356-4f95-a85e-2aa6f4456b93 None admin] PATH_INFO: `/v3/users/eff5fc4521044d4aa5829e339b10b23f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:02.637662 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f8ad1-4356-4f95-a85e-2aa6f4456b93 None admin] RBAC: Authorizing `identity:get_user(user_id=eff5fc4521044d4aa5829e339b10b23f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:02.639187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f8ad1-4356-4f95-a85e-2aa6f4456b93 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:02.640870 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 61/130] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:02 2022] GET /identity/v3/users/eff5fc4521044d4aa5829e339b10b23f => generated 248 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:02.641639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f8ad1-4356-4f95-a85e-2aa6f4456b93 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:02.696114 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3b368-592c-499a-b03c-cf2fe11de524 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:02.775925 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8b380-5707-4bd7-b478-31c56041c876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:02.777398 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8b380-5707-4bd7-b478-31c56041c876 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:02.777893 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8b380-5707-4bd7-b478-31c56041c876 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:02.778387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8b380-5707-4bd7-b478-31c56041c876 None admin] PATH_INFO: `/v3/users/a2fade2221bd4e6ca9ea62551c3c1ec6` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:02.779953 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8b380-5707-4bd7-b478-31c56041c876 None admin] RBAC: Authorizing `identity:get_user(user_id=a2fade2221bd4e6ca9ea62551c3c1ec6)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:02.781721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8b380-5707-4bd7-b478-31c56041c876 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:02.783617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 70/131] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:02 2022] GET /identity/v3/users/a2fade2221bd4e6ca9ea62551c3c1ec6 => generated 276 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:02.787107 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8b380-5707-4bd7-b478-31c56041c876 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:02.813504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f8ad1-4356-4f95-a85e-2aa6f4456b93 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:02.864168 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf034153-3497-479b-9039-a542f687ac7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:02.865063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf034153-3497-479b-9039-a542f687ac7f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:02.865353 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf034153-3497-479b-9039-a542f687ac7f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:02.865634 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf034153-3497-479b-9039-a542f687ac7f None admin] PATH_INFO: `/v3/projects/b3e2abbf88db47f5a08249584a594cbd` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:02.868521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf034153-3497-479b-9039-a542f687ac7f None admin] RBAC: Authorizing `identity:get_project(project_id=b3e2abbf88db47f5a08249584a594cbd)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:02.869981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf034153-3497-479b-9039-a542f687ac7f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:02.871727 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 62/132] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:02 2022] GET /identity/v3/projects/b3e2abbf88db47f5a08249584a594cbd => generated 313 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:02.872492 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf034153-3497-479b-9039-a542f687ac7f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:02.922076 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:02.925102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:02.946667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8b380-5707-4bd7-b478-31c56041c876 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:02.987878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbeb13-2b58-4beb-8b8b-fb0ef720153e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:02.989100 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbeb13-2b58-4beb-8b8b-fb0ef720153e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:02.989591 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbeb13-2b58-4beb-8b8b-fb0ef720153e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:02.990070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbeb13-2b58-4beb-8b8b-fb0ef720153e None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:02.993885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbeb13-2b58-4beb-8b8b-fb0ef720153e None admin] RBAC: Authorizing `identity:get_project(project_id=24bc5f74b0d84b00b6067c0fbd6e896e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:02.996907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbeb13-2b58-4beb-8b8b-fb0ef720153e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:02.999625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 71/133] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:02 2022] GET /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e => generated 299 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:03.002709 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbeb13-2b58-4beb-8b8b-fb0ef720153e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:03.081788 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf034153-3497-479b-9039-a542f687ac7f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:03.130465 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488101d-2f15-4959-b675-a1aa0daaf71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:03.131388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488101d-2f15-4959-b675-a1aa0daaf71b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:03.131702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488101d-2f15-4959-b675-a1aa0daaf71b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:03.132371 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488101d-2f15-4959-b675-a1aa0daaf71b None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:03.133933 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488101d-2f15-4959-b675-a1aa0daaf71b None admin] RBAC: Authorizing `identity:get_project(project_id=24bc5f74b0d84b00b6067c0fbd6e896e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:03.135708 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488101d-2f15-4959-b675-a1aa0daaf71b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:03.138665 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 63/134] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:02 2022] GET /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e => generated 299 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:03.139959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488101d-2f15-4959-b675-a1aa0daaf71b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:03.142798 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbeb13-2b58-4beb-8b8b-fb0ef720153e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:03.180475 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21b917-e772-45f0-ab35-581deb698552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:03.181837 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21b917-e772-45f0-ab35-581deb698552 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:03.182334 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21b917-e772-45f0-ab35-581deb698552 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:03.182846 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21b917-e772-45f0-ab35-581deb698552 None admin] PATH_INFO: `/v3/projects/b3e2abbf88db47f5a08249584a594cbd/users/a2fade2221bd4e6ca9ea62551c3c1ec6/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:03.185383 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21b917-e772-45f0-ab35-581deb698552 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3e2abbf88db47f5a08249584a594cbd, user_id=a2fade2221bd4e6ca9ea62551c3c1ec6, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:03.187184 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21b917-e772-45f0-ab35-581deb698552 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:03.203523 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 72/135] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:28:03 2022] PUT /identity/v3/projects/b3e2abbf88db47f5a08249584a594cbd/users/a2fade2221bd4e6ca9ea62551c3c1ec6/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:03.213224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce525a-d9d3-4780-9b3c-f74b7843bd8c None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:03.213785 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce525a-d9d3-4780-9b3c-f74b7843bd8c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:03.214268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce525a-d9d3-4780-9b3c-f74b7843bd8c None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:03.216226 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 73/136] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:03.217237 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce525a-d9d3-4780-9b3c-f74b7843bd8c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:03.239301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:03.250062 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:03.268216 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488101d-2f15-4959-b675-a1aa0daaf71b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:03.355597 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf8316-0478-4252-9604-b82e58462777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:03.358952 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf8316-0478-4252-9604-b82e58462777 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:03.358952 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf8316-0478-4252-9604-b82e58462777 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:03.358952 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf8316-0478-4252-9604-b82e58462777 None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e/users/eff5fc4521044d4aa5829e339b10b23f/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:03.368032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf8316-0478-4252-9604-b82e58462777 None admin] RBAC: Authorizing `identity:create_grant(project_id=24bc5f74b0d84b00b6067c0fbd6e896e, user_id=eff5fc4521044d4aa5829e339b10b23f, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:03.369553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf8316-0478-4252-9604-b82e58462777 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:03.377071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce525a-d9d3-4780-9b3c-f74b7843bd8c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:03.420936 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04171d-3387-4e41-b9ec-f43688e76e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:03.422019 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 64/137] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:28:03 2022] PUT /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e/users/eff5fc4521044d4aa5829e339b10b23f/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:03.423006 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04171d-3387-4e41-b9ec-f43688e76e60 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:03.423310 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04171d-3387-4e41-b9ec-f43688e76e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:03.423596 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04171d-3387-4e41-b9ec-f43688e76e60 None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e/users/a2fade2221bd4e6ca9ea62551c3c1ec6/roles/634cfaacf2e444359b518d8dc7ed122b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:03.424645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd612d1-8995-4ca9-b546-fc4d820ae975 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:03.424933 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd612d1-8995-4ca9-b546-fc4d820ae975 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:03.425215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd612d1-8995-4ca9-b546-fc4d820ae975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:03.428960 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04171d-3387-4e41-b9ec-f43688e76e60 None admin] RBAC: Authorizing `identity:create_grant(project_id=24bc5f74b0d84b00b6067c0fbd6e896e, user_id=a2fade2221bd4e6ca9ea62551c3c1ec6, role_id=634cfaacf2e444359b518d8dc7ed122b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:03.431427 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04171d-3387-4e41-b9ec-f43688e76e60 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:03.456223 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 74/138] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:28:03 2022] PUT /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e/users/a2fade2221bd4e6ca9ea62551c3c1ec6/roles/634cfaacf2e444359b518d8dc7ed122b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:03.467981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bcd612d1-8995-4ca9-b546-fc4d820ae975 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:03.469352 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bcd612d1-8995-4ca9-b546-fc4d820ae975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:03.565848 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 65/139] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:03.608333 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04171d-3387-4e41-b9ec-f43688e76e60 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:03.692450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:03.719842 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ea78e-4b35-4242-8eb2-963f8394eff4 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:03.720136 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ea78e-4b35-4242-8eb2-963f8394eff4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:03.720409 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ea78e-4b35-4242-8eb2-963f8394eff4 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:03.721799 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 66/140] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:28:03.728463 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d7fae-bb2f-4d42-bd48-5c17732bd5bf None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:03.728782 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d7fae-bb2f-4d42-bd48-5c17732bd5bf None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:03.729017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d7fae-bb2f-4d42-bd48-5c17732bd5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:03.742882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04171d-3387-4e41-b9ec-f43688e76e60 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:03.756964 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8a7d7fae-bb2f-4d42-bd48-5c17732bd5bf None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:03.759010 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8a7d7fae-bb2f-4d42-bd48-5c17732bd5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:03.792306 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40428b-5bb0-48ce-86bd-921510549868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:03.795761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40428b-5bb0-48ce-86bd-921510549868 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:03.795761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40428b-5bb0-48ce-86bd-921510549868 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:03.795761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40428b-5bb0-48ce-86bd-921510549868 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:03.809201 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40428b-5bb0-48ce-86bd-921510549868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:03.818297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-db40428b-5bb0-48ce-86bd-921510549868 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:03.818297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:03.818297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:03.818297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:03.818297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:03.818297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:03.818297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:03.818297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:03.818297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:03.818297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:03.818297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:03.818297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:03.818297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:03.818297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:03.818297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:03.818297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:03.819276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:03.819276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:03.819276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:03.819276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:03.819276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:03.819276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:03.819276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:03.819276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:03.819276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:03.819276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:03.819276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:03.819276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:03.819276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:03.819276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:03.819276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:03.819276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:03.820162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:03.820162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:03.820162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:03.820162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:03.820162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:03.820162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:03.820162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:03.820162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:03.820162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:03.820162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:03.820162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:03.820162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:03.820162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 75/141] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:03.826432 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40428b-5bb0-48ce-86bd-921510549868 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:03.862075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 67/142] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:03.894646 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d7fae-bb2f-4d42-bd48-5c17732bd5bf None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:03.910957 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:04.002592 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40428b-5bb0-48ce-86bd-921510549868 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:04.055430 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:04.072684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3c39e-4009-4477-8811-d80c7ed534b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:04.073374 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3c39e-4009-4477-8811-d80c7ed534b8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.073669 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3c39e-4009-4477-8811-d80c7ed534b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.073951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3c39e-4009-4477-8811-d80c7ed534b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.074747 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3c39e-4009-4477-8811-d80c7ed534b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:04.075064 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3c39e-4009-4477-8811-d80c7ed534b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:04.076550 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3c39e-4009-4477-8811-d80c7ed534b8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:04.090481 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 76/143] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:03 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:04.099697 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3c39e-4009-4477-8811-d80c7ed534b8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:04.127868 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d7fae-bb2f-4d42-bd48-5c17732bd5bf None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:04.202605 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c1e82-1704-4e0a-8bdd-0be2bbce0118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:04.203479 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c1e82-1704-4e0a-8bdd-0be2bbce0118 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.203770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c1e82-1704-4e0a-8bdd-0be2bbce0118 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.204102 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c1e82-1704-4e0a-8bdd-0be2bbce0118 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.206314 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c1e82-1704-4e0a-8bdd-0be2bbce0118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:04.207828 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c1e82-1704-4e0a-8bdd-0be2bbce0118 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:04.209469 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 68/144] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:03 2022] GET /identity/v3/domains/default => generated 200 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:04.224760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c1e82-1704-4e0a-8bdd-0be2bbce0118 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:04.268993 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3c39e-4009-4477-8811-d80c7ed534b8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:04.305171 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092606f-cb36-403f-abdd-b138356fabd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:04.306064 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092606f-cb36-403f-abdd-b138356fabd6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.306357 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092606f-cb36-403f-abdd-b138356fabd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.306670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092606f-cb36-403f-abdd-b138356fabd6 None admin] PATH_INFO: `/v3/users/a2fade2221bd4e6ca9ea62551c3c1ec6` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.307958 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092606f-cb36-403f-abdd-b138356fabd6 None admin] RBAC: Authorizing `identity:get_user(user_id=a2fade2221bd4e6ca9ea62551c3c1ec6)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:04.309434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092606f-cb36-403f-abdd-b138356fabd6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:04.311177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 77/145] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:04 2022] GET /identity/v3/users/a2fade2221bd4e6ca9ea62551c3c1ec6 => generated 276 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:04.321927 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092606f-cb36-403f-abdd-b138356fabd6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:04.375639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:04.395008 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:04.440414 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092606f-cb36-403f-abdd-b138356fabd6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:04.454249 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c1e82-1704-4e0a-8bdd-0be2bbce0118 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:04.481205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52473f8a-ce23-475a-bcb0-16c683c9049f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:04.481868 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52473f8a-ce23-475a-bcb0-16c683c9049f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.482205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52473f8a-ce23-475a-bcb0-16c683c9049f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.482495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52473f8a-ce23-475a-bcb0-16c683c9049f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.561229 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52473f8a-ce23-475a-bcb0-16c683c9049f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:04.563413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52473f8a-ce23-475a-bcb0-16c683c9049f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:04.563836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02fc97-4464-460c-9c2c-990455a89b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:04.564544 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02fc97-4464-460c-9c2c-990455a89b37 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.564836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02fc97-4464-460c-9c2c-990455a89b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.565120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02fc97-4464-460c-9c2c-990455a89b37 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.565841 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02fc97-4464-460c-9c2c-990455a89b37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:04.567500 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02fc97-4464-460c-9c2c-990455a89b37 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:04.614753 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 69/146] 10.222.0.110 () {60 vars in 1137 bytes} [Thu May 26 16:28:04 2022] POST /identity/v3/users => generated 284 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:04.654361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:04.729360 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 78/147] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:04 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:28:04.735276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02fc97-4464-460c-9c2c-990455a89b37 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:04.853462 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02fc97-4464-460c-9c2c-990455a89b37 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:04.887292 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:04.908012 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc5836-b9aa-4e19-baa6-cb5de24d8a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:04.909159 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc5836-b9aa-4e19-baa6-cb5de24d8a4a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.909597 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc5836-b9aa-4e19-baa6-cb5de24d8a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.910030 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc5836-b9aa-4e19-baa6-cb5de24d8a4a None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.911461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc5836-b9aa-4e19-baa6-cb5de24d8a4a None admin] RBAC: Authorizing `identity:get_project(project_id=24bc5f74b0d84b00b6067c0fbd6e896e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:04.913088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc5836-b9aa-4e19-baa6-cb5de24d8a4a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:04.915577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 70/148] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:04 2022] GET /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e => generated 299 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:04.921517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52473f8a-ce23-475a-bcb0-16c683c9049f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:05.055769 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e1883-d81c-417b-b760-13b801e22958 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.056261 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e1883-d81c-417b-b760-13b801e22958 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.056652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e1883-d81c-417b-b760-13b801e22958 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.058296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 71/149] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:05.065774 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4516cdb-cb55-4a3f-95d9-0780b528ed3a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.065774 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4516cdb-cb55-4a3f-95d9-0780b528ed3a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.065774 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4516cdb-cb55-4a3f-95d9-0780b528ed3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.089879 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a4516cdb-cb55-4a3f-95d9-0780b528ed3a None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:05.091331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a4516cdb-cb55-4a3f-95d9-0780b528ed3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:05.092185 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52473f8a-ce23-475a-bcb0-16c683c9049f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:05.166263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba6861-7e8a-4fb6-887f-7bea7de9d4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:05.166994 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba6861-7e8a-4fb6-887f-7bea7de9d4ca None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.167393 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba6861-7e8a-4fb6-887f-7bea7de9d4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.167727 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba6861-7e8a-4fb6-887f-7bea7de9d4ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.168632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba6861-7e8a-4fb6-887f-7bea7de9d4ca None admin] RBAC: Adding query filter params (role.id=1fdf01beb7394da2a4ea549a7d1bccf1, scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e, user.id=a2fade2221bd4e6ca9ea62551c3c1ec6) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:05.168958 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba6861-7e8a-4fb6-887f-7bea7de9d4ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:05.175217 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba6861-7e8a-4fb6-887f-7bea7de9d4ca None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:05.192318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 79/150] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:28:04 2022] GET /identity/v3/role_assignments?user.id=a2fade2221bd4e6ca9ea62551c3c1ec6&scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e&role.id=1fdf01beb7394da2a4ea549a7d1bccf1 => generated 610 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:05.255534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 72/151] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:05.291224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba6861-7e8a-4fb6-887f-7bea7de9d4ca None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:05.327391 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:05.452324 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba6861-7e8a-4fb6-887f-7bea7de9d4ca None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:05.500296 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a815e58-5923-47eb-bb3f-711e93666187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:05.501110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a815e58-5923-47eb-bb3f-711e93666187 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.501702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a815e58-5923-47eb-bb3f-711e93666187 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.501984 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a815e58-5923-47eb-bb3f-711e93666187 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.514181 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a815e58-5923-47eb-bb3f-711e93666187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:05.522311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-3a815e58-5923-47eb-bb3f-711e93666187 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:05.522311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:05.522311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:05.522311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:05.522311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:05.522311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:05.522311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:05.522311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:05.522311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:05.522311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:05.522311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:05.522311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:05.522311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:05.522311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:05.522311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:05.522311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:05.523722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:05.523722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:05.523722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:05.523722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:05.523722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:05.523722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:05.523722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:05.523722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:05.523722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:05.523722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:05.523722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:05.523722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:05.523722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:05.523722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:05.523722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:05.523722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:05.524538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:05.524538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:05.524538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:05.524538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:05.524538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:05.524538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:05.524538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:05.524538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:05.524538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:05.524538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:05.524538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:05.524538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:05.525114 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 80/152] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:05.531344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4516cdb-cb55-4a3f-95d9-0780b528ed3a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:05.646977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4516cdb-cb55-4a3f-95d9-0780b528ed3a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:05.677736 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:05.685535 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068adff-0f18-45b5-996d-d164a9bfa8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:05.686734 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068adff-0f18-45b5-996d-d164a9bfa8ff None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.687418 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068adff-0f18-45b5-996d-d164a9bfa8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.687695 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068adff-0f18-45b5-996d-d164a9bfa8ff None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.688450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068adff-0f18-45b5-996d-d164a9bfa8ff None admin] RBAC: Adding query filter params (name=reader) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:05.688756 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068adff-0f18-45b5-996d-d164a9bfa8ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:05.690146 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068adff-0f18-45b5-996d-d164a9bfa8ff None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:05.701290 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 73/153] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:05 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:05.706957 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a815e58-5923-47eb-bb3f-711e93666187 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:05.793757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:05.813146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a815e58-5923-47eb-bb3f-711e93666187 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:05.864207 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a867c-8867-426f-8e6a-35b8eaa00069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:05.865124 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a867c-8867-426f-8e6a-35b8eaa00069 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.865426 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a867c-8867-426f-8e6a-35b8eaa00069 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.865737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a867c-8867-426f-8e6a-35b8eaa00069 None admin] PATH_INFO: `/v3/users/7ddb3b82f68f4c34afae7180ff5aa5bd` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.867066 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a867c-8867-426f-8e6a-35b8eaa00069 None admin] RBAC: Authorizing `identity:get_user(user_id=7ddb3b82f68f4c34afae7180ff5aa5bd)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:05.868543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a867c-8867-426f-8e6a-35b8eaa00069 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:05.870580 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 81/154] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:05 2022] GET /identity/v3/users/7ddb3b82f68f4c34afae7180ff5aa5bd => generated 290 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:05.875862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068adff-0f18-45b5-996d-d164a9bfa8ff None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:05.996652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068adff-0f18-45b5-996d-d164a9bfa8ff None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:06.031927 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604dd24-f251-41d6-9d0d-dfc0413bda0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:06.033078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604dd24-f251-41d6-9d0d-dfc0413bda0f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:06.033509 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604dd24-f251-41d6-9d0d-dfc0413bda0f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:06.033928 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604dd24-f251-41d6-9d0d-dfc0413bda0f None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:06.035397 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604dd24-f251-41d6-9d0d-dfc0413bda0f None admin] RBAC: Authorizing `identity:get_project(project_id=24bc5f74b0d84b00b6067c0fbd6e896e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:06.037084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604dd24-f251-41d6-9d0d-dfc0413bda0f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:06.039945 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 74/155] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:05 2022] GET /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e => generated 299 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:06.047879 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a867c-8867-426f-8e6a-35b8eaa00069 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:06.186128 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a867c-8867-426f-8e6a-35b8eaa00069 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:06.226124 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb72edf-3339-4108-a0f7-e4fe70935368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:06.227425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb72edf-3339-4108-a0f7-e4fe70935368 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:06.227907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb72edf-3339-4108-a0f7-e4fe70935368 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:06.228331 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb72edf-3339-4108-a0f7-e4fe70935368 None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e/users/7ddb3b82f68f4c34afae7180ff5aa5bd/roles/2c812f60cda548deb1893180061ff8e5` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:06.231082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb72edf-3339-4108-a0f7-e4fe70935368 None admin] RBAC: Authorizing `identity:create_grant(project_id=24bc5f74b0d84b00b6067c0fbd6e896e, user_id=7ddb3b82f68f4c34afae7180ff5aa5bd, role_id=2c812f60cda548deb1893180061ff8e5)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:06.232695 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb72edf-3339-4108-a0f7-e4fe70935368 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:06.250651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 82/156] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:28:06 2022] PUT /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e/users/7ddb3b82f68f4c34afae7180ff5aa5bd/roles/2c812f60cda548deb1893180061ff8e5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:06.600682 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595c51a-fb6d-4fc6-8380-816657dd8b18 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:06.601644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595c51a-fb6d-4fc6-8380-816657dd8b18 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:06.602075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595c51a-fb6d-4fc6-8380-816657dd8b18 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:06.603972 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 75/157] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:06.609893 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33305c0b-139b-43a7-864e-ba51c4d17ecf None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:06.610752 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33305c0b-139b-43a7-864e-ba51c4d17ecf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:06.611260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33305c0b-139b-43a7-864e-ba51c4d17ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:06.635515 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-33305c0b-139b-43a7-864e-ba51c4d17ecf None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:06.636958 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-33305c0b-139b-43a7-864e-ba51c4d17ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:06.643853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:06.728084 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 83/158] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:06.763429 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595c51a-fb6d-4fc6-8380-816657dd8b18 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:06.841255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:06.894455 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595c51a-fb6d-4fc6-8380-816657dd8b18 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:06.937720 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40496b0-4c67-4add-a90c-c0f50974e4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:06.938588 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40496b0-4c67-4add-a90c-c0f50974e4ec None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:06.938875 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40496b0-4c67-4add-a90c-c0f50974e4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:06.939157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40496b0-4c67-4add-a90c-c0f50974e4ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:06.954272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40496b0-4c67-4add-a90c-c0f50974e4ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:06.966629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e40496b0-4c67-4add-a90c-c0f50974e4ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:06.966629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:06.966629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:06.966629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:06.966629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:06.966629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:06.966629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:06.966629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:06.966629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:06.966629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:06.966629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:06.966629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:06.966629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:06.966629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:06.966629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:06.966629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:06.967594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:06.967594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:06.967594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:06.967594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:06.967594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:06.967594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:06.967594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:06.967594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:06.967594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:06.967594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:06.967594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:06.967594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:06.967594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:06.967594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:06.967594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:06.967594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:06.968363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:06.968363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:06.968363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:06.968363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:06.968363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:06.968363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:06.968363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:06.968363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:06.968363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:06.968363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:06.968363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:06.968363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:06.968363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 76/159] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:06.973724 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33305c0b-139b-43a7-864e-ba51c4d17ecf None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:07.095482 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33305c0b-139b-43a7-864e-ba51c4d17ecf None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:07.143618 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad3468-e393-4edc-8e9e-90659cc190d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:07.144301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad3468-e393-4edc-8e9e-90659cc190d8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:07.144646 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad3468-e393-4edc-8e9e-90659cc190d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:07.144870 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad3468-e393-4edc-8e9e-90659cc190d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:07.145632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad3468-e393-4edc-8e9e-90659cc190d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:07.145946 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad3468-e393-4edc-8e9e-90659cc190d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:07.151452 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad3468-e393-4edc-8e9e-90659cc190d8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:07.160630 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 84/160] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:06 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:07.166504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40496b0-4c67-4add-a90c-c0f50974e4ec None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:07.319170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40496b0-4c67-4add-a90c-c0f50974e4ec None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:07.346978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:07.371951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db6fa6-6b1b-4f3e-9b88-5002910a3b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:07.372738 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db6fa6-6b1b-4f3e-9b88-5002910a3b48 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:07.373023 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db6fa6-6b1b-4f3e-9b88-5002910a3b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:07.373367 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db6fa6-6b1b-4f3e-9b88-5002910a3b48 None admin] PATH_INFO: `/v3/users/a2fade2221bd4e6ca9ea62551c3c1ec6` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:07.374621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db6fa6-6b1b-4f3e-9b88-5002910a3b48 None admin] RBAC: Authorizing `identity:get_user(user_id=a2fade2221bd4e6ca9ea62551c3c1ec6)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:07.376080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db6fa6-6b1b-4f3e-9b88-5002910a3b48 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:07.378263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 77/161] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:07 2022] GET /identity/v3/users/a2fade2221bd4e6ca9ea62551c3c1ec6 => generated 276 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:07.384220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad3468-e393-4edc-8e9e-90659cc190d8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:07.393210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:07.527907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad3468-e393-4edc-8e9e-90659cc190d8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:07.569524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7f90a-5e48-4760-a101-3f2d9dea4c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:07.570259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7f90a-5e48-4760-a101-3f2d9dea4c3d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:07.570548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7f90a-5e48-4760-a101-3f2d9dea4c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:07.570854 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7f90a-5e48-4760-a101-3f2d9dea4c3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:07.591301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635c2fd-51a8-4227-81c4-afefb03f13a5 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:07.591596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635c2fd-51a8-4227-81c4-afefb03f13a5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:07.591854 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635c2fd-51a8-4227-81c4-afefb03f13a5 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:07.593463 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 78/162] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:07.606097 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125f06b-1f6e-42e5-bc08-d345b05835e2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:07.606708 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125f06b-1f6e-42e5-bc08-d345b05835e2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:07.606708 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125f06b-1f6e-42e5-bc08-d345b05835e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:07.640081 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b125f06b-1f6e-42e5-bc08-d345b05835e2 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:07.642125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b125f06b-1f6e-42e5-bc08-d345b05835e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:07.673030 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7f90a-5e48-4760-a101-3f2d9dea4c3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:07.675297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7f90a-5e48-4760-a101-3f2d9dea4c3d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:07.678871 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:07.780868 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 79/163] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:07.782626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba5d1-8a23-4dca-9cf8-b45308cdfefa None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:07.783150 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba5d1-8a23-4dca-9cf8-b45308cdfefa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:07.783630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba5d1-8a23-4dca-9cf8-b45308cdfefa None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:07.785125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 80/164] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:07.790401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa956f8f-205b-4e57-ae66-00888edef033 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:07.790985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa956f8f-205b-4e57-ae66-00888edef033 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:07.791460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa956f8f-205b-4e57-ae66-00888edef033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:07.809219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-aa956f8f-205b-4e57-ae66-00888edef033 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:07.810734 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aa956f8f-205b-4e57-ae66-00888edef033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:07.835411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 85/165] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:07 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:07.838161 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7f90a-5e48-4760-a101-3f2d9dea4c3d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:07.935039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 81/166] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:07.936298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa956f8f-205b-4e57-ae66-00888edef033 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:08.026491 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7f90a-5e48-4760-a101-3f2d9dea4c3d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:08.029443 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:08.047026 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:08.085821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cf825-d0c9-4890-ba8d-5bc356ccd600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:08.086664 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cf825-d0c9-4890-ba8d-5bc356ccd600 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:08.086955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cf825-d0c9-4890-ba8d-5bc356ccd600 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:08.087234 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cf825-d0c9-4890-ba8d-5bc356ccd600 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:08.110921 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627cf825-d0c9-4890-ba8d-5bc356ccd600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:08.125861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-627cf825-d0c9-4890-ba8d-5bc356ccd600 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:08.125861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:08.125861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:08.125861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:08.125861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:08.125861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:08.125861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:08.125861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:08.125861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:08.125861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:08.125861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:08.125861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:08.125861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:08.125861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:08.125861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:08.125861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:08.127115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:08.127115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:08.127115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:08.127115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:08.127115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:08.127115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:08.127115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:08.127115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:08.127115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:08.127115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:08.127115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:08.127115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:08.127115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:08.127115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:08.127115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:08.127115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:08.128040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:08.128040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:08.128040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:08.128040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:08.128040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:08.128040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:08.128040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:08.128040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:08.128040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:08.128040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:08.128040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:08.128040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:08.128040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 86/167] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:28:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:08.128684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cf825-d0c9-4890-ba8d-5bc356ccd600 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:08.228671 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa956f8f-205b-4e57-ae66-00888edef033 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:08.293119 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cf825-d0c9-4890-ba8d-5bc356ccd600 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:08.344976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4fc37-e6a6-46ab-acd5-660b86a0ec7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:08.345732 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4fc37-e6a6-46ab-acd5-660b86a0ec7a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:08.346022 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4fc37-e6a6-46ab-acd5-660b86a0ec7a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:08.346304 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4fc37-e6a6-46ab-acd5-660b86a0ec7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:08.363706 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4fc37-e6a6-46ab-acd5-660b86a0ec7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:08.373521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-f5f4fc37-e6a6-46ab-acd5-660b86a0ec7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:08.373521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:08.373521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:08.373521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:08.373521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:08.373521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:08.373521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:08.373521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:08.373521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:08.373521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:08.373521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:08.373521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:08.373521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:08.373521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:08.373521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:08.373521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:08.374411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:08.374411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:08.374411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:08.374411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:08.374411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:08.374411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:08.374411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:08.374411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:08.374411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:08.374411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:08.374411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:08.374411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:08.374411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:08.374411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:08.374411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:08.374411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:08.375225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:08.375225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:08.375225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:08.375225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:08.375225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:08.375225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:08.375225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:08.375225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:08.375225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:08.375225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:08.375225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:08.375225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:08.375225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 87/168] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:28:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:08.383579 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4fc37-e6a6-46ab-acd5-660b86a0ec7a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:08.395297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad89c4-0e09-4897-b7bb-c269fd43156c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:08.396187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad89c4-0e09-4897-b7bb-c269fd43156c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:08.396469 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad89c4-0e09-4897-b7bb-c269fd43156c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:08.396742 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad89c4-0e09-4897-b7bb-c269fd43156c None admin] PATH_INFO: `/v3/projects/b3e2abbf88db47f5a08249584a594cbd` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:08.403302 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad89c4-0e09-4897-b7bb-c269fd43156c None admin] RBAC: Authorizing `identity:get_project(project_id=b3e2abbf88db47f5a08249584a594cbd)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:08.404788 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad89c4-0e09-4897-b7bb-c269fd43156c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:08.406508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 82/169] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:07 2022] GET /identity/v3/projects/b3e2abbf88db47f5a08249584a594cbd => generated 313 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:08.407347 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad89c4-0e09-4897-b7bb-c269fd43156c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:08.431650 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:08.548117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4fc37-e6a6-46ab-acd5-660b86a0ec7a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:08.586105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4135a-5aef-47f5-a12e-61bbde525071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:08.587308 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4135a-5aef-47f5-a12e-61bbde525071 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:08.587808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4135a-5aef-47f5-a12e-61bbde525071 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:08.588292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4135a-5aef-47f5-a12e-61bbde525071 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:08.589244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4135a-5aef-47f5-a12e-61bbde525071 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:08.589761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4135a-5aef-47f5-a12e-61bbde525071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:08.591476 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4135a-5aef-47f5-a12e-61bbde525071 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:08.602129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 88/170] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:08 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:08.603330 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4135a-5aef-47f5-a12e-61bbde525071 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:08.608140 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad89c4-0e09-4897-b7bb-c269fd43156c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:08.646925 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:08.704259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:08.718006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455d243-6414-4d91-b47d-97cef32939df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:08.718900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455d243-6414-4d91-b47d-97cef32939df None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:08.719013 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455d243-6414-4d91-b47d-97cef32939df None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:08.719280 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455d243-6414-4d91-b47d-97cef32939df None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:08.720039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455d243-6414-4d91-b47d-97cef32939df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:08.720360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455d243-6414-4d91-b47d-97cef32939df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:08.721715 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455d243-6414-4d91-b47d-97cef32939df None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:08.726641 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4135a-5aef-47f5-a12e-61bbde525071 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:08.741257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 83/171] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:28:08 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:08.742712 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9474c1-126b-4138-909e-fcccf548203c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:08.743008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9474c1-126b-4138-909e-fcccf548203c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:08.743291 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9474c1-126b-4138-909e-fcccf548203c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:08.744571 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 84/172] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:08.750667 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9474c1-126b-4138-909e-fcccf548203c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:08.774261 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d76a7d-cd9e-4834-9b5d-b15a547cd225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:08.775657 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d76a7d-cd9e-4834-9b5d-b15a547cd225 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:08.776209 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d76a7d-cd9e-4834-9b5d-b15a547cd225 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:08.776715 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d76a7d-cd9e-4834-9b5d-b15a547cd225 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:08.777761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d76a7d-cd9e-4834-9b5d-b15a547cd225 None admin] RBAC: Adding query filter params (role.id=1fdf01beb7394da2a4ea549a7d1bccf1, scope.project.id=b3e2abbf88db47f5a08249584a594cbd, user.id=a2fade2221bd4e6ca9ea62551c3c1ec6) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:08.778307 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d76a7d-cd9e-4834-9b5d-b15a547cd225 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:08.781262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d76a7d-cd9e-4834-9b5d-b15a547cd225 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:08.789389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 89/173] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:28:08 2022] GET /identity/v3/role_assignments?user.id=a2fade2221bd4e6ca9ea62551c3c1ec6&scope.project.id=b3e2abbf88db47f5a08249584a594cbd&role.id=1fdf01beb7394da2a4ea549a7d1bccf1 => generated 610 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:08.790732 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d76a7d-cd9e-4834-9b5d-b15a547cd225 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:08.918031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d76a7d-cd9e-4834-9b5d-b15a547cd225 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:08.970521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2371ed-ff69-4146-81f0-6c6c098b0874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:08.973844 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2371ed-ff69-4146-81f0-6c6c098b0874 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:08.974350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2371ed-ff69-4146-81f0-6c6c098b0874 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:08.975152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2371ed-ff69-4146-81f0-6c6c098b0874 None admin] PATH_INFO: `/v3/users/a2fade2221bd4e6ca9ea62551c3c1ec6` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:08.977800 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2371ed-ff69-4146-81f0-6c6c098b0874 None admin] RBAC: Authorizing `identity:get_user(user_id=a2fade2221bd4e6ca9ea62551c3c1ec6)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:08.983029 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2371ed-ff69-4146-81f0-6c6c098b0874 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:08.987339 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 90/174] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:08 2022] GET /identity/v3/users/a2fade2221bd4e6ca9ea62551c3c1ec6 => generated 276 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:08.990618 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00832d-70ea-48e6-87dc-ac44728f035e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:08.992171 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00832d-70ea-48e6-87dc-ac44728f035e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:08.992665 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00832d-70ea-48e6-87dc-ac44728f035e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.017401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9474c1-126b-4138-909e-fcccf548203c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:09.033138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ef00832d-70ea-48e6-87dc-ac44728f035e None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:09.034841 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ef00832d-70ea-48e6-87dc-ac44728f035e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:09.064978 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:09.127354 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc08c0-148d-44b3-93d5-71166ea8cc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:09.128305 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc08c0-148d-44b3-93d5-71166ea8cc0c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:09.128559 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc08c0-148d-44b3-93d5-71166ea8cc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:09.128848 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc08c0-148d-44b3-93d5-71166ea8cc0c None admin] PATH_INFO: `/v3/users/eff5fc4521044d4aa5829e339b10b23f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.130172 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc08c0-148d-44b3-93d5-71166ea8cc0c None admin] RBAC: Authorizing `identity:get_user(user_id=eff5fc4521044d4aa5829e339b10b23f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:09.131684 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc08c0-148d-44b3-93d5-71166ea8cc0c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:09.134068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 85/175] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:08 2022] GET /identity/v3/users/eff5fc4521044d4aa5829e339b10b23f => generated 248 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:09.134938 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc08c0-148d-44b3-93d5-71166ea8cc0c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:09.140260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 91/176] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:09.141402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00832d-70ea-48e6-87dc-ac44728f035e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:09.224601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:09.261024 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00832d-70ea-48e6-87dc-ac44728f035e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:09.300366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3c4b4-3fb2-4660-859c-1c7a20941892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:09.301419 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3c4b4-3fb2-4660-859c-1c7a20941892 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:09.301934 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3c4b4-3fb2-4660-859c-1c7a20941892 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:09.302416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3c4b4-3fb2-4660-859c-1c7a20941892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.307590 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc08c0-148d-44b3-93d5-71166ea8cc0c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:09.321229 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:09.363452 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe8a97-4b24-4628-a7ac-b6211dc9cd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:09.364178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe8a97-4b24-4628-a7ac-b6211dc9cd5b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:09.364717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe8a97-4b24-4628-a7ac-b6211dc9cd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:09.364717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe8a97-4b24-4628-a7ac-b6211dc9cd5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.404607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3c4b4-3fb2-4660-859c-1c7a20941892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:09.407372 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3c4b4-3fb2-4660-859c-1c7a20941892 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:09.488948 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe8a97-4b24-4628-a7ac-b6211dc9cd5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:09.490510 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe8a97-4b24-4628-a7ac-b6211dc9cd5b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:09.521766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 92/177] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:09.523914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3c4b4-3fb2-4660-859c-1c7a20941892 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:09.569288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:09.577653 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:09.637514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3c4b4-3fb2-4660-859c-1c7a20941892 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:09.663933 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 86/178] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:09.665711 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe8a97-4b24-4628-a7ac-b6211dc9cd5b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:09.676668 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19821113-3168-4174-bba3-325d7af21038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:09.680214 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19821113-3168-4174-bba3-325d7af21038 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:09.680214 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19821113-3168-4174-bba3-325d7af21038 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:09.680214 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19821113-3168-4174-bba3-325d7af21038 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.690647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19821113-3168-4174-bba3-325d7af21038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:09.699617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-19821113-3168-4174-bba3-325d7af21038 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:09.699617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:09.699617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:09.699617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:09.699617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:09.699617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:09.699617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:09.699617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:09.699617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:09.699617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:09.699617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:09.699617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:09.699617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:09.699617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:09.699617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:09.699617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:09.700688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:09.700688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:09.700688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:09.700688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:09.700688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:09.700688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:09.700688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:09.700688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:09.700688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:09.700688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:09.700688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:09.700688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:09.700688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:09.700688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:09.700688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:09.700688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:09.701524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:09.701524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:09.701524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:09.701524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:09.701524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:09.701524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:09.701524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:09.701524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:09.701524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:09.701524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:09.701524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:09.701524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:09.703037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 93/179] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:28:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:09.705186 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19821113-3168-4174-bba3-325d7af21038 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:09.815101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe8a97-4b24-4628-a7ac-b6211dc9cd5b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:09.818301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19821113-3168-4174-bba3-325d7af21038 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:09.826025 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:09.856826 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7adeb-3048-4595-9bf4-1f8daca11bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:09.857698 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7adeb-3048-4595-9bf4-1f8daca11bca None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:09.857984 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7adeb-3048-4595-9bf4-1f8daca11bca None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:09.858262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7adeb-3048-4595-9bf4-1f8daca11bca None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.858880 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712ffd1-9429-44f9-b2b6-985afd7946c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:09.859473 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7adeb-3048-4595-9bf4-1f8daca11bca None admin] RBAC: Authorizing `identity:get_project(project_id=24bc5f74b0d84b00b6067c0fbd6e896e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:09.859742 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712ffd1-9429-44f9-b2b6-985afd7946c0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:09.860027 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712ffd1-9429-44f9-b2b6-985afd7946c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:09.860302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712ffd1-9429-44f9-b2b6-985afd7946c0 None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.860918 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7adeb-3048-4595-9bf4-1f8daca11bca None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:09.861469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712ffd1-9429-44f9-b2b6-985afd7946c0 None admin] RBAC: Authorizing `identity:get_project(project_id=24bc5f74b0d84b00b6067c0fbd6e896e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:09.868016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 87/180] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:09 2022] GET /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e => generated 299 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:09.868167 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712ffd1-9429-44f9-b2b6-985afd7946c0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:09.868245 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37400c43-410d-4ecf-99c2-7525c1e32c29 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:09.868245 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37400c43-410d-4ecf-99c2-7525c1e32c29 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:09.868245 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37400c43-410d-4ecf-99c2-7525c1e32c29 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.868418 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 94/181] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:09 2022] GET /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e => generated 299 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:09.868418 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712ffd1-9429-44f9-b2b6-985afd7946c0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:09.871070 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 88/182] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:09 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:09.872918 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83a651-3351-4f90-8c41-d96aa9d1e2fc None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:09.872918 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83a651-3351-4f90-8c41-d96aa9d1e2fc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:09.872918 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83a651-3351-4f90-8c41-d96aa9d1e2fc None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.874157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 89/183] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:09 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:09.879111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83a651-3351-4f90-8c41-d96aa9d1e2fc None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:09.899818 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:09.986419 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712ffd1-9429-44f9-b2b6-985afd7946c0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:10.014187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83a651-3351-4f90-8c41-d96aa9d1e2fc None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:10.026014 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6c8ba-c75e-4bb4-925a-1eb58b4cb736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:10.026722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6c8ba-c75e-4bb4-925a-1eb58b4cb736 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:10.027016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6c8ba-c75e-4bb4-925a-1eb58b4cb736 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:10.027814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6c8ba-c75e-4bb4-925a-1eb58b4cb736 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:10.028042 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6c8ba-c75e-4bb4-925a-1eb58b4cb736 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:10.028357 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6c8ba-c75e-4bb4-925a-1eb58b4cb736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:10.029756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6c8ba-c75e-4bb4-925a-1eb58b4cb736 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:10.038517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 95/184] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:09 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:10.039569 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6c8ba-c75e-4bb4-925a-1eb58b4cb736 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:10.054985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c12995-93eb-4b47-970c-3a67d18cc229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:10.055648 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c12995-93eb-4b47-970c-3a67d18cc229 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:10.055937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c12995-93eb-4b47-970c-3a67d18cc229 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:10.056215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c12995-93eb-4b47-970c-3a67d18cc229 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:10.057052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c12995-93eb-4b47-970c-3a67d18cc229 None admin] RBAC: Adding query filter params (role.id=1393d128d39b4649b6cd71b6609846cb, scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e, user.id=eff5fc4521044d4aa5829e339b10b23f) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:10.057362 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c12995-93eb-4b47-970c-3a67d18cc229 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:10.058840 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c12995-93eb-4b47-970c-3a67d18cc229 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:10.070680 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 90/185] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:28:09 2022] GET /identity/v3/role_assignments?user.id=eff5fc4521044d4aa5829e339b10b23f&scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e&role.id=1393d128d39b4649b6cd71b6609846cb => generated 610 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:10.070680 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcbe22-138e-446c-a2cd-f08e489d94ea None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:10.070680 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcbe22-138e-446c-a2cd-f08e489d94ea None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:10.070680 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcbe22-138e-446c-a2cd-f08e489d94ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:10.088461 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:10.103969 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fabcbe22-138e-446c-a2cd-f08e489d94ea None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:10.105290 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fabcbe22-138e-446c-a2cd-f08e489d94ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:10.170761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6c8ba-c75e-4bb4-925a-1eb58b4cb736 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:10.186321 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 91/186] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:10.187667 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf2cfe-53c3-4c79-be5e-2d10e7dd9474 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:10.187956 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf2cfe-53c3-4c79-be5e-2d10e7dd9474 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:10.188230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf2cfe-53c3-4c79-be5e-2d10e7dd9474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:10.201756 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:10.209301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-44cf2cfe-53c3-4c79-be5e-2d10e7dd9474 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:10.212014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-44cf2cfe-53c3-4c79-be5e-2d10e7dd9474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:10.221157 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845a121-fc49-43bd-9c09-f54ec6798d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:10.221851 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845a121-fc49-43bd-9c09-f54ec6798d1e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:10.222153 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845a121-fc49-43bd-9c09-f54ec6798d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:10.222426 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845a121-fc49-43bd-9c09-f54ec6798d1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:10.223754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845a121-fc49-43bd-9c09-f54ec6798d1e None admin] RBAC: Adding query filter params (role.id=634cfaacf2e444359b518d8dc7ed122b, scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e, user.id=a2fade2221bd4e6ca9ea62551c3c1ec6) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:10.224360 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845a121-fc49-43bd-9c09-f54ec6798d1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:10.225882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845a121-fc49-43bd-9c09-f54ec6798d1e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:10.233300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 96/187] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:28:10 2022] GET /identity/v3/role_assignments?user.id=a2fade2221bd4e6ca9ea62551c3c1ec6&scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e&role.id=634cfaacf2e444359b518d8dc7ed122b => generated 610 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:10.233962 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845a121-fc49-43bd-9c09-f54ec6798d1e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:10.314397 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 92/188] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:10.325120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b46c7-f769-46f4-88a2-e0ba7265661a None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:10.325120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b46c7-f769-46f4-88a2-e0ba7265661a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:10.325120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b46c7-f769-46f4-88a2-e0ba7265661a None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:10.325120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 93/189] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:10 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:10.325120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b46c7-f769-46f4-88a2-e0ba7265661a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:10.399601 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:10.404888 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845a121-fc49-43bd-9c09-f54ec6798d1e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:10.461767 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa673d4-3658-4f7a-82f3-42d78be2c2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:10.462735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa673d4-3658-4f7a-82f3-42d78be2c2af None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:10.463053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa673d4-3658-4f7a-82f3-42d78be2c2af None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:10.463330 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa673d4-3658-4f7a-82f3-42d78be2c2af None admin] PATH_INFO: `/v3/users/23abfe2828e3411890c62a72df70eb80` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:10.468998 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b46c7-f769-46f4-88a2-e0ba7265661a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:10.482940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa673d4-3658-4f7a-82f3-42d78be2c2af None admin] RBAC: Authorizing `identity:get_user(user_id=23abfe2828e3411890c62a72df70eb80)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:10.484693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa673d4-3658-4f7a-82f3-42d78be2c2af None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:10.486707 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 97/190] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:10 2022] GET /identity/v3/users/23abfe2828e3411890c62a72df70eb80 => generated 284 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:10.489684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e776134-0f87-4d53-8712-097e11042464 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:10.489684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e776134-0f87-4d53-8712-097e11042464 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:10.489684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e776134-0f87-4d53-8712-097e11042464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:10.506637 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-5e776134-0f87-4d53-8712-097e11042464 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:10.508506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5e776134-0f87-4d53-8712-097e11042464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:10.516486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d62ae8-9021-4a0f-9d89-0de0454bae07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:10.517318 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d62ae8-9021-4a0f-9d89-0de0454bae07 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:10.517599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d62ae8-9021-4a0f-9d89-0de0454bae07 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:10.517883 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d62ae8-9021-4a0f-9d89-0de0454bae07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:10.520738 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:10.530246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d62ae8-9021-4a0f-9d89-0de0454bae07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:10.538791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c6d62ae8-9021-4a0f-9d89-0de0454bae07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:10.538791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:10.538791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:10.538791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:10.538791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:10.538791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:10.538791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:10.538791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:10.538791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:10.538791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:10.538791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:10.538791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:10.538791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:10.538791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:10.538791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:10.538791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:10.539843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:10.539843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:10.539843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:10.539843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:10.539843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:10.539843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:10.539843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:10.539843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:10.539843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:10.539843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:10.539843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:10.539843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:10.539843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:10.539843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:10.539843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:10.539843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:10.540691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:10.540691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:10.540691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:10.540691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:10.540691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:10.540691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:10.540691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:10.540691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:10.540691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:10.540691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:10.540691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:10.540691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:10.540691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 94/191] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:28:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:10.541372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d62ae8-9021-4a0f-9d89-0de0454bae07 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:10.584030 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 98/192] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:10.585160 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e776134-0f87-4d53-8712-097e11042464 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:10.642835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d62ae8-9021-4a0f-9d89-0de0454bae07 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:10.674409 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:10.678209 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e60af5-a327-4a2a-bc03-ab8ebf634a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:10.679078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e60af5-a327-4a2a-bc03-ab8ebf634a4b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:10.679364 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e60af5-a327-4a2a-bc03-ab8ebf634a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:10.679643 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e60af5-a327-4a2a-bc03-ab8ebf634a4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:10.680931 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e60af5-a327-4a2a-bc03-ab8ebf634a4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:10.683288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e60af5-a327-4a2a-bc03-ab8ebf634a4b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:10.684947 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 95/193] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:10 2022] GET /identity/v3/domains/default => generated 200 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:10.685715 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e60af5-a327-4a2a-bc03-ab8ebf634a4b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:10.687774 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e776134-0f87-4d53-8712-097e11042464 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:10.722670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25c060-e013-43cb-9ed1-b1b19e47024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:10.723348 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25c060-e013-43cb-9ed1-b1b19e47024e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:10.723593 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25c060-e013-43cb-9ed1-b1b19e47024e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:10.723873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25c060-e013-43cb-9ed1-b1b19e47024e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:10.754475 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:10.793929 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e60af5-a327-4a2a-bc03-ab8ebf634a4b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:10.795095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25c060-e013-43cb-9ed1-b1b19e47024e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:10.796566 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25c060-e013-43cb-9ed1-b1b19e47024e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:10.828523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96830f-6d46-4943-b380-96c2a448d515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:10.829194 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96830f-6d46-4943-b380-96c2a448d515 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:10.829486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96830f-6d46-4943-b380-96c2a448d515 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:10.829770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96830f-6d46-4943-b380-96c2a448d515 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:10.830512 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96830f-6d46-4943-b380-96c2a448d515 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:10.830855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96830f-6d46-4943-b380-96c2a448d515 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:10.832235 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96830f-6d46-4943-b380-96c2a448d515 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:10.840418 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 96/194] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:28:10 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:10.841397 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96830f-6d46-4943-b380-96c2a448d515 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:10.885461 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:10.899318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 99/195] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:10 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:10.900110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25c060-e013-43cb-9ed1-b1b19e47024e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:10.947555 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96830f-6d46-4943-b380-96c2a448d515 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:10.972763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:10.982167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5c070-8218-4e14-93f8-265dca0b66f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:10.982997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5c070-8218-4e14-93f8-265dca0b66f8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:10.983285 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5c070-8218-4e14-93f8-265dca0b66f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:10.983559 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5c070-8218-4e14-93f8-265dca0b66f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:10.994523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5c070-8218-4e14-93f8-265dca0b66f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:10.999440 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25c060-e013-43cb-9ed1-b1b19e47024e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:11.002762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-70e5c070-8218-4e14-93f8-265dca0b66f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:11.002762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:11.002762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:11.002762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:11.002762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:11.002762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:11.002762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:11.002762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:11.002762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:11.002762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:11.002762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:11.002762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:11.002762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:11.002762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:11.002762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:11.002762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:11.003669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:11.003669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:11.003669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:11.003669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:11.003669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:11.003669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:11.003669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:11.003669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:11.003669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:11.003669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:11.003669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:11.003669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:11.003669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:11.003669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:11.003669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:11.003669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:11.004444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:11.004444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:11.004444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:11.004444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:11.004444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:11.004444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:11.004444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:11.004444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:11.004444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:11.004444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:11.004444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:11.004444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:11.004444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 97/196] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:11.005092 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5c070-8218-4e14-93f8-265dca0b66f8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:11.034288 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d953309-f02d-43a9-9a8c-40a42ebfa0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:11.034941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d953309-f02d-43a9-9a8c-40a42ebfa0c6 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:11.035232 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d953309-f02d-43a9-9a8c-40a42ebfa0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:11.035516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d953309-f02d-43a9-9a8c-40a42ebfa0c6 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:11.036232 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d953309-f02d-43a9-9a8c-40a42ebfa0c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:11.037696 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d953309-f02d-43a9-9a8c-40a42ebfa0c6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:11.065225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 100/197] 10.222.0.110 () {60 vars in 1137 bytes} [Thu May 26 16:28:10 2022] POST /identity/v3/users => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:11.066045 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d953309-f02d-43a9-9a8c-40a42ebfa0c6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:11.115493 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5c070-8218-4e14-93f8-265dca0b66f8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:11.136509 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:11.156922 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da994793-843e-420c-93cf-59d352dfbbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:11.157827 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da994793-843e-420c-93cf-59d352dfbbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:11.158113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da994793-843e-420c-93cf-59d352dfbbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:11.158683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da994793-843e-420c-93cf-59d352dfbbd0 None admin] PATH_INFO: `/v3/users/23abfe2828e3411890c62a72df70eb80` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:11.159686 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da994793-843e-420c-93cf-59d352dfbbd0 None admin] RBAC: Authorizing `identity:get_user(user_id=23abfe2828e3411890c62a72df70eb80)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:11.161168 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da994793-843e-420c-93cf-59d352dfbbd0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:11.167376 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 98/198] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:11 2022] GET /identity/v3/users/23abfe2828e3411890c62a72df70eb80 => generated 284 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:11.167376 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da994793-843e-420c-93cf-59d352dfbbd0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:11.206823 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d953309-f02d-43a9-9a8c-40a42ebfa0c6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:11.232227 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:11.251483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc29307-9a48-4183-a3e2-b1c41904e702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:11.252354 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc29307-9a48-4183-a3e2-b1c41904e702 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:11.252642 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc29307-9a48-4183-a3e2-b1c41904e702 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:11.252919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc29307-9a48-4183-a3e2-b1c41904e702 None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:11.254159 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc29307-9a48-4183-a3e2-b1c41904e702 None admin] RBAC: Authorizing `identity:get_project(project_id=eafb781b5fef4c2ebef0cb43793cf42e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:11.255658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc29307-9a48-4183-a3e2-b1c41904e702 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:11.257940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 101/199] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:11 2022] GET /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e => generated 303 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:11.258726 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc29307-9a48-4183-a3e2-b1c41904e702 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:11.287145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da994793-843e-420c-93cf-59d352dfbbd0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:11.325102 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c039708-a2fb-40ef-9376-2f1495bfb495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:11.325790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039708-a2fb-40ef-9376-2f1495bfb495 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:11.326077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039708-a2fb-40ef-9376-2f1495bfb495 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:11.326357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039708-a2fb-40ef-9376-2f1495bfb495 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:11.327148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c039708-a2fb-40ef-9376-2f1495bfb495 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:11.327462 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c039708-a2fb-40ef-9376-2f1495bfb495 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:11.328866 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c039708-a2fb-40ef-9376-2f1495bfb495 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:11.338300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 99/200] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:11 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:11.339503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c039708-a2fb-40ef-9376-2f1495bfb495 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:11.386989 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc29307-9a48-4183-a3e2-b1c41904e702 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:11.404712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:11.431256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd3693-7774-4bfb-a96f-903e3897e731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:11.431922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd3693-7774-4bfb-a96f-903e3897e731 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:11.432209 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd3693-7774-4bfb-a96f-903e3897e731 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:11.432489 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd3693-7774-4bfb-a96f-903e3897e731 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:11.469086 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c039708-a2fb-40ef-9376-2f1495bfb495 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:11.486313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:11.513953 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bec5c5-d7d3-4fa0-80f7-31f75fbd2da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:11.514808 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bec5c5-d7d3-4fa0-80f7-31f75fbd2da1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:11.515251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bec5c5-d7d3-4fa0-80f7-31f75fbd2da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:11.515715 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bec5c5-d7d3-4fa0-80f7-31f75fbd2da1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:11.517203 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bec5c5-d7d3-4fa0-80f7-31f75fbd2da1 None admin] RBAC: Adding query filter params (role.id=1393d128d39b4649b6cd71b6609846cb, scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e, user.id=23abfe2828e3411890c62a72df70eb80) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:11.517531 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bec5c5-d7d3-4fa0-80f7-31f75fbd2da1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:11.519319 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bec5c5-d7d3-4fa0-80f7-31f75fbd2da1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:11.519712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd3693-7774-4bfb-a96f-903e3897e731 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:11.521410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd3693-7774-4bfb-a96f-903e3897e731 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:11.527411 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 100/201] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:28:11 2022] GET /identity/v3/role_assignments?user.id=23abfe2828e3411890c62a72df70eb80&scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e&role.id=1393d128d39b4649b6cd71b6609846cb => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:11.528063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bec5c5-d7d3-4fa0-80f7-31f75fbd2da1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:11.647336 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bec5c5-d7d3-4fa0-80f7-31f75fbd2da1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:11.679182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 102/202] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:11 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:11.685254 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd3693-7774-4bfb-a96f-903e3897e731 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:11.706012 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75c015-9a5d-43f5-ac39-b8a6cbb29d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:11.708605 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75c015-9a5d-43f5-ac39-b8a6cbb29d2b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:11.709274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75c015-9a5d-43f5-ac39-b8a6cbb29d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:11.711560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75c015-9a5d-43f5-ac39-b8a6cbb29d2b None admin] PATH_INFO: `/v3/users/7ddb3b82f68f4c34afae7180ff5aa5bd` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:11.711702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:11.714983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75c015-9a5d-43f5-ac39-b8a6cbb29d2b None admin] RBAC: Authorizing `identity:get_user(user_id=7ddb3b82f68f4c34afae7180ff5aa5bd)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:11.718472 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75c015-9a5d-43f5-ac39-b8a6cbb29d2b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:11.721478 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 101/203] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:11 2022] GET /identity/v3/users/7ddb3b82f68f4c34afae7180ff5aa5bd => generated 290 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:11.731621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75c015-9a5d-43f5-ac39-b8a6cbb29d2b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:11.826529 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd3693-7774-4bfb-a96f-903e3897e731 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:11.859457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:11.879271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687187fa-ba5b-43fd-be1e-605a91c5104c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:11.880159 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687187fa-ba5b-43fd-be1e-605a91c5104c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:11.880444 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687187fa-ba5b-43fd-be1e-605a91c5104c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:11.880721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687187fa-ba5b-43fd-be1e-605a91c5104c None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:11.887381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687187fa-ba5b-43fd-be1e-605a91c5104c None admin] RBAC: Authorizing `identity:get_project(project_id=eafb781b5fef4c2ebef0cb43793cf42e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:11.888866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687187fa-ba5b-43fd-be1e-605a91c5104c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:11.890943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 103/204] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:11 2022] GET /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e => generated 303 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:11.896388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687187fa-ba5b-43fd-be1e-605a91c5104c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:11.929821 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75c015-9a5d-43f5-ac39-b8a6cbb29d2b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:11.964778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11741ca-4514-4d14-baa5-02018ea852de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:11.965502 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11741ca-4514-4d14-baa5-02018ea852de None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:11.965791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11741ca-4514-4d14-baa5-02018ea852de None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:11.966075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11741ca-4514-4d14-baa5-02018ea852de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:12.042319 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11741ca-4514-4d14-baa5-02018ea852de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:12.044119 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11741ca-4514-4d14-baa5-02018ea852de None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:12.097414 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:12.149162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:12.158013 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 102/205] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:11 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:12.164759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11741ca-4514-4d14-baa5-02018ea852de None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:12.195537 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687187fa-ba5b-43fd-be1e-605a91c5104c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:12.272067 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8107f-7eeb-4237-915c-ed20fa4a5f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:12.273394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8107f-7eeb-4237-915c-ed20fa4a5f50 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:12.273682 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8107f-7eeb-4237-915c-ed20fa4a5f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:12.273961 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8107f-7eeb-4237-915c-ed20fa4a5f50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:12.274829 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8107f-7eeb-4237-915c-ed20fa4a5f50 None admin] RBAC: Adding query filter params (role.id=634cfaacf2e444359b518d8dc7ed122b, scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e, user.id=23abfe2828e3411890c62a72df70eb80) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:12.275143 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8107f-7eeb-4237-915c-ed20fa4a5f50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:12.276597 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8107f-7eeb-4237-915c-ed20fa4a5f50 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:12.293877 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 104/206] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:28:11 2022] GET /identity/v3/role_assignments?user.id=23abfe2828e3411890c62a72df70eb80&scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e&role.id=634cfaacf2e444359b518d8dc7ed122b => generated 260 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:12.332124 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11741ca-4514-4d14-baa5-02018ea852de None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:12.382064 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54c8b1-ed57-4d2d-8e04-f2dad1284607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:12.383541 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54c8b1-ed57-4d2d-8e04-f2dad1284607 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:12.383829 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54c8b1-ed57-4d2d-8e04-f2dad1284607 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:12.384111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54c8b1-ed57-4d2d-8e04-f2dad1284607 None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:12.391581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54c8b1-ed57-4d2d-8e04-f2dad1284607 None admin] RBAC: Authorizing `identity:get_project(project_id=24bc5f74b0d84b00b6067c0fbd6e896e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:12.393105 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54c8b1-ed57-4d2d-8e04-f2dad1284607 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:12.395383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 103/207] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:12 2022] GET /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e => generated 299 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:12.402193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8107f-7eeb-4237-915c-ed20fa4a5f50 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:12.542638 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8107f-7eeb-4237-915c-ed20fa4a5f50 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:12.580653 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43efe9-0a83-4392-a1de-cf246fb3eeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:12.581337 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43efe9-0a83-4392-a1de-cf246fb3eeeb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:12.581628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43efe9-0a83-4392-a1de-cf246fb3eeeb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:12.581911 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43efe9-0a83-4392-a1de-cf246fb3eeeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:12.582810 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43efe9-0a83-4392-a1de-cf246fb3eeeb None admin] RBAC: Adding query filter params (role.id=2c812f60cda548deb1893180061ff8e5, scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e, user.id=7ddb3b82f68f4c34afae7180ff5aa5bd) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:12.583133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43efe9-0a83-4392-a1de-cf246fb3eeeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:12.584631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43efe9-0a83-4392-a1de-cf246fb3eeeb None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:12.592257 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 105/208] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:28:12 2022] GET /identity/v3/role_assignments?user.id=7ddb3b82f68f4c34afae7180ff5aa5bd&scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e&role.id=2c812f60cda548deb1893180061ff8e5 => generated 610 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:13.722637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f07e1f-0914-49f9-a2aa-9d1717cabe75 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:13.723119 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f07e1f-0914-49f9-a2aa-9d1717cabe75 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:13.723119 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f07e1f-0914-49f9-a2aa-9d1717cabe75 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:13.724801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 104/209] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:13.730283 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203486f9-f05f-4584-a368-73dfde597e4b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:13.730795 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203486f9-f05f-4584-a368-73dfde597e4b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:13.730867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203486f9-f05f-4584-a368-73dfde597e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:13.740560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baeaff-3fb5-42c4-a74e-e36f92f76f03 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:13.740875 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baeaff-3fb5-42c4-a74e-e36f92f76f03 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:13.741123 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baeaff-3fb5-42c4-a74e-e36f92f76f03 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:13.743135 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 105/210] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:13.748888 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd6688-98da-4d17-9173-ba63e0d19776 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:13.749272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd6688-98da-4d17-9173-ba63e0d19776 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:13.749460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd6688-98da-4d17-9173-ba63e0d19776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:13.750132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-203486f9-f05f-4584-a368-73dfde597e4b None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:13.751629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-203486f9-f05f-4584-a368-73dfde597e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:13.753856 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:13.768329 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fadd6688-98da-4d17-9173-ba63e0d19776 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:13.769667 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fadd6688-98da-4d17-9173-ba63e0d19776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:13.784078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:13.828802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 106/211] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:13.848387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 106/212] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:13.853940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203486f9-f05f-4584-a368-73dfde597e4b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:13.874916 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd6688-98da-4d17-9173-ba63e0d19776 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:13.958947 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203486f9-f05f-4584-a368-73dfde597e4b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:13.986485 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd6688-98da-4d17-9173-ba63e0d19776 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:13.995443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b30ce9-5111-43c0-91ee-88e7d6b73f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:13.996238 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b30ce9-5111-43c0-91ee-88e7d6b73f27 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:13.996520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b30ce9-5111-43c0-91ee-88e7d6b73f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:13.996791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b30ce9-5111-43c0-91ee-88e7d6b73f27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.003918 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:14.007773 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b30ce9-5111-43c0-91ee-88e7d6b73f27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:14.016121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-b2b30ce9-5111-43c0-91ee-88e7d6b73f27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:14.016121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:14.016121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:14.016121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:14.016121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:14.016121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:14.016121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:14.016121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:14.016121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:14.016121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:14.016121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:14.016121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:14.016121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:14.016121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:14.016121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:14.016121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:14.017202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:14.017202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:14.017202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:14.017202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:14.017202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:14.017202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:14.017202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:14.017202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:14.017202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:14.017202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:14.017202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:14.017202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:14.017202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:14.017202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:14.017202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:14.017202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:14.018170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:14.018170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:14.018170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:14.018170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:14.018170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:14.018170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:14.018170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:14.018170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:14.018170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:14.018170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:14.018170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:14.018170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:14.022309 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 107/213] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:14.023609 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988610d-72e5-4e37-b58d-60691d4d6f0e None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.023900 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988610d-72e5-4e37-b58d-60691d4d6f0e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.024266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988610d-72e5-4e37-b58d-60691d4d6f0e None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.025685 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 108/214] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:14.027445 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7aa7f-2264-4331-96e3-8c0af603727e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:14.027695 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988610d-72e5-4e37-b58d-60691d4d6f0e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:14.028268 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7aa7f-2264-4331-96e3-8c0af603727e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.028534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7aa7f-2264-4331-96e3-8c0af603727e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.028812 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7aa7f-2264-4331-96e3-8c0af603727e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.030129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7aa7f-2264-4331-96e3-8c0af603727e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:14.031618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7aa7f-2264-4331-96e3-8c0af603727e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:14.033442 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 107/215] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:13 2022] GET /identity/v3/domains/default => generated 200 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:14.034486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740ae20-7a65-4c22-ac15-bfadaaf07e6c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.034800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740ae20-7a65-4c22-ac15-bfadaaf07e6c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.035085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740ae20-7a65-4c22-ac15-bfadaaf07e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.052173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3740ae20-7a65-4c22-ac15-bfadaaf07e6c None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:14.053369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3740ae20-7a65-4c22-ac15-bfadaaf07e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:14.063800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:14.130628 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 108/216] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:14.130628 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740ae20-7a65-4c22-ac15-bfadaaf07e6c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:14.164786 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988610d-72e5-4e37-b58d-60691d4d6f0e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:14.202122 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f1b70-b187-4821-9e15-1037a28a2e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:14.203288 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f1b70-b187-4821-9e15-1037a28a2e59 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.203641 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f1b70-b187-4821-9e15-1037a28a2e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.203924 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f1b70-b187-4821-9e15-1037a28a2e59 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.204796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f1b70-b187-4821-9e15-1037a28a2e59 None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:14.205105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f1b70-b187-4821-9e15-1037a28a2e59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:14.206480 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f1b70-b187-4821-9e15-1037a28a2e59 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:14.220538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 109/217] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:14 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:14.220538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f1b70-b187-4821-9e15-1037a28a2e59 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:14.231574 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740ae20-7a65-4c22-ac15-bfadaaf07e6c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:14.266316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28f843-74e9-4518-bfd4-3a9e0a9e5249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:14.266937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28f843-74e9-4518-bfd4-3a9e0a9e5249 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.267227 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28f843-74e9-4518-bfd4-3a9e0a9e5249 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.267567 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28f843-74e9-4518-bfd4-3a9e0a9e5249 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.268216 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28f843-74e9-4518-bfd4-3a9e0a9e5249 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:14.269671 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28f843-74e9-4518-bfd4-3a9e0a9e5249 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:14.280990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:14.287512 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:14.302597 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 109/218] 10.222.0.110 () {60 vars in 1137 bytes} [Thu May 26 16:28:14 2022] POST /identity/v3/users => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:14.302597 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28f843-74e9-4518-bfd4-3a9e0a9e5249 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:14.329277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f1b70-b187-4821-9e15-1037a28a2e59 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:14.376349 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45ec80-1572-4043-94aa-7d882363bbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:14.377175 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45ec80-1572-4043-94aa-7d882363bbae None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.377574 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45ec80-1572-4043-94aa-7d882363bbae None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.377861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45ec80-1572-4043-94aa-7d882363bbae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.391459 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45ec80-1572-4043-94aa-7d882363bbae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:14.400789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-ad45ec80-1572-4043-94aa-7d882363bbae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:14.400789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:14.400789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:14.400789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:14.400789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:14.400789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:14.400789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:14.400789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:14.400789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:14.400789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:14.400789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:14.400789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:14.400789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:14.400789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:14.400789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:14.400789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:14.401758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:14.401758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:14.401758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:14.401758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:14.401758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:14.401758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:14.401758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:14.401758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:14.401758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:14.401758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:14.401758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:14.401758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:14.401758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:14.401758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:14.401758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:14.401758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:14.402674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:14.402674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:14.402674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:14.402674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:14.402674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:14.402674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:14.402674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:14.402674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:14.402674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:14.402674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:14.402674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:14.402674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:14.402674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 110/219] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:28:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:14.409709 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45ec80-1572-4043-94aa-7d882363bbae None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:14.448057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28f843-74e9-4518-bfd4-3a9e0a9e5249 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:14.485261 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2c021-7fd0-4cd6-a288-ac44783619dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:14.486404 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2c021-7fd0-4cd6-a288-ac44783619dc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.486888 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2c021-7fd0-4cd6-a288-ac44783619dc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.487305 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2c021-7fd0-4cd6-a288-ac44783619dc None admin] PATH_INFO: `/v3/users/b27b58e77d8a489aaf4a1e8a1b2b01bc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.503085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2c021-7fd0-4cd6-a288-ac44783619dc None admin] RBAC: Authorizing `identity:get_user(user_id=b27b58e77d8a489aaf4a1e8a1b2b01bc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:14.504926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2c021-7fd0-4cd6-a288-ac44783619dc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:14.506864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 110/220] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:14 2022] GET /identity/v3/users/b27b58e77d8a489aaf4a1e8a1b2b01bc => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:14.512510 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2c021-7fd0-4cd6-a288-ac44783619dc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:14.526074 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45ec80-1572-4043-94aa-7d882363bbae None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:14.549824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:14.573020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4f569-57ec-426a-93f8-7fe201b5d6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:14.573437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4f569-57ec-426a-93f8-7fe201b5d6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.573785 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4f569-57ec-426a-93f8-7fe201b5d6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.574061 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4f569-57ec-426a-93f8-7fe201b5d6c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.574770 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4f569-57ec-426a-93f8-7fe201b5d6c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:14.575090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4f569-57ec-426a-93f8-7fe201b5d6c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:14.576762 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4f569-57ec-426a-93f8-7fe201b5d6c6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:14.586784 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:14.589154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 111/221] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:14 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:14.595031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4f569-57ec-426a-93f8-7fe201b5d6c6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:14.639270 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2c021-7fd0-4cd6-a288-ac44783619dc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:14.687155 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76c2f7-a5b9-4e4b-9663-5d4bfc4f7cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:14.687826 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76c2f7-a5b9-4e4b-9663-5d4bfc4f7cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.688113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76c2f7-a5b9-4e4b-9663-5d4bfc4f7cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.688390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76c2f7-a5b9-4e4b-9663-5d4bfc4f7cb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.736928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4f569-57ec-426a-93f8-7fe201b5d6c6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:14.776171 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f37aa-9f85-42fe-8f6d-5cf695c38ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:14.777095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f37aa-9f85-42fe-8f6d-5cf695c38ecf None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.777386 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f37aa-9f85-42fe-8f6d-5cf695c38ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.777665 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f37aa-9f85-42fe-8f6d-5cf695c38ecf None admin] PATH_INFO: `/v3/users/23abfe2828e3411890c62a72df70eb80` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.779621 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f37aa-9f85-42fe-8f6d-5cf695c38ecf None admin] RBAC: Authorizing `identity:get_user(user_id=23abfe2828e3411890c62a72df70eb80)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:14.780959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f37aa-9f85-42fe-8f6d-5cf695c38ecf None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:14.781856 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76c2f7-a5b9-4e4b-9663-5d4bfc4f7cb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:14.782991 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 112/222] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:14 2022] GET /identity/v3/users/23abfe2828e3411890c62a72df70eb80 => generated 284 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:14.784000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76c2f7-a5b9-4e4b-9663-5d4bfc4f7cb0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:14.793479 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f37aa-9f85-42fe-8f6d-5cf695c38ecf None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:14.851739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:14.858835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:14.914092 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f37aa-9f85-42fe-8f6d-5cf695c38ecf None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:14.922937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 111/223] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:14 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:28:14.924853 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783a98a-fb01-4093-9e9e-97a960ac94d3 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.925148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783a98a-fb01-4093-9e9e-97a960ac94d3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.925431 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783a98a-fb01-4093-9e9e-97a960ac94d3 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.927422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 112/224] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:14.928144 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783a98a-fb01-4093-9e9e-97a960ac94d3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:14.957709 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31a731-c1da-4c04-a81b-cc2bbd433402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:14.959687 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31a731-c1da-4c04-a81b-cc2bbd433402 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.960490 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31a731-c1da-4c04-a81b-cc2bbd433402 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.960971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31a731-c1da-4c04-a81b-cc2bbd433402 None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.962950 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31a731-c1da-4c04-a81b-cc2bbd433402 None admin] RBAC: Authorizing `identity:get_project(project_id=eafb781b5fef4c2ebef0cb43793cf42e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:14.965490 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31a731-c1da-4c04-a81b-cc2bbd433402 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:14.967444 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 113/225] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:14 2022] GET /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e => generated 303 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:14.969217 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e55bd-6157-4e74-b90d-582bbf3fc071 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.970591 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e55bd-6157-4e74-b90d-582bbf3fc071 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.971059 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e55bd-6157-4e74-b90d-582bbf3fc071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.992812 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ac6e55bd-6157-4e74-b90d-582bbf3fc071 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:14.995007 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ac6e55bd-6157-4e74-b90d-582bbf3fc071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:15.040164 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783a98a-fb01-4093-9e9e-97a960ac94d3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:15.081825 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f1993-d839-4fd0-b24b-6c20b643331c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:15.082879 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f1993-d839-4fd0-b24b-6c20b643331c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:15.083236 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f1993-d839-4fd0-b24b-6c20b643331c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:15.083580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f1993-d839-4fd0-b24b-6c20b643331c None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:15.084900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f1993-d839-4fd0-b24b-6c20b643331c None admin] RBAC: Authorizing `identity:get_project(project_id=eafb781b5fef4c2ebef0cb43793cf42e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:15.086383 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 114/226] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:15.087476 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e55bd-6157-4e74-b90d-582bbf3fc071 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:15.091295 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f1993-d839-4fd0-b24b-6c20b643331c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:15.093364 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 113/227] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:14 2022] GET /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e => generated 303 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:15.099141 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f1993-d839-4fd0-b24b-6c20b643331c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:15.139492 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:15.152525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:15.222846 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e55bd-6157-4e74-b90d-582bbf3fc071 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:15.227019 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f1993-d839-4fd0-b24b-6c20b643331c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:15.265455 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df9314-afba-4369-ba8d-fab43926b5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:15.266359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df9314-afba-4369-ba8d-fab43926b5c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:15.266673 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df9314-afba-4369-ba8d-fab43926b5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:15.266954 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df9314-afba-4369-ba8d-fab43926b5c6 None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e/users/23abfe2828e3411890c62a72df70eb80/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:15.268856 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b06274-a6b2-45a2-a125-aa47736423cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:15.268995 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df9314-afba-4369-ba8d-fab43926b5c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=eafb781b5fef4c2ebef0cb43793cf42e, user_id=23abfe2828e3411890c62a72df70eb80, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:15.269517 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b06274-a6b2-45a2-a125-aa47736423cc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:15.269797 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b06274-a6b2-45a2-a125-aa47736423cc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:15.270075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b06274-a6b2-45a2-a125-aa47736423cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:15.270529 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df9314-afba-4369-ba8d-fab43926b5c6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:15.270986 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b06274-a6b2-45a2-a125-aa47736423cc None admin] RBAC: Adding query filter params (role.id=1fdf01beb7394da2a4ea549a7d1bccf1, scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e, user.id=b27b58e77d8a489aaf4a1e8a1b2b01bc) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:15.271301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b06274-a6b2-45a2-a125-aa47736423cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:15.273543 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b06274-a6b2-45a2-a125-aa47736423cc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:15.280812 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 114/228] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:28:15 2022] GET /identity/v3/role_assignments?user.id=b27b58e77d8a489aaf4a1e8a1b2b01bc&scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e&role.id=1fdf01beb7394da2a4ea549a7d1bccf1 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:15.281731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b06274-a6b2-45a2-a125-aa47736423cc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:15.286428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 115/229] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:28:15 2022] PUT /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e/users/23abfe2828e3411890c62a72df70eb80/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:15.388676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:15.408540 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b06274-a6b2-45a2-a125-aa47736423cc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:15.456897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73614d-557c-4024-9e5d-8546ca75bb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:15.457783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73614d-557c-4024-9e5d-8546ca75bb5d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:15.458085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73614d-557c-4024-9e5d-8546ca75bb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:15.458362 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73614d-557c-4024-9e5d-8546ca75bb5d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:15.471376 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73614d-557c-4024-9e5d-8546ca75bb5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:15.480299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8f73614d-557c-4024-9e5d-8546ca75bb5d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:15.480299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:15.480299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:15.480299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:15.480299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:15.480299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:15.480299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:15.480299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:15.480299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:15.480299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:15.480299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:15.480299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:15.480299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:15.480299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:15.480299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:15.480299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:15.481296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:15.481296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:15.481296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:15.481296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:15.481296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:15.481296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:15.481296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:15.481296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:15.481296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:15.481296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:15.481296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:15.481296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:15.481296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:15.481296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:15.481296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:15.481296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:15.482356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:15.482356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:15.482356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:15.482356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:15.482356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:15.482356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:15.482356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:15.482356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:15.482356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:15.482356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:15.482356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:15.482356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:15.482356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 115/230] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:28:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:15.490437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df9314-afba-4369-ba8d-fab43926b5c6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:15.619748 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df9314-afba-4369-ba8d-fab43926b5c6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:15.630235 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:15.657719 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d2e78-1b3b-4456-96bb-10b892be5db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:15.658753 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d2e78-1b3b-4456-96bb-10b892be5db7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:15.659247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d2e78-1b3b-4456-96bb-10b892be5db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:15.659761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d2e78-1b3b-4456-96bb-10b892be5db7 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:15.660704 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d2e78-1b3b-4456-96bb-10b892be5db7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:15.661226 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d2e78-1b3b-4456-96bb-10b892be5db7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:15.662824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d2e78-1b3b-4456-96bb-10b892be5db7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:15.672431 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 116/231] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:28:15 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:15.677638 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73614d-557c-4024-9e5d-8546ca75bb5d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:15.794901 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73614d-557c-4024-9e5d-8546ca75bb5d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:15.847478 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa5c13-170d-48c9-a3b9-4a1b9f4b370d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:15.848794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa5c13-170d-48c9-a3b9-4a1b9f4b370d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:15.849285 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa5c13-170d-48c9-a3b9-4a1b9f4b370d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:15.849764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa5c13-170d-48c9-a3b9-4a1b9f4b370d None admin] PATH_INFO: `/v3/users/23abfe2828e3411890c62a72df70eb80` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:15.854265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa5c13-170d-48c9-a3b9-4a1b9f4b370d None admin] RBAC: Authorizing `identity:get_user(user_id=23abfe2828e3411890c62a72df70eb80)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:15.856074 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa5c13-170d-48c9-a3b9-4a1b9f4b370d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:15.857985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 116/232] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:15 2022] GET /identity/v3/users/23abfe2828e3411890c62a72df70eb80 => generated 284 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:15.863359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d2e78-1b3b-4456-96bb-10b892be5db7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:15.974616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d2e78-1b3b-4456-96bb-10b892be5db7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:16.012749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f038f-6d16-45c3-b9b6-270046273a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:16.014051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f038f-6d16-45c3-b9b6-270046273a12 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.014549 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f038f-6d16-45c3-b9b6-270046273a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.015109 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f038f-6d16-45c3-b9b6-270046273a12 None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:16.016516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f038f-6d16-45c3-b9b6-270046273a12 None admin] RBAC: Authorizing `identity:get_project(project_id=eafb781b5fef4c2ebef0cb43793cf42e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:16.018180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f038f-6d16-45c3-b9b6-270046273a12 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:16.020486 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 117/233] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:15 2022] GET /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e => generated 303 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:16.027681 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa5c13-170d-48c9-a3b9-4a1b9f4b370d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:16.067201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:16.181715 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa5c13-170d-48c9-a3b9-4a1b9f4b370d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:16.233272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe6445-f837-42bd-8e3d-bbf9c56d466d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:16.234180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe6445-f837-42bd-8e3d-bbf9c56d466d None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.234468 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe6445-f837-42bd-8e3d-bbf9c56d466d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.234773 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe6445-f837-42bd-8e3d-bbf9c56d466d None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e/users/23abfe2828e3411890c62a72df70eb80/roles/634cfaacf2e444359b518d8dc7ed122b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:16.237065 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe6445-f837-42bd-8e3d-bbf9c56d466d None admin] RBAC: Authorizing `identity:create_grant(project_id=eafb781b5fef4c2ebef0cb43793cf42e, user_id=23abfe2828e3411890c62a72df70eb80, role_id=634cfaacf2e444359b518d8dc7ed122b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:16.238516 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe6445-f837-42bd-8e3d-bbf9c56d466d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:16.263208 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 117/234] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:28:16 2022] PUT /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e/users/23abfe2828e3411890c62a72df70eb80/roles/634cfaacf2e444359b518d8dc7ed122b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:17.227001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4d863-6db9-4955-9bad-60054cd80da5 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.227514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4d863-6db9-4955-9bad-60054cd80da5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.227588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4d863-6db9-4955-9bad-60054cd80da5 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.229181 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 118/235] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:17.234412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bb3d5-5952-4122-9157-1bc5b3e80728 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.234834 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bb3d5-5952-4122-9157-1bc5b3e80728 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.235013 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bb3d5-5952-4122-9157-1bc5b3e80728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.250657 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaffa84-f438-47f1-999a-8ac006ff6a04 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.251221 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaffa84-f438-47f1-999a-8ac006ff6a04 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.251513 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaffa84-f438-47f1-999a-8ac006ff6a04 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.253293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 119/236] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:17.258400 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7f4af-9c0c-4665-9f91-9ae4e0e38f14 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.258711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7f4af-9c0c-4665-9f91-9ae4e0e38f14 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.258999 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7f4af-9c0c-4665-9f91-9ae4e0e38f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.263179 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0e7bb3d5-5952-4122-9157-1bc5b3e80728 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:17.264397 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0e7bb3d5-5952-4122-9157-1bc5b3e80728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:17.294782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-71d7f4af-9c0c-4665-9f91-9ae4e0e38f14 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:17.296006 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-71d7f4af-9c0c-4665-9f91-9ae4e0e38f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:17.341660 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 118/237] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:17.355577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:17.404921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bb3d5-5952-4122-9157-1bc5b3e80728 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.420831 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 120/238] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:17.421032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:17.452981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7f4af-9c0c-4665-9f91-9ae4e0e38f14 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.515558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bb3d5-5952-4122-9157-1bc5b3e80728 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:17.555142 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b63a5-e4be-4f66-a59f-0fdf7bc9bd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:17.556355 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b63a5-e4be-4f66-a59f-0fdf7bc9bd2e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.556837 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b63a5-e4be-4f66-a59f-0fdf7bc9bd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.557331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b63a5-e4be-4f66-a59f-0fdf7bc9bd2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.558754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b63a5-e4be-4f66-a59f-0fdf7bc9bd2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:17.560551 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b63a5-e4be-4f66-a59f-0fdf7bc9bd2e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:17.562508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 119/239] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:17 2022] GET /identity/v3/domains/default => generated 200 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:17.567780 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b63a5-e4be-4f66-a59f-0fdf7bc9bd2e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.628752 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7f4af-9c0c-4665-9f91-9ae4e0e38f14 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:17.657828 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:17.686285 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b63a5-e4be-4f66-a59f-0fdf7bc9bd2e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:17.726548 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4fac1-89aa-45bb-bf59-53811f4255b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:17.727708 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4fac1-89aa-45bb-bf59-53811f4255b1 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.728183 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999aba49-9f0d-4cf5-a5f3-3b4ca122e6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:17.728449 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4fac1-89aa-45bb-bf59-53811f4255b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.728915 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4fac1-89aa-45bb-bf59-53811f4255b1 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.729015 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999aba49-9f0d-4cf5-a5f3-3b4ca122e6ad None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.729267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999aba49-9f0d-4cf5-a5f3-3b4ca122e6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.729552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999aba49-9f0d-4cf5-a5f3-3b4ca122e6ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.730498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4fac1-89aa-45bb-bf59-53811f4255b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:17.732184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4fac1-89aa-45bb-bf59-53811f4255b1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:17.756287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 120/240] 10.222.0.110 () {60 vars in 1137 bytes} [Thu May 26 16:28:17 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:17.763661 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999aba49-9f0d-4cf5-a5f3-3b4ca122e6ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:17.778323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-999aba49-9f0d-4cf5-a5f3-3b4ca122e6ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:17.778323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:17.778323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:17.778323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:17.778323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:17.778323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:17.778323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:17.778323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:17.778323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:17.778323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:17.778323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:17.778323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:17.778323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:17.778323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:17.778323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:17.778323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:17.779302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:17.779302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:17.779302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:17.779302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:17.779302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:17.779302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:17.779302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:17.779302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:17.779302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:17.779302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:17.779302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:17.779302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:17.779302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:17.779302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:17.779302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:17.779302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:17.780102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:17.780102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:17.780102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:17.780102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:17.780102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:17.780102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:17.780102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:17.780102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:17.780102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:17.780102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:17.780102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:17.780102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:17.780102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 121/241] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:17.785629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4fac1-89aa-45bb-bf59-53811f4255b1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.946165 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4fac1-89aa-45bb-bf59-53811f4255b1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:17.984766 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:17.992292 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b1832-10d9-4fbd-a808-6556ba647c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:17.993495 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b1832-10d9-4fbd-a808-6556ba647c60 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.994211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b1832-10d9-4fbd-a808-6556ba647c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.994910 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b1832-10d9-4fbd-a808-6556ba647c60 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.995674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b1832-10d9-4fbd-a808-6556ba647c60 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:17.995986 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b1832-10d9-4fbd-a808-6556ba647c60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:17.997372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b1832-10d9-4fbd-a808-6556ba647c60 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:18.007277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 121/242] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:17 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:18.012917 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999aba49-9f0d-4cf5-a5f3-3b4ca122e6ad None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:18.066388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:18.129677 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d80b4-a4dc-4ef3-88f8-d2d82d314752 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.130352 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d80b4-a4dc-4ef3-88f8-d2d82d314752 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.130878 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d80b4-a4dc-4ef3-88f8-d2d82d314752 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.132724 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 122/243] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:18 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:18.138840 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb8751-6b35-4072-9cb5-371dbd85e476 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.139184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb8751-6b35-4072-9cb5-371dbd85e476 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.139416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb8751-6b35-4072-9cb5-371dbd85e476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.159472 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3ecb8751-6b35-4072-9cb5-371dbd85e476 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:18.160699 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3ecb8751-6b35-4072-9cb5-371dbd85e476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:18.165841 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999aba49-9f0d-4cf5-a5f3-3b4ca122e6ad None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:18.208194 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531740af-c7ca-4c9f-af05-d498c003aff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:18.209070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531740af-c7ca-4c9f-af05-d498c003aff1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.209455 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531740af-c7ca-4c9f-af05-d498c003aff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.210335 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531740af-c7ca-4c9f-af05-d498c003aff1 None admin] PATH_INFO: `/v3/users/9fd151d66e44462194e55efdce163884` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.226276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531740af-c7ca-4c9f-af05-d498c003aff1 None admin] RBAC: Authorizing `identity:get_user(user_id=9fd151d66e44462194e55efdce163884)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:18.227910 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531740af-c7ca-4c9f-af05-d498c003aff1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:18.230094 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 122/244] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:18 2022] GET /identity/v3/users/9fd151d66e44462194e55efdce163884 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:18.236757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531740af-c7ca-4c9f-af05-d498c003aff1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:18.257889 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 123/245] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:18.284115 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb8751-6b35-4072-9cb5-371dbd85e476 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:18.331546 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:18.349150 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531740af-c7ca-4c9f-af05-d498c003aff1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:18.400422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0177cd-3d96-44b1-94f4-7514b385c65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:18.401087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0177cd-3d96-44b1-94f4-7514b385c65c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.401370 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0177cd-3d96-44b1-94f4-7514b385c65c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.401647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0177cd-3d96-44b1-94f4-7514b385c65c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.414982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb8751-6b35-4072-9cb5-371dbd85e476 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:18.446150 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:18.465352 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d76603-d7ee-4976-bd92-a55757179f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:18.466089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d76603-d7ee-4976-bd92-a55757179f2b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.466382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d76603-d7ee-4976-bd92-a55757179f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.466756 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d76603-d7ee-4976-bd92-a55757179f2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.486499 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d76603-d7ee-4976-bd92-a55757179f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:18.495925 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0177cd-3d96-44b1-94f4-7514b385c65c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:18.497096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a3d76603-d7ee-4976-bd92-a55757179f2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:18.497096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:18.497096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:18.497096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:18.497096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:18.497096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:18.497096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:18.497096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:18.497096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:18.497096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:18.497096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:18.497096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:18.497096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:18.497096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:18.497096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:18.497096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:18.497988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:18.497988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:18.497988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:18.497988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:18.497988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:18.497988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:18.497988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:18.497988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:18.497988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:18.497988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:18.497988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:18.497988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:18.497988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:18.497988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:18.497988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:18.497988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:18.498790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:18.498790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:18.498790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:18.498790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:18.498790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:18.498790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:18.498790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:18.498790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:18.498790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:18.498790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:18.498790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:18.498790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:18.499394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0177cd-3d96-44b1-94f4-7514b385c65c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:18.502598 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 124/246] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:28:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:18.504087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993e02e-f5ac-48e2-8927-3ce378a60f9f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.504515 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993e02e-f5ac-48e2-8927-3ce378a60f9f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.504987 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993e02e-f5ac-48e2-8927-3ce378a60f9f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.507327 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 125/247] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:18.508954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993e02e-f5ac-48e2-8927-3ce378a60f9f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:18.637964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:18.677798 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993e02e-f5ac-48e2-8927-3ce378a60f9f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:18.681200 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 123/248] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:18 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:18.682733 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9955eb6-cb1e-4b01-b91c-48473d7ec557 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.683253 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9955eb6-cb1e-4b01-b91c-48473d7ec557 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.683821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9955eb6-cb1e-4b01-b91c-48473d7ec557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.719088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5de014-8551-4315-be74-2a321e88a372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:18.719821 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5de014-8551-4315-be74-2a321e88a372 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.720109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5de014-8551-4315-be74-2a321e88a372 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.720392 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5de014-8551-4315-be74-2a321e88a372 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.721134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5de014-8551-4315-be74-2a321e88a372 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:18.721446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5de014-8551-4315-be74-2a321e88a372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:18.726594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5de014-8551-4315-be74-2a321e88a372 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:18.727831 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b9955eb6-cb1e-4b01-b91c-48473d7ec557 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:18.729375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b9955eb6-cb1e-4b01-b91c-48473d7ec557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:18.733168 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 126/249] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:18 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:18.733983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5de014-8551-4315-be74-2a321e88a372 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:18.791139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:18.858148 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 124/250] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:18.858863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9955eb6-cb1e-4b01-b91c-48473d7ec557 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:18.872466 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5de014-8551-4315-be74-2a321e88a372 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:18.937695 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eceda4-c1d1-412f-a55e-47c32c674dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:18.939619 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eceda4-c1d1-412f-a55e-47c32c674dcf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.940120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eceda4-c1d1-412f-a55e-47c32c674dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.940891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eceda4-c1d1-412f-a55e-47c32c674dcf None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.946747 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eceda4-c1d1-412f-a55e-47c32c674dcf None admin] RBAC: Authorizing `identity:get_project(project_id=eafb781b5fef4c2ebef0cb43793cf42e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:18.946747 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eceda4-c1d1-412f-a55e-47c32c674dcf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:18.955249 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 127/251] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:18 2022] GET /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e => generated 303 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:18.955823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eceda4-c1d1-412f-a55e-47c32c674dcf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:19.047686 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9955eb6-cb1e-4b01-b91c-48473d7ec557 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:19.067184 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:19.088438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a19328-a008-4c68-9faf-b9152210c3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:19.089322 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a19328-a008-4c68-9faf-b9152210c3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:19.089604 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a19328-a008-4c68-9faf-b9152210c3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:19.089876 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a19328-a008-4c68-9faf-b9152210c3a6 None admin] PATH_INFO: `/v3/users/23abfe2828e3411890c62a72df70eb80` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:19.091080 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a19328-a008-4c68-9faf-b9152210c3a6 None admin] RBAC: Authorizing `identity:get_user(user_id=23abfe2828e3411890c62a72df70eb80)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:19.092949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a19328-a008-4c68-9faf-b9152210c3a6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:19.094819 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 125/252] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:18 2022] GET /identity/v3/users/23abfe2828e3411890c62a72df70eb80 => generated 284 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:19.095398 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a19328-a008-4c68-9faf-b9152210c3a6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:19.151750 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eceda4-c1d1-412f-a55e-47c32c674dcf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:19.183779 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:19.206940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae357d-8fae-4a31-ab82-c248d4e921f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:19.207668 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae357d-8fae-4a31-ab82-c248d4e921f2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:19.207957 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae357d-8fae-4a31-ab82-c248d4e921f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:19.208235 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae357d-8fae-4a31-ab82-c248d4e921f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:19.215834 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a19328-a008-4c68-9faf-b9152210c3a6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:19.219356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae357d-8fae-4a31-ab82-c248d4e921f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:19.228090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4dae357d-8fae-4a31-ab82-c248d4e921f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:19.228090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:19.228090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:19.228090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:19.228090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:19.228090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:19.228090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:19.228090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:19.228090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:19.228090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:19.228090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:19.228090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:19.228090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:19.228090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:19.228090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:19.228090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:19.229008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:19.229008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:19.229008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:19.229008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:19.229008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:19.229008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:19.229008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:19.229008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:19.229008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:19.229008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:19.229008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:19.229008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:19.229008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:19.229008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:19.229008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:19.229008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:19.229778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:19.229778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:19.229778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:19.229778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:19.229778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:19.229778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:19.229778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:19.229778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:19.229778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:19.229778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:19.229778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:19.229778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:19.229778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 128/253] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:19.230435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae357d-8fae-4a31-ab82-c248d4e921f2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:19.259040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677bbd0-11c4-461a-9aaf-702b7e030835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:19.259693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677bbd0-11c4-461a-9aaf-702b7e030835 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:19.260140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677bbd0-11c4-461a-9aaf-702b7e030835 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:19.260681 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677bbd0-11c4-461a-9aaf-702b7e030835 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:19.261828 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677bbd0-11c4-461a-9aaf-702b7e030835 None admin] RBAC: Adding query filter params (role.id=2c812f60cda548deb1893180061ff8e5, scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e, user.id=9fd151d66e44462194e55efdce163884) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:19.262279 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677bbd0-11c4-461a-9aaf-702b7e030835 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:19.264104 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677bbd0-11c4-461a-9aaf-702b7e030835 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:19.278600 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 126/254] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:28:19 2022] GET /identity/v3/role_assignments?user.id=9fd151d66e44462194e55efdce163884&scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e&role.id=2c812f60cda548deb1893180061ff8e5 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:19.280434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b688aae-d4a5-458b-a898-7d6e5138109a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:19.280906 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b688aae-d4a5-458b-a898-7d6e5138109a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:19.281187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b688aae-d4a5-458b-a898-7d6e5138109a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:19.282600 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 127/255] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:19.283269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b688aae-d4a5-458b-a898-7d6e5138109a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:19.358959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae357d-8fae-4a31-ab82-c248d4e921f2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:19.403130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11008be6-a2cd-4691-867c-cfb39f5fe2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:19.404071 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11008be6-a2cd-4691-867c-cfb39f5fe2fc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:19.404503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11008be6-a2cd-4691-867c-cfb39f5fe2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:19.409884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11008be6-a2cd-4691-867c-cfb39f5fe2fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:19.438931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:19.472694 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:19.504992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11008be6-a2cd-4691-867c-cfb39f5fe2fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:19.506464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11008be6-a2cd-4691-867c-cfb39f5fe2fc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:19.543111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b688aae-d4a5-458b-a898-7d6e5138109a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:19.608606 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6893c-f2cf-4442-8663-ad0844d3c4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:19.609291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6893c-f2cf-4442-8663-ad0844d3c4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:19.609580 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6893c-f2cf-4442-8663-ad0844d3c4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:19.609857 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6893c-f2cf-4442-8663-ad0844d3c4e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:19.610625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6893c-f2cf-4442-8663-ad0844d3c4e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:19.610941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6893c-f2cf-4442-8663-ad0844d3c4e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:19.612317 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6893c-f2cf-4442-8663-ad0844d3c4e1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:19.632840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 128/256] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:19 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:19.635842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b080533-8f95-46fa-ac7c-c71946e5bc12 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:19.636134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b080533-8f95-46fa-ac7c-c71946e5bc12 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:19.636415 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b080533-8f95-46fa-ac7c-c71946e5bc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:19.667079 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0b080533-8f95-46fa-ac7c-c71946e5bc12 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:19.668986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0b080533-8f95-46fa-ac7c-c71946e5bc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:19.677123 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 129/257] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:19 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:19.678061 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11008be6-a2cd-4691-867c-cfb39f5fe2fc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:19.799919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 129/258] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:19.800790 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b080533-8f95-46fa-ac7c-c71946e5bc12 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:19.810026 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:19.855010 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11008be6-a2cd-4691-867c-cfb39f5fe2fc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:19.882621 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:19.916983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af3d44-9eb1-40b6-a4b9-83bebb0511cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:19.917871 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af3d44-9eb1-40b6-a4b9-83bebb0511cd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:19.918153 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af3d44-9eb1-40b6-a4b9-83bebb0511cd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:19.918429 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af3d44-9eb1-40b6-a4b9-83bebb0511cd None admin] PATH_INFO: `/v3/users/b27b58e77d8a489aaf4a1e8a1b2b01bc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:19.919656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af3d44-9eb1-40b6-a4b9-83bebb0511cd None admin] RBAC: Authorizing `identity:get_user(user_id=b27b58e77d8a489aaf4a1e8a1b2b01bc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:19.921128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af3d44-9eb1-40b6-a4b9-83bebb0511cd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:19.922785 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 130/259] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:19 2022] GET /identity/v3/users/b27b58e77d8a489aaf4a1e8a1b2b01bc => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:19.923624 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af3d44-9eb1-40b6-a4b9-83bebb0511cd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:19.999695 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b080533-8f95-46fa-ac7c-c71946e5bc12 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:20.060181 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e51f6-3006-4a9f-aab1-85930ebd53da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:20.060976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e51f6-3006-4a9f-aab1-85930ebd53da None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:20.061259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e51f6-3006-4a9f-aab1-85930ebd53da None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:20.061534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e51f6-3006-4a9f-aab1-85930ebd53da None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:20.062902 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e51f6-3006-4a9f-aab1-85930ebd53da None admin] RBAC: Authorizing `identity:get_project(project_id=eafb781b5fef4c2ebef0cb43793cf42e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:20.064373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e51f6-3006-4a9f-aab1-85930ebd53da None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:20.066080 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 130/260] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:19 2022] GET /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e => generated 303 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:20.072642 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e51f6-3006-4a9f-aab1-85930ebd53da None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:20.098473 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af3d44-9eb1-40b6-a4b9-83bebb0511cd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:20.169143 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb04872-0faa-4a85-a670-4775267c8d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:20.170351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb04872-0faa-4a85-a670-4775267c8d07 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:20.170857 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb04872-0faa-4a85-a670-4775267c8d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:20.171326 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb04872-0faa-4a85-a670-4775267c8d07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:20.186972 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e51f6-3006-4a9f-aab1-85930ebd53da None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:20.197076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:20.199519 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb04872-0faa-4a85-a670-4775267c8d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:20.216035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-cfb04872-0faa-4a85-a670-4775267c8d07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:20.216035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:20.216035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:20.216035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:20.216035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:20.216035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:20.216035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:20.216035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:20.216035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:20.216035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:20.216035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:20.216035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:20.216035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:20.216035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:20.216035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:20.216035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:20.216992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:20.216992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:20.216992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:20.216992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:20.216992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:20.216992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:20.216992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:20.216992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:20.216992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:20.216992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:20.216992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:20.216992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:20.216992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:20.216992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:20.216992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:20.216992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:20.217802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:20.217802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:20.217802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:20.217802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:20.217802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:20.217802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:20.217802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:20.217802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:20.217802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:20.217802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:20.217802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:20.217802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:20.217802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 131/261] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:28:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:20.218447 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb04872-0faa-4a85-a670-4775267c8d07 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:20.226480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:20.229171 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617e577-161a-4255-9a77-1bc92a863379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:20.230114 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617e577-161a-4255-9a77-1bc92a863379 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:20.230460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617e577-161a-4255-9a77-1bc92a863379 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:20.230770 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617e577-161a-4255-9a77-1bc92a863379 None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:20.232291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617e577-161a-4255-9a77-1bc92a863379 None admin] RBAC: Authorizing `identity:get_project(project_id=eafb781b5fef4c2ebef0cb43793cf42e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:20.233478 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617e577-161a-4255-9a77-1bc92a863379 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:20.235569 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 131/262] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:20 2022] GET /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e => generated 303 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:20.236498 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617e577-161a-4255-9a77-1bc92a863379 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:20.344578 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617e577-161a-4255-9a77-1bc92a863379 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:20.385218 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8161436-11b2-4008-b47f-3a2ba98a8fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:20.386209 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8161436-11b2-4008-b47f-3a2ba98a8fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:20.386726 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8161436-11b2-4008-b47f-3a2ba98a8fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:20.387220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8161436-11b2-4008-b47f-3a2ba98a8fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:20.388178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8161436-11b2-4008-b47f-3a2ba98a8fb7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:20.388698 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8161436-11b2-4008-b47f-3a2ba98a8fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:20.390348 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8161436-11b2-4008-b47f-3a2ba98a8fb7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:20.404120 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 132/263] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:28:20 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:20.405227 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8161436-11b2-4008-b47f-3a2ba98a8fb7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:20.448711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:20.514517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8161436-11b2-4008-b47f-3a2ba98a8fb7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:20.562307 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb04872-0faa-4a85-a670-4775267c8d07 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:20.566837 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc2c44-9344-427c-b699-8ef3ae27a01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:20.567762 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc2c44-9344-427c-b699-8ef3ae27a01b None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:20.568051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc2c44-9344-427c-b699-8ef3ae27a01b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:20.568321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc2c44-9344-427c-b699-8ef3ae27a01b None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e/users/b27b58e77d8a489aaf4a1e8a1b2b01bc/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:20.575445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc2c44-9344-427c-b699-8ef3ae27a01b None admin] RBAC: Authorizing `identity:create_grant(project_id=eafb781b5fef4c2ebef0cb43793cf42e, user_id=b27b58e77d8a489aaf4a1e8a1b2b01bc, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:20.576953 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc2c44-9344-427c-b699-8ef3ae27a01b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:20.602034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 133/264] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:28:20 2022] PUT /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e/users/b27b58e77d8a489aaf4a1e8a1b2b01bc/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:20.603292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc2c44-9344-427c-b699-8ef3ae27a01b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:20.675425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b67b3-6111-477d-8fbe-e980e810eb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:20.676116 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b67b3-6111-477d-8fbe-e980e810eb8b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:20.676598 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b67b3-6111-477d-8fbe-e980e810eb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:20.677025 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b67b3-6111-477d-8fbe-e980e810eb8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:20.678144 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b67b3-6111-477d-8fbe-e980e810eb8b None admin] RBAC: Adding query filter params (role.id=1393d128d39b4649b6cd71b6609846cb, scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e, user.id=23abfe2828e3411890c62a72df70eb80) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:20.678692 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b67b3-6111-477d-8fbe-e980e810eb8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:20.680365 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b67b3-6111-477d-8fbe-e980e810eb8b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:20.695318 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 132/265] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:28:20 2022] GET /identity/v3/role_assignments?user.id=23abfe2828e3411890c62a72df70eb80&scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e&role.id=1393d128d39b4649b6cd71b6609846cb => generated 610 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:20.721697 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc2c44-9344-427c-b699-8ef3ae27a01b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:20.723693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:20.764114 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5c69a-0f49-4579-ba76-a3dd58f1a6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:20.765090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5c69a-0f49-4579-ba76-a3dd58f1a6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:20.765611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5c69a-0f49-4579-ba76-a3dd58f1a6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:20.766229 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5c69a-0f49-4579-ba76-a3dd58f1a6b3 None admin] PATH_INFO: `/v3/users/23abfe2828e3411890c62a72df70eb80` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:20.772946 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5c69a-0f49-4579-ba76-a3dd58f1a6b3 None admin] RBAC: Authorizing `identity:get_user(user_id=23abfe2828e3411890c62a72df70eb80)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:20.774788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5c69a-0f49-4579-ba76-a3dd58f1a6b3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:20.776845 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 134/266] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:20 2022] GET /identity/v3/users/23abfe2828e3411890c62a72df70eb80 => generated 284 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:20.783739 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b67b3-6111-477d-8fbe-e980e810eb8b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:20.877685 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb390a04-7f98-407b-b156-230c03ee206f None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:20.878198 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb390a04-7f98-407b-b156-230c03ee206f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:20.878674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb390a04-7f98-407b-b156-230c03ee206f None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:20.881864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 135/267] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:20.886726 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f41a3-7609-4ee9-ae16-7e075ebfcd6b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:20.887357 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f41a3-7609-4ee9-ae16-7e075ebfcd6b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:20.887848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f41a3-7609-4ee9-ae16-7e075ebfcd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:20.893778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:20.926271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7e6f41a3-7609-4ee9-ae16-7e075ebfcd6b None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:20.926271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7e6f41a3-7609-4ee9-ae16-7e075ebfcd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:20.927468 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b67b3-6111-477d-8fbe-e980e810eb8b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:20.966264 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4265fb-abc4-447a-9f84-8b353c598746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:20.966977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4265fb-abc4-447a-9f84-8b353c598746 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:20.967432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4265fb-abc4-447a-9f84-8b353c598746 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:20.967885 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4265fb-abc4-447a-9f84-8b353c598746 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.052953 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4265fb-abc4-447a-9f84-8b353c598746 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:21.055404 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4265fb-abc4-447a-9f84-8b353c598746 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:21.065189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 136/268] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:21.066543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd9f47-c68b-40b5-ac20-a2970032a25e None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.067017 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd9f47-c68b-40b5-ac20-a2970032a25e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.067460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd9f47-c68b-40b5-ac20-a2970032a25e None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.068992 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 137/269] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:21.079052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfe7c1-035f-4d82-b7fd-ad3f77851de5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.079530 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfe7c1-035f-4d82-b7fd-ad3f77851de5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.079946 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfe7c1-035f-4d82-b7fd-ad3f77851de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.098673 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-5fdfe7c1-035f-4d82-b7fd-ad3f77851de5 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:21.100099 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5fdfe7c1-035f-4d82-b7fd-ad3f77851de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:21.127923 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:21.174163 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 133/270] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:20 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:21.175171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4265fb-abc4-447a-9f84-8b353c598746 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:21.203062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 138/271] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:21.203599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfe7c1-035f-4d82-b7fd-ad3f77851de5 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:21.262972 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:21.313663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4265fb-abc4-447a-9f84-8b353c598746 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:21.361117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfe7c1-035f-4d82-b7fd-ad3f77851de5 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:21.376421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2bf61-9ac6-459a-8a0d-23f61780772e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:21.377997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2bf61-9ac6-459a-8a0d-23f61780772e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.378898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2bf61-9ac6-459a-8a0d-23f61780772e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.379670 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2bf61-9ac6-459a-8a0d-23f61780772e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.399087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2bf61-9ac6-459a-8a0d-23f61780772e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:21.405058 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb78be4-5020-409f-a8ee-9a5d044f83bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:21.406024 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb78be4-5020-409f-a8ee-9a5d044f83bf None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.406377 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb78be4-5020-409f-a8ee-9a5d044f83bf None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.406744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb78be4-5020-409f-a8ee-9a5d044f83bf None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.407991 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb78be4-5020-409f-a8ee-9a5d044f83bf None admin] RBAC: Authorizing `identity:get_project(project_id=eafb781b5fef4c2ebef0cb43793cf42e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:21.409525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb78be4-5020-409f-a8ee-9a5d044f83bf None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:21.409759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8ba2bf61-9ac6-459a-8a0d-23f61780772e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:21.409759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:21.409759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:21.409759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:21.409759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:21.409759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:21.409759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:21.409759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:21.409759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:21.409759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:21.409759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:21.409759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:21.409759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:21.409759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:21.409759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:21.409759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:21.410652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:21.410652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:21.410652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:21.410652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:21.410652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:21.410652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:21.410652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:21.410652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:21.410652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:21.410652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:21.410652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:21.410652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:21.410652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:21.410652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:21.410652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:21.410652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:21.411480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:21.411480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:21.411480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:21.411480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:21.411480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:21.411480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:21.411480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:21.411480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:21.411480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:21.411480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:21.411480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:21.411480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:21.414794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 134/273] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:21.415763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2bf61-9ac6-459a-8a0d-23f61780772e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:21.418634 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 139/273] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:21 2022] GET /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e => generated 303 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:21.422821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb78be4-5020-409f-a8ee-9a5d044f83bf None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:21.452816 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:21.533028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2bf61-9ac6-459a-8a0d-23f61780772e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:21.543433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:21.553645 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb78be4-5020-409f-a8ee-9a5d044f83bf None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:21.572815 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d45f14-e831-4212-83c9-c51d7855a58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:21.574340 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d45f14-e831-4212-83c9-c51d7855a58e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.574869 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d45f14-e831-4212-83c9-c51d7855a58e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.575340 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d45f14-e831-4212-83c9-c51d7855a58e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.576875 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d45f14-e831-4212-83c9-c51d7855a58e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:21.578512 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d45f14-e831-4212-83c9-c51d7855a58e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:21.580770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 135/274] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:21 2022] GET /identity/v3/domains/default => generated 200 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:21.581714 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d45f14-e831-4212-83c9-c51d7855a58e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:21.602892 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b0ece-9cf1-4317-a970-437e07f621fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:21.603578 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b0ece-9cf1-4317-a970-437e07f621fd None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.603865 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b0ece-9cf1-4317-a970-437e07f621fd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.604144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b0ece-9cf1-4317-a970-437e07f621fd None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.605185 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b0ece-9cf1-4317-a970-437e07f621fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:21.605499 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b0ece-9cf1-4317-a970-437e07f621fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:21.607668 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b0ece-9cf1-4317-a970-437e07f621fd None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:21.622730 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 140/275] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:21 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:21.623895 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b0ece-9cf1-4317-a970-437e07f621fd None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:21.713692 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:21.725806 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d45f14-e831-4212-83c9-c51d7855a58e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:21.743314 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b0ece-9cf1-4317-a970-437e07f621fd None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:21.774757 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022231b-ebdc-4d01-b4ba-514582148e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:21.775464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022231b-ebdc-4d01-b4ba-514582148e88 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.775697 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022231b-ebdc-4d01-b4ba-514582148e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.775977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022231b-ebdc-4d01-b4ba-514582148e88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.776808 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022231b-ebdc-4d01-b4ba-514582148e88 None admin] RBAC: Adding query filter params (role.id=634cfaacf2e444359b518d8dc7ed122b, scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e, user.id=23abfe2828e3411890c62a72df70eb80) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:21.777124 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022231b-ebdc-4d01-b4ba-514582148e88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:21.778669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022231b-ebdc-4d01-b4ba-514582148e88 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:21.783879 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d833d-db31-4bb6-977a-489274a21653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:21.784818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d833d-db31-4bb6-977a-489274a21653 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.785296 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d833d-db31-4bb6-977a-489274a21653 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.785763 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d833d-db31-4bb6-977a-489274a21653 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.786741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d833d-db31-4bb6-977a-489274a21653 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:21.788425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d833d-db31-4bb6-977a-489274a21653 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:21.791100 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 136/276] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:28:21 2022] GET /identity/v3/role_assignments?user.id=23abfe2828e3411890c62a72df70eb80&scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e&role.id=634cfaacf2e444359b518d8dc7ed122b => generated 610 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:21.792137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022231b-ebdc-4d01-b4ba-514582148e88 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:21.815295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 141/277] 10.222.0.110 () {60 vars in 1137 bytes} [Thu May 26 16:28:21 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:21.904548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424041d-da6b-4142-a768-639ecf913f33 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.905194 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424041d-da6b-4142-a768-639ecf913f33 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.905735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424041d-da6b-4142-a768-639ecf913f33 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.907868 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 142/278] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:21 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:21.914162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c058acd-7b8d-473c-acba-908d10325d2c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.914835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c058acd-7b8d-473c-acba-908d10325d2c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.915309 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c058acd-7b8d-473c-acba-908d10325d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.956111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0c058acd-7b8d-473c-acba-908d10325d2c None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:21.957386 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0c058acd-7b8d-473c-acba-908d10325d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:21.973811 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:21.979060 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022231b-ebdc-4d01-b4ba-514582148e88 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:22.049159 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26b97a-f7e8-4c32-a88b-c74948d1611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:22.050376 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26b97a-f7e8-4c32-a88b-c74948d1611d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.052907 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26b97a-f7e8-4c32-a88b-c74948d1611d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.052907 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26b97a-f7e8-4c32-a88b-c74948d1611d None admin] PATH_INFO: `/v3/users/eab53255e00f4a15a42ed163b6e2e1d3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.074426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26b97a-f7e8-4c32-a88b-c74948d1611d None admin] RBAC: Authorizing `identity:get_user(user_id=eab53255e00f4a15a42ed163b6e2e1d3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:22.077334 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26b97a-f7e8-4c32-a88b-c74948d1611d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:22.085849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 137/279] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:21 2022] GET /identity/v3/users/eab53255e00f4a15a42ed163b6e2e1d3 => generated 294 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:22.087597 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26b97a-f7e8-4c32-a88b-c74948d1611d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:22.101289 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 143/280] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:22.114375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:22.125916 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c058acd-7b8d-473c-acba-908d10325d2c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:22.218102 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26b97a-f7e8-4c32-a88b-c74948d1611d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:22.255262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c058acd-7b8d-473c-acba-908d10325d2c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:22.265132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a40e33-779b-421b-b14e-0667cf9055d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:22.265801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a40e33-779b-421b-b14e-0667cf9055d8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.266074 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a40e33-779b-421b-b14e-0667cf9055d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.266671 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a40e33-779b-421b-b14e-0667cf9055d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.267244 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a40e33-779b-421b-b14e-0667cf9055d8 None admin] RBAC: Adding query filter params (role.id=1fdf01beb7394da2a4ea549a7d1bccf1, user.id=eab53255e00f4a15a42ed163b6e2e1d3, scope.system=all) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:22.267576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a40e33-779b-421b-b14e-0667cf9055d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:22.269136 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a40e33-779b-421b-b14e-0667cf9055d8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:22.277001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 138/281] 10.222.0.110 () {56 vars in 1313 bytes} [Thu May 26 16:28:22 2022] GET /identity/v3/role_assignments?user.id=eab53255e00f4a15a42ed163b6e2e1d3&scope.system=all&role.id=1fdf01beb7394da2a4ea549a7d1bccf1 => generated 227 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:22.303096 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6437e66-f61e-4344-bf21-9fb01372d6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:22.304056 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6437e66-f61e-4344-bf21-9fb01372d6fe None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.304341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6437e66-f61e-4344-bf21-9fb01372d6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.304622 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6437e66-f61e-4344-bf21-9fb01372d6fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.318742 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6437e66-f61e-4344-bf21-9fb01372d6fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:22.327466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-b6437e66-f61e-4344-bf21-9fb01372d6fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:22.327466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:22.327466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:22.327466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:22.327466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:22.327466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:22.327466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:22.327466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:22.327466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:22.327466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:22.327466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:22.327466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:22.327466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:22.327466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:22.327466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:22.327466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:22.328410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:22.328410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:22.328410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:22.328410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:22.328410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:22.328410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:22.328410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:22.328410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:22.328410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:22.328410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:22.328410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:22.328410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:22.328410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:22.328410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:22.328410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:22.328410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:22.329174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:22.329174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:22.329174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:22.329174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:22.329174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:22.329174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:22.329174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:22.329174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:22.329174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:22.329174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:22.329174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:22.329174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:22.329174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 144/282] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:22.335433 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a40e33-779b-421b-b14e-0667cf9055d8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:22.434952 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:22.454713 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a40e33-779b-421b-b14e-0667cf9055d8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:22.493697 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0e261-6093-4316-9d0a-d73102ebef79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:22.494379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0e261-6093-4316-9d0a-d73102ebef79 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.494694 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0e261-6093-4316-9d0a-d73102ebef79 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.494976 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0e261-6093-4316-9d0a-d73102ebef79 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.495729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0e261-6093-4316-9d0a-d73102ebef79 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:22.496037 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0e261-6093-4316-9d0a-d73102ebef79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:22.497412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0e261-6093-4316-9d0a-d73102ebef79 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:22.509472 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 139/283] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:22 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:22.515020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6437e66-f61e-4344-bf21-9fb01372d6fe None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:22.518183 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:22.664198 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6437e66-f61e-4344-bf21-9fb01372d6fe None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:22.731293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3981e2-79b0-426c-8cd0-ea15ce3b1cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:22.732570 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3981e2-79b0-426c-8cd0-ea15ce3b1cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.733070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3981e2-79b0-426c-8cd0-ea15ce3b1cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.733533 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3981e2-79b0-426c-8cd0-ea15ce3b1cb7 None admin] PATH_INFO: `/v3/users/9fd151d66e44462194e55efdce163884` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.735032 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3981e2-79b0-426c-8cd0-ea15ce3b1cb7 None admin] RBAC: Authorizing `identity:get_user(user_id=9fd151d66e44462194e55efdce163884)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:22.736692 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3981e2-79b0-426c-8cd0-ea15ce3b1cb7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:22.738580 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 145/284] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:22 2022] GET /identity/v3/users/9fd151d66e44462194e55efdce163884 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:22.747706 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0e261-6093-4316-9d0a-d73102ebef79 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:22.883457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0e261-6093-4316-9d0a-d73102ebef79 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:22.926314 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ca914-a3b0-4d82-ad92-48de91477665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:22.927237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ca914-a3b0-4d82-ad92-48de91477665 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.927525 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ca914-a3b0-4d82-ad92-48de91477665 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.927895 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ca914-a3b0-4d82-ad92-48de91477665 None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.929357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ca914-a3b0-4d82-ad92-48de91477665 None admin] RBAC: Authorizing `identity:get_project(project_id=eafb781b5fef4c2ebef0cb43793cf42e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:22.930853 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ca914-a3b0-4d82-ad92-48de91477665 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:22.932726 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 140/285] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:22 2022] GET /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e => generated 303 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:22.938133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3981e2-79b0-426c-8cd0-ea15ce3b1cb7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:23.037467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:23.079145 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3981e2-79b0-426c-8cd0-ea15ce3b1cb7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:23.135467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64029d-c5f1-4df9-9bb9-bee6485f20a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:23.136311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64029d-c5f1-4df9-9bb9-bee6485f20a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:23.136600 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64029d-c5f1-4df9-9bb9-bee6485f20a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:23.136879 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64029d-c5f1-4df9-9bb9-bee6485f20a5 None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e/users/9fd151d66e44462194e55efdce163884/roles/2c812f60cda548deb1893180061ff8e5` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:23.139150 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64029d-c5f1-4df9-9bb9-bee6485f20a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=eafb781b5fef4c2ebef0cb43793cf42e, user_id=9fd151d66e44462194e55efdce163884, role_id=2c812f60cda548deb1893180061ff8e5)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:23.140657 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64029d-c5f1-4df9-9bb9-bee6485f20a5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:23.159436 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 146/286] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:28:22 2022] PUT /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e/users/9fd151d66e44462194e55efdce163884/roles/2c812f60cda548deb1893180061ff8e5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:23.469707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddeb79-f07e-4c13-9b15-f16628763f4d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:23.470018 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddeb79-f07e-4c13-9b15-f16628763f4d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:23.470559 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddeb79-f07e-4c13-9b15-f16628763f4d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:23.472712 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 141/287] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:23 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:23.480207 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bd9ee-fe8d-49b8-94a9-60c116007bed None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:23.480207 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bd9ee-fe8d-49b8-94a9-60c116007bed None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:23.480207 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bd9ee-fe8d-49b8-94a9-60c116007bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:23.496839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c81bd9ee-fe8d-49b8-94a9-60c116007bed None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:23.498291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c81bd9ee-fe8d-49b8-94a9-60c116007bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:23.568244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 147/288] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:23.592759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddeb79-f07e-4c13-9b15-f16628763f4d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:23.606485 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:23.716383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddeb79-f07e-4c13-9b15-f16628763f4d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:23.754487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137f562-5c7a-48a0-926f-b7f24eb4d7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:23.756088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137f562-5c7a-48a0-926f-b7f24eb4d7cf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:23.756662 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137f562-5c7a-48a0-926f-b7f24eb4d7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:23.757185 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137f562-5c7a-48a0-926f-b7f24eb4d7cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:23.768229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137f562-5c7a-48a0-926f-b7f24eb4d7cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:23.776385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5137f562-5c7a-48a0-926f-b7f24eb4d7cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:23.776385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:23.776385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:23.776385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:23.776385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:23.776385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:23.776385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:23.776385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:23.776385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:23.776385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:23.776385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:23.776385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:23.776385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:23.776385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:23.776385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:23.776385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:23.777317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:23.777317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:23.777317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:23.777317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:23.777317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:23.777317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:23.777317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:23.777317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:23.777317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:23.777317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:23.777317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:23.777317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:23.777317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:23.777317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:23.777317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:23.777317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:23.778187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:23.778187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:23.778187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:23.778187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:23.778187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:23.778187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:23.778187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:23.778187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:23.778187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:23.778187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:23.778187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:23.778187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:23.780953 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 142/289] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:23.786997 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bd9ee-fe8d-49b8-94a9-60c116007bed None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:23.847728 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:23.892165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bd9ee-fe8d-49b8-94a9-60c116007bed None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:23.927847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14031b-b285-4ad1-8142-a315c6ede579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:23.928941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14031b-b285-4ad1-8142-a315c6ede579 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:23.929430 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14031b-b285-4ad1-8142-a315c6ede579 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:23.929898 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14031b-b285-4ad1-8142-a315c6ede579 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:23.930866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14031b-b285-4ad1-8142-a315c6ede579 None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:23.931368 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14031b-b285-4ad1-8142-a315c6ede579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:23.932949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14031b-b285-4ad1-8142-a315c6ede579 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:23.942038 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 148/290] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:23 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:23.947898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137f562-5c7a-48a0-926f-b7f24eb4d7cf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:24.034757 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:24.075083 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137f562-5c7a-48a0-926f-b7f24eb4d7cf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:24.127776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ede87f-59b3-4808-9f40-50c2742ace83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:24.129026 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ede87f-59b3-4808-9f40-50c2742ace83 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:24.129505 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ede87f-59b3-4808-9f40-50c2742ace83 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:24.129973 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ede87f-59b3-4808-9f40-50c2742ace83 None admin] PATH_INFO: `/v3/users/b27b58e77d8a489aaf4a1e8a1b2b01bc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:24.131419 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ede87f-59b3-4808-9f40-50c2742ace83 None admin] RBAC: Authorizing `identity:get_user(user_id=b27b58e77d8a489aaf4a1e8a1b2b01bc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:24.133096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ede87f-59b3-4808-9f40-50c2742ace83 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:24.135040 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 143/291] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:23 2022] GET /identity/v3/users/b27b58e77d8a489aaf4a1e8a1b2b01bc => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:24.140943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14031b-b285-4ad1-8142-a315c6ede579 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:24.248578 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14031b-b285-4ad1-8142-a315c6ede579 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:24.272794 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:24.285089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d40173-6d0f-4ffd-af63-cd4918b0e906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:24.286051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40173-6d0f-4ffd-af63-cd4918b0e906 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:24.286531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40173-6d0f-4ffd-af63-cd4918b0e906 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:24.287058 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40173-6d0f-4ffd-af63-cd4918b0e906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:24.357656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d40173-6d0f-4ffd-af63-cd4918b0e906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:24.359495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d40173-6d0f-4ffd-af63-cd4918b0e906 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:24.463371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 149/292] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:28:24.471191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ede87f-59b3-4808-9f40-50c2742ace83 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:24.611480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ede87f-59b3-4808-9f40-50c2742ace83 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:24.658033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2eb30-3c0f-492b-85e5-82c538d89cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:24.659407 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2eb30-3c0f-492b-85e5-82c538d89cad None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:24.659902 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2eb30-3c0f-492b-85e5-82c538d89cad None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:24.660370 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2eb30-3c0f-492b-85e5-82c538d89cad None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:24.661825 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2eb30-3c0f-492b-85e5-82c538d89cad None admin] RBAC: Authorizing `identity:get_project(project_id=eafb781b5fef4c2ebef0cb43793cf42e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:24.664009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2eb30-3c0f-492b-85e5-82c538d89cad None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:24.666270 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 144/293] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:24 2022] GET /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e => generated 303 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:24.671967 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d40173-6d0f-4ffd-af63-cd4918b0e906 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:24.706940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:24.763269 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d611d-f6ca-4de5-924d-b29e3ad8b18c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:24.763816 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d611d-f6ca-4de5-924d-b29e3ad8b18c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:24.763816 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d611d-f6ca-4de5-924d-b29e3ad8b18c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:24.766323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 145/294] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:28:24.770226 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46dc9a-9133-407d-a706-a22a70928742 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:24.770506 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46dc9a-9133-407d-a706-a22a70928742 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:24.770821 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46dc9a-9133-407d-a706-a22a70928742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:24.778957 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d40173-6d0f-4ffd-af63-cd4918b0e906 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:24.795851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:24.815736 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cd46dc9a-9133-407d-a706-a22a70928742 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:24.817846 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cd46dc9a-9133-407d-a706-a22a70928742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:24.823389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86004e2-781f-4156-847b-7b5fa5c02c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:24.824411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86004e2-781f-4156-847b-7b5fa5c02c50 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:24.824935 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86004e2-781f-4156-847b-7b5fa5c02c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:24.825399 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86004e2-781f-4156-847b-7b5fa5c02c50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:24.826448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86004e2-781f-4156-847b-7b5fa5c02c50 None admin] RBAC: Adding query filter params (role.id=1fdf01beb7394da2a4ea549a7d1bccf1, scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e, user.id=b27b58e77d8a489aaf4a1e8a1b2b01bc) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:24.827200 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86004e2-781f-4156-847b-7b5fa5c02c50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:24.830088 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86004e2-781f-4156-847b-7b5fa5c02c50 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:24.844587 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 150/295] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:28:24 2022] GET /identity/v3/role_assignments?user.id=b27b58e77d8a489aaf4a1e8a1b2b01bc&scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e&role.id=1fdf01beb7394da2a4ea549a7d1bccf1 => generated 610 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:24.919083 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 146/296] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:24.960029 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86004e2-781f-4156-847b-7b5fa5c02c50 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:25.064219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d4898-0070-4d68-93bc-e5938833b30c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.064554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d4898-0070-4d68-93bc-e5938833b30c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.064790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d4898-0070-4d68-93bc-e5938833b30c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.066507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 147/297] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:25.071917 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b4100-41bd-48cb-8ab4-2899b42ccfca None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.072199 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b4100-41bd-48cb-8ab4-2899b42ccfca None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.072479 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b4100-41bd-48cb-8ab4-2899b42ccfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.082958 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:25.092818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86004e2-781f-4156-847b-7b5fa5c02c50 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:25.102978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-264b4100-41bd-48cb-8ab4-2899b42ccfca None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:25.104709 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-264b4100-41bd-48cb-8ab4-2899b42ccfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:25.143521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8212e-0630-45c6-884d-c4476716f194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:25.146199 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8212e-0630-45c6-884d-c4476716f194 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.146199 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8212e-0630-45c6-884d-c4476716f194 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.146199 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8212e-0630-45c6-884d-c4476716f194 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.160495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8212e-0630-45c6-884d-c4476716f194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:25.168683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-e1c8212e-0630-45c6-884d-c4476716f194 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:25.168683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:25.168683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:25.168683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:25.168683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:25.168683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:25.168683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:25.168683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:25.168683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:25.168683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:25.168683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:25.168683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:25.168683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:25.168683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:25.168683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:25.168683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:25.169620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:25.169620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:25.169620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:25.169620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:25.169620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:25.169620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:25.169620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:25.169620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:25.169620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:25.169620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:25.169620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:25.169620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:25.169620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:25.169620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:25.169620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:25.169620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:25.171361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:25.171361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:25.171361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:25.171361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:25.171361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:25.171361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:25.171361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:25.171361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:25.171361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:25.171361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:25.171361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:25.171361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:25.171361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 151/298] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:25.173784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fe4d3-68e7-45ea-8c06-ec43e4f5bf14 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.173784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fe4d3-68e7-45ea-8c06-ec43e4f5bf14 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.173784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fe4d3-68e7-45ea-8c06-ec43e4f5bf14 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.174361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 152/299] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:25.175502 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fe4d3-68e7-45ea-8c06-ec43e4f5bf14 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:25.199409 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 148/300] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:25.200711 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f39ab-44d1-4140-a6e5-8507a5e76ac6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.201547 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f39ab-44d1-4140-a6e5-8507a5e76ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.201836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f39ab-44d1-4140-a6e5-8507a5e76ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.219887 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-062f39ab-44d1-4140-a6e5-8507a5e76ac6 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:25.221087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-062f39ab-44d1-4140-a6e5-8507a5e76ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:25.294650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:25.302867 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 149/301] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:25.303834 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f39ab-44d1-4140-a6e5-8507a5e76ac6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:25.313608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fe4d3-68e7-45ea-8c06-ec43e4f5bf14 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:25.350964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ceee70-2bbc-4a0c-8c79-c004ecd69cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:25.351781 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ceee70-2bbc-4a0c-8c79-c004ecd69cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.352136 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ceee70-2bbc-4a0c-8c79-c004ecd69cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.352424 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ceee70-2bbc-4a0c-8c79-c004ecd69cb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.353167 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ceee70-2bbc-4a0c-8c79-c004ecd69cb4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:25.353480 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ceee70-2bbc-4a0c-8c79-c004ecd69cb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:25.354930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ceee70-2bbc-4a0c-8c79-c004ecd69cb4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:25.371206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 153/302] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:25 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:25.371206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ceee70-2bbc-4a0c-8c79-c004ecd69cb4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:25.381880 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:25.424026 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f39ab-44d1-4140-a6e5-8507a5e76ac6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:25.460701 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269311b-3d34-4104-a809-4fc7f7044329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:25.461596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269311b-3d34-4104-a809-4fc7f7044329 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.461886 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269311b-3d34-4104-a809-4fc7f7044329 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.462161 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269311b-3d34-4104-a809-4fc7f7044329 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.463352 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269311b-3d34-4104-a809-4fc7f7044329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:25.464807 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269311b-3d34-4104-a809-4fc7f7044329 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:25.466607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 150/303] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:25 2022] GET /identity/v3/domains/default => generated 200 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:25.467223 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269311b-3d34-4104-a809-4fc7f7044329 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:25.482514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ceee70-2bbc-4a0c-8c79-c004ecd69cb4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:25.519674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79a452-8deb-469c-a97f-c22ae4daacf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:25.520750 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79a452-8deb-469c-a97f-c22ae4daacf6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.521045 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79a452-8deb-469c-a97f-c22ae4daacf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.521373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79a452-8deb-469c-a97f-c22ae4daacf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.533129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79a452-8deb-469c-a97f-c22ae4daacf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:25.533957 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:25.541713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-9d79a452-8deb-469c-a97f-c22ae4daacf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:25.541713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:25.541713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:25.541713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:25.541713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:25.541713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:25.541713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:25.541713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:25.541713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:25.541713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:25.541713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:25.541713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:25.541713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:25.541713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:25.541713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:25.541713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:25.542590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:25.542590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:25.542590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:25.542590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:25.542590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:25.542590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:25.542590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:25.542590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:25.542590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:25.542590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:25.542590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:25.542590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:25.542590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:25.542590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:25.542590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:25.542590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:25.543379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:25.543379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:25.543379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:25.543379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:25.543379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:25.543379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:25.543379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:25.543379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:25.543379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:25.543379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:25.543379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:25.543379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:25.543379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 154/304] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:25.544026 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79a452-8deb-469c-a97f-c22ae4daacf6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:25.580935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269311b-3d34-4104-a809-4fc7f7044329 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:25.614803 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:25.616279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defe941-b851-426a-a2e1-a20204e69c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:25.617187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defe941-b851-426a-a2e1-a20204e69c32 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.617463 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defe941-b851-426a-a2e1-a20204e69c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.617759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defe941-b851-426a-a2e1-a20204e69c32 None admin] PATH_INFO: `/v3/users/a4286cd4929f4f41bbd3e15c156a9f61` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.633297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defe941-b851-426a-a2e1-a20204e69c32 None admin] RBAC: Authorizing `identity:get_user(user_id=a4286cd4929f4f41bbd3e15c156a9f61)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:25.634802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defe941-b851-426a-a2e1-a20204e69c32 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:25.636642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 151/305] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:25 2022] GET /identity/v3/users/a4286cd4929f4f41bbd3e15c156a9f61 => generated 294 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:25.637408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defe941-b851-426a-a2e1-a20204e69c32 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:25.659327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79a452-8deb-469c-a97f-c22ae4daacf6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:25.694411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7faaa-8741-4cbb-9852-49ee9409d66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:25.695227 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7faaa-8741-4cbb-9852-49ee9409d66d None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.695525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7faaa-8741-4cbb-9852-49ee9409d66d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.695813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7faaa-8741-4cbb-9852-49ee9409d66d None admin] PATH_INFO: `/v3/groups` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.696564 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7faaa-8741-4cbb-9852-49ee9409d66d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:25.698034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7faaa-8741-4cbb-9852-49ee9409d66d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:25.714143 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 155/306] 10.222.0.110 () {60 vars in 1139 bytes} [Thu May 26 16:28:25 2022] POST /identity/v3/groups => generated 230 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:25.715787 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7faaa-8741-4cbb-9852-49ee9409d66d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:25.754690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defe941-b851-426a-a2e1-a20204e69c32 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:25.782319 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:25.796313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f381d-da03-4f4e-9860-7ecdefef1358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:25.797012 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f381d-da03-4f4e-9860-7ecdefef1358 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.797300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f381d-da03-4f4e-9860-7ecdefef1358 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.797588 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f381d-da03-4f4e-9860-7ecdefef1358 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.798345 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f381d-da03-4f4e-9860-7ecdefef1358 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:25.798728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f381d-da03-4f4e-9860-7ecdefef1358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:25.800247 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f381d-da03-4f4e-9860-7ecdefef1358 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:25.814822 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 152/307] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:25 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:25.816464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f381d-da03-4f4e-9860-7ecdefef1358 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:25.862660 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7faaa-8741-4cbb-9852-49ee9409d66d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:25.891853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:25.902941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e6b37-1ea6-48e6-83fa-8689d5abc780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:25.904225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e6b37-1ea6-48e6-83fa-8689d5abc780 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.904225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e6b37-1ea6-48e6-83fa-8689d5abc780 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.904225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e6b37-1ea6-48e6-83fa-8689d5abc780 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.905011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e6b37-1ea6-48e6-83fa-8689d5abc780 None admin] RBAC: Adding query filter params (role.id=2c812f60cda548deb1893180061ff8e5, user.id=a4286cd4929f4f41bbd3e15c156a9f61, scope.system=all) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:25.905330 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e6b37-1ea6-48e6-83fa-8689d5abc780 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:25.906853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e6b37-1ea6-48e6-83fa-8689d5abc780 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:25.913121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 156/308] 10.222.0.110 () {56 vars in 1313 bytes} [Thu May 26 16:28:25 2022] GET /identity/v3/role_assignments?user.id=a4286cd4929f4f41bbd3e15c156a9f61&scope.system=all&role.id=2c812f60cda548deb1893180061ff8e5 => generated 227 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:25.946008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f381d-da03-4f4e-9860-7ecdefef1358 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:25.985871 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2eaa4-f980-488e-b711-f11374f93f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:25.986803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2eaa4-f980-488e-b711-f11374f93f59 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.987089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2eaa4-f980-488e-b711-f11374f93f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.987381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2eaa4-f980-488e-b711-f11374f93f59 None admin] PATH_INFO: `/v3/users/eab53255e00f4a15a42ed163b6e2e1d3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.988620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2eaa4-f980-488e-b711-f11374f93f59 None admin] RBAC: Authorizing `identity:get_user(user_id=eab53255e00f4a15a42ed163b6e2e1d3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:25.990180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2eaa4-f980-488e-b711-f11374f93f59 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:25.992280 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 153/309] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:25 2022] GET /identity/v3/users/eab53255e00f4a15a42ed163b6e2e1d3 => generated 294 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:25.998139 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e6b37-1ea6-48e6-83fa-8689d5abc780 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:26.120352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e6b37-1ea6-48e6-83fa-8689d5abc780 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:26.157336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda968d1-1ae9-4da3-9e95-bdb8a1551cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:26.158661 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda968d1-1ae9-4da3-9e95-bdb8a1551cef None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:26.159140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda968d1-1ae9-4da3-9e95-bdb8a1551cef None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:26.159604 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda968d1-1ae9-4da3-9e95-bdb8a1551cef None admin] PATH_INFO: `/v3/system/users/eab53255e00f4a15a42ed163b6e2e1d3/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:26.161298 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda968d1-1ae9-4da3-9e95-bdb8a1551cef None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=eab53255e00f4a15a42ed163b6e2e1d3, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:26.163566 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda968d1-1ae9-4da3-9e95-bdb8a1551cef None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:26.176611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 157/310] 10.222.0.110 () {58 vars in 1339 bytes} [Thu May 26 16:28:25 2022] PUT /identity/v3/system/users/eab53255e00f4a15a42ed163b6e2e1d3/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:26.233397 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44005aa-1a76-4bdd-9438-46596ad5ecf4 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:26.233699 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44005aa-1a76-4bdd-9438-46596ad5ecf4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:26.233985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44005aa-1a76-4bdd-9438-46596ad5ecf4 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:26.235762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 154/311] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:26.242249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c053a8-4454-43ad-b62a-d9f0e11def90 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:26.242540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c053a8-4454-43ad-b62a-d9f0e11def90 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:26.242862 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c053a8-4454-43ad-b62a-d9f0e11def90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:26.261347 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d8c053a8-4454-43ad-b62a-d9f0e11def90 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:26.262563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d8c053a8-4454-43ad-b62a-d9f0e11def90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:26.327614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:26.347739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 158/312] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:26.371510 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44005aa-1a76-4bdd-9438-46596ad5ecf4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:26.433709 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:26.485178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44005aa-1a76-4bdd-9438-46596ad5ecf4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:26.521996 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8029f-8f95-4516-b297-6437b4a88f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:26.522838 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8029f-8f95-4516-b297-6437b4a88f59 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:26.523129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8029f-8f95-4516-b297-6437b4a88f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:26.523412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8029f-8f95-4516-b297-6437b4a88f59 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:26.534507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8029f-8f95-4516-b297-6437b4a88f59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:26.543000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c1a8029f-8f95-4516-b297-6437b4a88f59 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:26.543000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:26.543000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:26.543000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:26.543000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:26.543000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:26.543000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:26.543000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:26.543000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:26.543000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:26.543000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:26.543000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:26.543000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:26.543000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:26.543000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:26.543000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:26.543844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:26.543844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:26.543844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:26.543844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:26.543844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:26.543844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:26.543844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:26.543844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:26.543844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:26.543844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:26.543844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:26.543844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:26.543844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:26.543844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:26.543844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:26.543844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:26.544626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:26.544626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:26.544626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:26.544626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:26.544626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:26.544626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:26.544626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:26.544626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:26.544626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:26.544626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:26.544626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:26.544626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:26.544626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 155/313] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:26.550197 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c053a8-4454-43ad-b62a-d9f0e11def90 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:26.651360 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c053a8-4454-43ad-b62a-d9f0e11def90 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:26.685285 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909f4fc-8dea-4671-b8d2-e58482695aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:26.685957 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909f4fc-8dea-4671-b8d2-e58482695aed None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:26.686245 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909f4fc-8dea-4671-b8d2-e58482695aed None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:26.686523 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909f4fc-8dea-4671-b8d2-e58482695aed None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:26.687292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909f4fc-8dea-4671-b8d2-e58482695aed None admin] RBAC: Adding query filter params (name=reader) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:26.687601 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909f4fc-8dea-4671-b8d2-e58482695aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:26.688971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909f4fc-8dea-4671-b8d2-e58482695aed None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:26.698103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 159/314] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:26 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:26.703549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8029f-8f95-4516-b297-6437b4a88f59 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:26.806765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8029f-8f95-4516-b297-6437b4a88f59 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:26.820530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:26.843347 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1848bd-d0d6-48d4-8470-959758d72275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:26.844287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1848bd-d0d6-48d4-8470-959758d72275 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:26.844576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1848bd-d0d6-48d4-8470-959758d72275 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:26.844856 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1848bd-d0d6-48d4-8470-959758d72275 None admin] PATH_INFO: `/v3/users/9fd151d66e44462194e55efdce163884` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:26.846129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1848bd-d0d6-48d4-8470-959758d72275 None admin] RBAC: Authorizing `identity:get_user(user_id=9fd151d66e44462194e55efdce163884)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:26.847663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1848bd-d0d6-48d4-8470-959758d72275 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:26.849675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 156/315] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:26 2022] GET /identity/v3/users/9fd151d66e44462194e55efdce163884 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:26.855445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909f4fc-8dea-4671-b8d2-e58482695aed None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:26.914948 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:26.962008 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909f4fc-8dea-4671-b8d2-e58482695aed None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:26.996640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c31726-41e2-4eff-b491-f10e9bfcbb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:26.997632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c31726-41e2-4eff-b491-f10e9bfcbb3e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:26.998110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c31726-41e2-4eff-b491-f10e9bfcbb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:26.998628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c31726-41e2-4eff-b491-f10e9bfcbb3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:27.072624 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c31726-41e2-4eff-b491-f10e9bfcbb3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:27.074426 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c31726-41e2-4eff-b491-f10e9bfcbb3e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:27.127237 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:27.182129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 160/316] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:26 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:27.187650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1848bd-d0d6-48d4-8470-959758d72275 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:27.291042 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1848bd-d0d6-48d4-8470-959758d72275 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:27.325767 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8587925-3fd1-4a20-9ee5-7f85d0ada974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:27.326588 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8587925-3fd1-4a20-9ee5-7f85d0ada974 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:27.326877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8587925-3fd1-4a20-9ee5-7f85d0ada974 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:27.327172 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8587925-3fd1-4a20-9ee5-7f85d0ada974 None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:27.328352 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8587925-3fd1-4a20-9ee5-7f85d0ada974 None admin] RBAC: Authorizing `identity:get_project(project_id=eafb781b5fef4c2ebef0cb43793cf42e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:27.329791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8587925-3fd1-4a20-9ee5-7f85d0ada974 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:27.331507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 157/317] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:27 2022] GET /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e => generated 303 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:27.338050 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c31726-41e2-4eff-b491-f10e9bfcbb3e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:27.445855 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c31726-41e2-4eff-b491-f10e9bfcbb3e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:27.482286 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feebdb2-c253-46fe-800d-bc66208829ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:27.482982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feebdb2-c253-46fe-800d-bc66208829ef None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:27.483269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feebdb2-c253-46fe-800d-bc66208829ef None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:27.483549 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feebdb2-c253-46fe-800d-bc66208829ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:27.484382 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feebdb2-c253-46fe-800d-bc66208829ef None admin] RBAC: Adding query filter params (role.id=2c812f60cda548deb1893180061ff8e5, scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e, user.id=9fd151d66e44462194e55efdce163884) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:27.484696 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feebdb2-c253-46fe-800d-bc66208829ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:27.486139 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feebdb2-c253-46fe-800d-bc66208829ef None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:27.493107 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 161/318] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:28:27 2022] GET /identity/v3/role_assignments?user.id=9fd151d66e44462194e55efdce163884&scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e&role.id=2c812f60cda548deb1893180061ff8e5 => generated 610 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:28.079384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c698334-c818-4719-a696-d08f3663f02f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.079907 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c698334-c818-4719-a696-d08f3663f02f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.080017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c698334-c818-4719-a696-d08f3663f02f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.081471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 158/319] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:28.087596 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49021031-4136-49ec-9c57-248d974ae7fd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.088118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49021031-4136-49ec-9c57-248d974ae7fd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.088118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49021031-4136-49ec-9c57-248d974ae7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.106039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-49021031-4136-49ec-9c57-248d974ae7fd None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:28.107321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-49021031-4136-49ec-9c57-248d974ae7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:28.117803 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:28.180527 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 162/320] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:28.202938 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c698334-c818-4719-a696-d08f3663f02f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:28.255374 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:28.284598 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fc0bc-31ea-4bc6-a980-6ee72239e8d0 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.284944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fc0bc-31ea-4bc6-a980-6ee72239e8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.285171 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fc0bc-31ea-4bc6-a980-6ee72239e8d0 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.286721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 163/321] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:28.292063 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4eb7a-cac8-4d77-a9ea-98144eb179d9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.292356 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4eb7a-cac8-4d77-a9ea-98144eb179d9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.292639 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4eb7a-cac8-4d77-a9ea-98144eb179d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.309453 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a9a4eb7a-cac8-4d77-a9ea-98144eb179d9 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:28.309657 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c698334-c818-4719-a696-d08f3663f02f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:28.310709 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a9a4eb7a-cac8-4d77-a9ea-98144eb179d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:28.354312 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b45197-d352-4d1e-b7b6-41aaef4fcb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:28.355060 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b45197-d352-4d1e-b7b6-41aaef4fcb02 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.355346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b45197-d352-4d1e-b7b6-41aaef4fcb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.355623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b45197-d352-4d1e-b7b6-41aaef4fcb02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.358916 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b45197-d352-4d1e-b7b6-41aaef4fcb02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:28.359140 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b45197-d352-4d1e-b7b6-41aaef4fcb02 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:28.360839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 159/322] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:28 2022] GET /identity/v3/domains/default => generated 200 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:28.366469 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b45197-d352-4d1e-b7b6-41aaef4fcb02 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:28.394271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 164/323] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:28.416409 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4eb7a-cac8-4d77-a9ea-98144eb179d9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:28.473878 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b45197-d352-4d1e-b7b6-41aaef4fcb02 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:28.486729 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:28.491604 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:28.511503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab2087-a00b-4510-91ac-c301611ebf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:28.512178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab2087-a00b-4510-91ac-c301611ebf93 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.512459 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab2087-a00b-4510-91ac-c301611ebf93 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.512738 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab2087-a00b-4510-91ac-c301611ebf93 None admin] PATH_INFO: `/v3/groups` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.513422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab2087-a00b-4510-91ac-c301611ebf93 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:28.514889 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab2087-a00b-4510-91ac-c301611ebf93 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:28.520165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4eb7a-cac8-4d77-a9ea-98144eb179d9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:28.530079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 160/324] 10.222.0.110 () {60 vars in 1139 bytes} [Thu May 26 16:28:28 2022] POST /identity/v3/groups => generated 227 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:28:28.531572 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa52270-0112-4341-bc9e-0a24a83610d3 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.531865 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa52270-0112-4341-bc9e-0a24a83610d3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.532145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa52270-0112-4341-bc9e-0a24a83610d3 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.533410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 161/325] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:28.539280 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836e7f8-4a8f-44d8-a1e9-aa0dbc287bf9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.539567 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836e7f8-4a8f-44d8-a1e9-aa0dbc287bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.539847 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836e7f8-4a8f-44d8-a1e9-aa0dbc287bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.558822 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3836e7f8-4a8f-44d8-a1e9-aa0dbc287bf9 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:28.560039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3836e7f8-4a8f-44d8-a1e9-aa0dbc287bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:28.572567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358178a-f96a-47f2-baa6-9990dbe3bf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:28.573388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358178a-f96a-47f2-baa6-9990dbe3bf41 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.573675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358178a-f96a-47f2-baa6-9990dbe3bf41 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.573955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358178a-f96a-47f2-baa6-9990dbe3bf41 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.585791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358178a-f96a-47f2-baa6-9990dbe3bf41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:28.593835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-2358178a-f96a-47f2-baa6-9990dbe3bf41 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:28.593835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:28.593835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:28.593835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:28.593835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:28.593835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:28.593835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:28.593835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:28.593835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:28.593835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:28.593835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:28.593835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:28.593835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:28.593835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:28.593835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:28.593835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:28.595016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:28.595016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:28.595016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:28.595016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:28.595016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:28.595016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:28.595016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:28.595016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:28.595016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:28.595016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:28.595016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:28.595016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:28.595016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:28.595016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:28.595016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:28.595016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:28.595878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:28.595878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:28.595878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:28.595878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:28.595878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:28.595878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:28.595878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:28.595878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:28.595878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:28.595878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:28.595878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:28.595878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:28.595878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 165/326] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:28.603910 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358178a-f96a-47f2-baa6-9990dbe3bf41 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:28.642675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 162/327] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:28.664860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836e7f8-4a8f-44d8-a1e9-aa0dbc287bf9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:28.727993 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358178a-f96a-47f2-baa6-9990dbe3bf41 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:28.765834 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:28.772737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd008e5-0851-457f-8d90-fbee70c87243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:28.773414 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd008e5-0851-457f-8d90-fbee70c87243 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.773699 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd008e5-0851-457f-8d90-fbee70c87243 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.773972 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd008e5-0851-457f-8d90-fbee70c87243 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.775418 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd008e5-0851-457f-8d90-fbee70c87243 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:28.775418 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd008e5-0851-457f-8d90-fbee70c87243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:28.776426 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd008e5-0851-457f-8d90-fbee70c87243 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:28.786114 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 166/328] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:28 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:28.789006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836e7f8-4a8f-44d8-a1e9-aa0dbc287bf9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:28.792700 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd008e5-0851-457f-8d90-fbee70c87243 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:28.798448 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:28.837462 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cc1ff-ec8c-4ddc-b359-afaf4556db03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:28.838279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cc1ff-ec8c-4ddc-b359-afaf4556db03 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.838563 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cc1ff-ec8c-4ddc-b359-afaf4556db03 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.838863 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cc1ff-ec8c-4ddc-b359-afaf4556db03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.854044 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cc1ff-ec8c-4ddc-b359-afaf4556db03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:28.862198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-0f0cc1ff-ec8c-4ddc-b359-afaf4556db03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:28.862198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:28.862198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:28.862198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:28.862198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:28.862198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:28.862198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:28.862198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:28.862198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:28.862198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:28.862198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:28.862198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:28.862198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:28.862198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:28.862198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:28.862198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:28.863145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:28.863145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:28.863145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:28.863145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:28.863145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:28.863145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:28.863145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:28.863145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:28.863145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:28.863145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:28.863145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:28.863145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:28.863145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:28.863145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:28.863145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:28.863145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:28.864688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:28.864688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:28.864688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:28.864688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:28.864688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:28.864688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:28.864688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:28.864688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:28.864688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:28.864688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:28.864688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:28.864688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:28.864688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 163/329] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:28.869313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cc1ff-ec8c-4ddc-b359-afaf4556db03 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:28.925919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd008e5-0851-457f-8d90-fbee70c87243 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:28.978252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdae7bd-c33f-4906-ab5a-f6919193bda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:28.979434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdae7bd-c33f-4906-ab5a-f6919193bda4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.979721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdae7bd-c33f-4906-ab5a-f6919193bda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.979995 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdae7bd-c33f-4906-ab5a-f6919193bda4 None admin] PATH_INFO: `/v3/users/a4286cd4929f4f41bbd3e15c156a9f61` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.981813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdae7bd-c33f-4906-ab5a-f6919193bda4 None admin] RBAC: Authorizing `identity:get_user(user_id=a4286cd4929f4f41bbd3e15c156a9f61)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:28.983280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdae7bd-c33f-4906-ab5a-f6919193bda4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:28.985441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 167/330] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:28 2022] GET /identity/v3/users/a4286cd4929f4f41bbd3e15c156a9f61 => generated 294 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:28.991836 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdae7bd-c33f-4906-ab5a-f6919193bda4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:28.993556 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cc1ff-ec8c-4ddc-b359-afaf4556db03 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:29.040604 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192187d-b34d-40a1-b20f-8aa35edf6e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:29.041299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192187d-b34d-40a1-b20f-8aa35edf6e43 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:29.041586 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192187d-b34d-40a1-b20f-8aa35edf6e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:29.041864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192187d-b34d-40a1-b20f-8aa35edf6e43 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:29.042642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192187d-b34d-40a1-b20f-8aa35edf6e43 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:29.042960 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192187d-b34d-40a1-b20f-8aa35edf6e43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:29.044358 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192187d-b34d-40a1-b20f-8aa35edf6e43 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:29.055647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 164/331] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:28 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:29.061192 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192187d-b34d-40a1-b20f-8aa35edf6e43 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:29.078837 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:29.100549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:29.129214 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdae7bd-c33f-4906-ab5a-f6919193bda4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:29.168417 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8b33a-a105-4010-9c6e-7cdae3176b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:29.169601 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8b33a-a105-4010-9c6e-7cdae3176b5f None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:29.169984 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8b33a-a105-4010-9c6e-7cdae3176b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:29.170360 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8b33a-a105-4010-9c6e-7cdae3176b5f None admin] PATH_INFO: `/v3/system/users/a4286cd4929f4f41bbd3e15c156a9f61/roles/2c812f60cda548deb1893180061ff8e5` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:29.171992 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e8b33a-a105-4010-9c6e-7cdae3176b5f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a4286cd4929f4f41bbd3e15c156a9f61, role_id=2c812f60cda548deb1893180061ff8e5)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:29.173692 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e8b33a-a105-4010-9c6e-7cdae3176b5f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:29.194678 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 168/332] 10.222.0.110 () {58 vars in 1339 bytes} [Thu May 26 16:28:28 2022] PUT /identity/v3/system/users/a4286cd4929f4f41bbd3e15c156a9f61/roles/2c812f60cda548deb1893180061ff8e5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:29.197195 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192187d-b34d-40a1-b20f-8aa35edf6e43 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:29.239287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c7520-5a74-4b0a-af06-d101057eb8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:29.240269 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c7520-5a74-4b0a-af06-d101057eb8bf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:29.240585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c7520-5a74-4b0a-af06-d101057eb8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:29.240859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c7520-5a74-4b0a-af06-d101057eb8bf None admin] PATH_INFO: `/v3/users/eab53255e00f4a15a42ed163b6e2e1d3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:29.242161 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c7520-5a74-4b0a-af06-d101057eb8bf None admin] RBAC: Authorizing `identity:get_user(user_id=eab53255e00f4a15a42ed163b6e2e1d3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:29.243644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c7520-5a74-4b0a-af06-d101057eb8bf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:29.245617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 165/333] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:29 2022] GET /identity/v3/users/eab53255e00f4a15a42ed163b6e2e1d3 => generated 294 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:29.251564 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8b33a-a105-4010-9c6e-7cdae3176b5f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:29.402852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8b33a-a105-4010-9c6e-7cdae3176b5f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:29.434337 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:29.445173 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17f72c-bd3a-4fb4-bee5-b83fbd3571db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:29.445774 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17f72c-bd3a-4fb4-bee5-b83fbd3571db None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:29.446067 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17f72c-bd3a-4fb4-bee5-b83fbd3571db None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:29.446404 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17f72c-bd3a-4fb4-bee5-b83fbd3571db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:29.447623 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17f72c-bd3a-4fb4-bee5-b83fbd3571db None admin] RBAC: Adding query filter params (role.id=1fdf01beb7394da2a4ea549a7d1bccf1, user.id=eab53255e00f4a15a42ed163b6e2e1d3, scope.system=all) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:29.447623 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17f72c-bd3a-4fb4-bee5-b83fbd3571db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:29.449093 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17f72c-bd3a-4fb4-bee5-b83fbd3571db None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:29.464784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 169/334] 10.222.0.110 () {56 vars in 1313 bytes} [Thu May 26 16:28:29 2022] GET /identity/v3/role_assignments?user.id=eab53255e00f4a15a42ed163b6e2e1d3&scope.system=all&role.id=1fdf01beb7394da2a4ea549a7d1bccf1 => generated 512 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:31.151753 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18732c02-95b7-482c-82b7-072019ab8af7 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:31.152300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18732c02-95b7-482c-82b7-072019ab8af7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:31.152300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18732c02-95b7-482c-82b7-072019ab8af7 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:31.153978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 166/335] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:31.159248 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff0ff1-f6b7-432f-9fe8-f789c80af0c4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:31.159717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff0ff1-f6b7-432f-9fe8-f789c80af0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:31.159798 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff0ff1-f6b7-432f-9fe8-f789c80af0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:31.183607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-77ff0ff1-f6b7-432f-9fe8-f789c80af0c4 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:31.184808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-77ff0ff1-f6b7-432f-9fe8-f789c80af0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:31.261557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 170/336] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:31.288064 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18732c02-95b7-482c-82b7-072019ab8af7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:31.304445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f284e5-e9a2-4c4e-99ef-54dc6b1d5cad None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:31.304787 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f284e5-e9a2-4c4e-99ef-54dc6b1d5cad None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:31.305007 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f284e5-e9a2-4c4e-99ef-54dc6b1d5cad None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:31.306383 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 171/337] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:28:31.313820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38cfa9-c1a4-45da-8e73-1c68995cd24c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:31.314101 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38cfa9-c1a4-45da-8e73-1c68995cd24c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:31.314376 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38cfa9-c1a4-45da-8e73-1c68995cd24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:31.339611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7e38cfa9-c1a4-45da-8e73-1c68995cd24c None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:31.340798 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7e38cfa9-c1a4-45da-8e73-1c68995cd24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:31.479728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:31.482269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 172/338] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:31.492146 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18732c02-95b7-482c-82b7-072019ab8af7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:31.517781 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38cfa9-c1a4-45da-8e73-1c68995cd24c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:31.545651 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5133f2-399d-4d69-83f2-cea791d774ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:31.546470 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5133f2-399d-4d69-83f2-cea791d774ab None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:31.546792 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5133f2-399d-4d69-83f2-cea791d774ab None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:31.547074 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5133f2-399d-4d69-83f2-cea791d774ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:31.567725 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5133f2-399d-4d69-83f2-cea791d774ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:31.575823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ad5133f2-399d-4d69-83f2-cea791d774ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:31.575823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:31.575823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:31.575823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:31.575823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:31.575823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:31.575823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:31.575823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:31.575823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:31.575823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:31.575823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:31.575823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:31.575823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:31.575823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:31.575823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:31.575823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:31.576754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:31.576754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:31.576754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:31.576754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:31.576754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:31.576754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:31.576754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:31.576754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:31.576754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:31.576754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:31.576754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:31.576754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:31.576754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:31.576754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:31.576754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:31.576754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:31.578112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:31.578112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:31.578112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:31.578112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:31.578112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:31.578112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:31.578112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:31.578112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:31.578112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:31.578112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:31.578112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:31.578112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:31.578112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 167/339] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:31.587763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5133f2-399d-4d69-83f2-cea791d774ab None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:31.618201 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:31.764919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38cfa9-c1a4-45da-8e73-1c68995cd24c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:31.784724 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5133f2-399d-4d69-83f2-cea791d774ab None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:31.853886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ec7bd-fef2-48db-9efb-db14bb586576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:31.854758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ec7bd-fef2-48db-9efb-db14bb586576 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:31.855047 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ec7bd-fef2-48db-9efb-db14bb586576 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:31.855324 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ec7bd-fef2-48db-9efb-db14bb586576 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:31.861148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1b233-c3c3-40e6-ba53-08e88637791d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:31.861820 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b233-c3c3-40e6-ba53-08e88637791d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:31.862100 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b233-c3c3-40e6-ba53-08e88637791d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:31.862376 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b233-c3c3-40e6-ba53-08e88637791d None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:31.863161 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1b233-c3c3-40e6-ba53-08e88637791d None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:31.863467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1b233-c3c3-40e6-ba53-08e88637791d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:31.864832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1b233-c3c3-40e6-ba53-08e88637791d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:31.882383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 168/340] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:31 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:31.883422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ec7bd-fef2-48db-9efb-db14bb586576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:31.891760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-143ec7bd-fef2-48db-9efb-db14bb586576 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:31.891760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:31.891760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:31.891760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:31.891760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:31.891760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:31.891760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:31.891760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:31.891760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:31.891760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:31.891760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:31.891760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:31.891760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:31.891760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:31.891760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:31.891760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:31.892656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:31.892656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:31.892656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:31.892656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:31.892656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:31.892656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:31.892656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:31.892656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:31.892656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:31.892656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:31.892656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:31.892656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:31.892656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:31.892656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:31.892656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:31.892656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:31.894380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:31.894380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:31.894380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:31.894380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:31.894380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:31.894380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:31.894380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:31.894380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:31.894380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:31.894380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:31.894380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:31.894380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:31.894380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 173/341] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:28:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:31.899030 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1b233-c3c3-40e6-ba53-08e88637791d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:31.899547 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ec7bd-fef2-48db-9efb-db14bb586576 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:31.944527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:32.064078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ec7bd-fef2-48db-9efb-db14bb586576 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:32.067732 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:32.120403 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096b762-a0f1-486a-9f80-801f091ad50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:32.121086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096b762-a0f1-486a-9f80-801f091ad50a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.121369 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096b762-a0f1-486a-9f80-801f091ad50a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.121647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096b762-a0f1-486a-9f80-801f091ad50a None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.122419 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096b762-a0f1-486a-9f80-801f091ad50a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:32.122902 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096b762-a0f1-486a-9f80-801f091ad50a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:32.124308 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096b762-a0f1-486a-9f80-801f091ad50a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:32.140198 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 174/342] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:28:31 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:32.146492 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1b233-c3c3-40e6-ba53-08e88637791d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:32.147813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096b762-a0f1-486a-9f80-801f091ad50a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:32.188653 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091f24e-7495-4d8d-bb1c-f96daf03a12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:32.189338 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091f24e-7495-4d8d-bb1c-f96daf03a12d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.189600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091f24e-7495-4d8d-bb1c-f96daf03a12d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.190188 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091f24e-7495-4d8d-bb1c-f96daf03a12d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.305351 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096b762-a0f1-486a-9f80-801f091ad50a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:32.332954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091f24e-7495-4d8d-bb1c-f96daf03a12d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:32.334729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091f24e-7495-4d8d-bb1c-f96daf03a12d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:32.363419 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758c6ae-c442-424c-8a07-05d13fa4f253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:32.364073 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758c6ae-c442-424c-8a07-05d13fa4f253 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.364357 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758c6ae-c442-424c-8a07-05d13fa4f253 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.364632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758c6ae-c442-424c-8a07-05d13fa4f253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.376114 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:32.431215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:32.494288 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758c6ae-c442-424c-8a07-05d13fa4f253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:32.495794 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758c6ae-c442-424c-8a07-05d13fa4f253 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:32.515010 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 169/343] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:31 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:32.516389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67651b47-c3de-424b-afee-886a098a8628 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.516673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67651b47-c3de-424b-afee-886a098a8628 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.516950 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67651b47-c3de-424b-afee-886a098a8628 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.518223 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 170/344] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:32.525305 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32035d-fb7b-43bf-8430-230236acb5ce None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.525611 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32035d-fb7b-43bf-8430-230236acb5ce None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.525862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32035d-fb7b-43bf-8430-230236acb5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.555655 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7c32035d-fb7b-43bf-8430-230236acb5ce None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:32.556894 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7c32035d-fb7b-43bf-8430-230236acb5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:32.642267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 175/345] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:32 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:32.643062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758c6ae-c442-424c-8a07-05d13fa4f253 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:32.650621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 171/346] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:32.652767 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32035d-fb7b-43bf-8430-230236acb5ce None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:32.707862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:32.764560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32035d-fb7b-43bf-8430-230236acb5ce None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:32.775203 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:32.805830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8addda-7abb-4df1-acb4-4d0d04df5790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:32.806749 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8addda-7abb-4df1-acb4-4d0d04df5790 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.807041 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8addda-7abb-4df1-acb4-4d0d04df5790 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.807317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8addda-7abb-4df1-acb4-4d0d04df5790 None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.811443 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8addda-7abb-4df1-acb4-4d0d04df5790 None admin] RBAC: Authorizing `identity:get_project(project_id=24bc5f74b0d84b00b6067c0fbd6e896e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:32.814326 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8addda-7abb-4df1-acb4-4d0d04df5790 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:32.816331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 172/347] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:32 2022] GET /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e => generated 299 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:32.816882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8addda-7abb-4df1-acb4-4d0d04df5790 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:32.837986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758c6ae-c442-424c-8a07-05d13fa4f253 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:32.891740 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccef5c5-c160-4061-a50f-9c690b14db74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:32.892955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccef5c5-c160-4061-a50f-9c690b14db74 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.893190 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccef5c5-c160-4061-a50f-9c690b14db74 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.893706 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccef5c5-c160-4061-a50f-9c690b14db74 None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.895043 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccef5c5-c160-4061-a50f-9c690b14db74 None admin] RBAC: Authorizing `identity:get_project(project_id=24bc5f74b0d84b00b6067c0fbd6e896e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:32.897500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccef5c5-c160-4061-a50f-9c690b14db74 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:32.899989 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 176/348] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:32 2022] GET /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e => generated 299 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:32.901200 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7f1f5-7421-41d0-8e63-92c41b378dc3 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.901488 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7f1f5-7421-41d0-8e63-92c41b378dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.901771 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7f1f5-7421-41d0-8e63-92c41b378dc3 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.903838 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 177/349] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:32.904573 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7f1f5-7421-41d0-8e63-92c41b378dc3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:32.967103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8addda-7abb-4df1-acb4-4d0d04df5790 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:32.988676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:33.010812 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac551d-75dd-4d31-8247-3ce71f9f786d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:33.011673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac551d-75dd-4d31-8247-3ce71f9f786d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:33.011955 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac551d-75dd-4d31-8247-3ce71f9f786d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:33.012274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac551d-75dd-4d31-8247-3ce71f9f786d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:33.023894 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac551d-75dd-4d31-8247-3ce71f9f786d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:33.032503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ceac551d-75dd-4d31-8247-3ce71f9f786d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:33.032503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:33.032503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:33.032503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:33.032503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:33.032503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:33.032503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:33.032503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:33.032503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:33.032503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:33.032503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:33.032503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:33.032503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:33.032503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:33.032503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:33.032503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:33.033416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:33.033416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:33.033416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:33.033416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:33.033416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:33.033416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:33.033416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:33.033416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:33.033416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:33.033416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:33.033416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:33.033416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:33.033416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:33.033416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:33.033416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:33.033416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:33.035239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:33.035239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:33.035239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:33.035239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:33.035239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:33.035239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:33.035239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:33.035239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:33.035239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:33.035239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:33.035239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:33.035239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:33.035239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 173/350] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:33.035239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac551d-75dd-4d31-8247-3ce71f9f786d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:33.043294 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7f1f5-7421-41d0-8e63-92c41b378dc3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:33.090818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4fb7a-10cb-4315-99b0-e676a74e0420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:33.091974 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4fb7a-10cb-4315-99b0-e676a74e0420 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:33.092260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4fb7a-10cb-4315-99b0-e676a74e0420 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:33.092540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4fb7a-10cb-4315-99b0-e676a74e0420 None admin] PATH_INFO: `/v3/groups/d1887e62b2404c37b6fe062b53ba4483` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:33.095900 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:33.101854 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4fb7a-10cb-4315-99b0-e676a74e0420 None admin] RBAC: Authorizing `identity:get_group(group_id=d1887e62b2404c37b6fe062b53ba4483)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:33.103486 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4fb7a-10cb-4315-99b0-e676a74e0420 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:33.106558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 178/351] 10.222.0.110 () {56 vars in 1185 bytes} [Thu May 26 16:28:32 2022] GET /identity/v3/groups/d1887e62b2404c37b6fe062b53ba4483 => generated 227 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:33.107854 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f243e0-80d3-4670-84e4-06343475af28 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:33.108150 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f243e0-80d3-4670-84e4-06343475af28 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:33.108500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f243e0-80d3-4670-84e4-06343475af28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:33.130824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-45f243e0-80d3-4670-84e4-06343475af28 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:33.132046 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-45f243e0-80d3-4670-84e4-06343475af28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:33.169256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac551d-75dd-4d31-8247-3ce71f9f786d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:33.215727 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57820e-a2d9-47f9-9929-dbe0c6c40547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:33.216596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57820e-a2d9-47f9-9929-dbe0c6c40547 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:33.216879 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57820e-a2d9-47f9-9929-dbe0c6c40547 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:33.217156 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57820e-a2d9-47f9-9929-dbe0c6c40547 None admin] PATH_INFO: `/v3/groups/d1887e62b2404c37b6fe062b53ba4483` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:33.218328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57820e-a2d9-47f9-9929-dbe0c6c40547 None admin] RBAC: Authorizing `identity:get_group(group_id=d1887e62b2404c37b6fe062b53ba4483)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:33.219808 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57820e-a2d9-47f9-9929-dbe0c6c40547 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:33.227937 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 179/352] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:33.228267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 174/353] 10.222.0.110 () {56 vars in 1185 bytes} [Thu May 26 16:28:33 2022] GET /identity/v3/groups/d1887e62b2404c37b6fe062b53ba4483 => generated 227 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:33.229158 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57820e-a2d9-47f9-9929-dbe0c6c40547 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:33.229407 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f243e0-80d3-4670-84e4-06343475af28 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:33.302820 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:33.371710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f243e0-80d3-4670-84e4-06343475af28 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:33.379113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57820e-a2d9-47f9-9929-dbe0c6c40547 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:33.406313 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:33.422425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cd0f6-0f87-4f89-8819-db13684c0300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:33.423412 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cd0f6-0f87-4f89-8819-db13684c0300 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:33.423838 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cd0f6-0f87-4f89-8819-db13684c0300 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:33.424119 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cd0f6-0f87-4f89-8819-db13684c0300 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:33.424873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cd0f6-0f87-4f89-8819-db13684c0300 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:33.425232 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cd0f6-0f87-4f89-8819-db13684c0300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:33.426557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cd0f6-0f87-4f89-8819-db13684c0300 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:33.427745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfdba2-4714-4e4a-a732-c6af5746a58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:33.428500 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfdba2-4714-4e4a-a732-c6af5746a58b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:33.428853 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfdba2-4714-4e4a-a732-c6af5746a58b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:33.429319 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfdba2-4714-4e4a-a732-c6af5746a58b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:33.430088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfdba2-4714-4e4a-a732-c6af5746a58b None admin] RBAC: Adding query filter params (group.id=d1887e62b2404c37b6fe062b53ba4483, role.id=634cfaacf2e444359b518d8dc7ed122b, scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:33.430463 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfdba2-4714-4e4a-a732-c6af5746a58b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:33.431993 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfdba2-4714-4e4a-a732-c6af5746a58b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:33.437852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 180/354] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:33 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:33.437852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cd0f6-0f87-4f89-8819-db13684c0300 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:33.438080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 175/355] 10.222.0.110 () {56 vars in 1381 bytes} [Thu May 26 16:28:33 2022] GET /identity/v3/role_assignments?group.id=d1887e62b2404c37b6fe062b53ba4483&scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e&role.id=634cfaacf2e444359b518d8dc7ed122b => generated 261 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:33.439121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfdba2-4714-4e4a-a732-c6af5746a58b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:33.567779 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cd0f6-0f87-4f89-8819-db13684c0300 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:33.569518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfdba2-4714-4e4a-a732-c6af5746a58b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:33.583726 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:33.614537 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268cf98-449d-46c2-816f-fd85f6f55de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:33.615685 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268cf98-449d-46c2-816f-fd85f6f55de5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:33.616221 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268cf98-449d-46c2-816f-fd85f6f55de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:33.618316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268cf98-449d-46c2-816f-fd85f6f55de5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:33.619708 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268cf98-449d-46c2-816f-fd85f6f55de5 None admin] RBAC: Adding query filter params (group.id=d1887e62b2404c37b6fe062b53ba4483, role.id=1fdf01beb7394da2a4ea549a7d1bccf1, scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:33.620309 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268cf98-449d-46c2-816f-fd85f6f55de5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:33.620747 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad5be7-5256-4ddf-bed4-2d74fb2586cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:33.621758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad5be7-5256-4ddf-bed4-2d74fb2586cb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:33.622141 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad5be7-5256-4ddf-bed4-2d74fb2586cb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:33.622479 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268cf98-449d-46c2-816f-fd85f6f55de5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:33.622621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad5be7-5256-4ddf-bed4-2d74fb2586cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:33.630399 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 181/356] 10.222.0.110 () {56 vars in 1381 bytes} [Thu May 26 16:28:33 2022] GET /identity/v3/role_assignments?group.id=d1887e62b2404c37b6fe062b53ba4483&scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e&role.id=1fdf01beb7394da2a4ea549a7d1bccf1 => generated 261 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:33.632813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b5ac4-2103-4daf-9aa2-09f6279656d8 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:33.633270 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b5ac4-2103-4daf-9aa2-09f6279656d8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:33.633557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b5ac4-2103-4daf-9aa2-09f6279656d8 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:33.640407 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 182/357] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:33.640407 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b5ac4-2103-4daf-9aa2-09f6279656d8 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:33.645757 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad5be7-5256-4ddf-bed4-2d74fb2586cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:33.658623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-49ad5be7-5256-4ddf-bed4-2d74fb2586cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:33.658623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:33.658623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:33.658623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:33.658623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:33.658623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:33.658623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:33.658623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:33.658623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:33.658623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:33.658623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:33.658623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:33.658623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:33.658623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:33.658623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:33.658623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:33.659617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:33.659617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:33.659617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:33.659617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:33.659617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:33.659617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:33.659617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:33.659617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:33.659617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:33.659617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:33.659617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:33.659617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:33.659617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:33.659617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:33.659617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:33.659617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:33.660381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:33.660381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:33.660381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:33.660381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:33.660381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:33.660381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:33.660381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:33.660381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:33.660381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:33.660381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:33.660381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:33.660381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:33.663961 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 176/358] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:33.666134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b107dba-c27c-4cde-a22c-edb677bd66a1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:33.666705 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b107dba-c27c-4cde-a22c-edb677bd66a1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:33.667177 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b107dba-c27c-4cde-a22c-edb677bd66a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:33.703450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7b107dba-c27c-4cde-a22c-edb677bd66a1 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:33.705193 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7b107dba-c27c-4cde-a22c-edb677bd66a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:33.729897 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:33.813311 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 177/359] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:33.815317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b107dba-c27c-4cde-a22c-edb677bd66a1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:33.821279 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b5ac4-2103-4daf-9aa2-09f6279656d8 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:33.886205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799d070-9303-4ddd-8f53-cafd83e90bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:33.887489 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799d070-9303-4ddd-8f53-cafd83e90bfe None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:33.893294 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799d070-9303-4ddd-8f53-cafd83e90bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:33.893927 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799d070-9303-4ddd-8f53-cafd83e90bfe None admin] PATH_INFO: `/v3/users/a4286cd4929f4f41bbd3e15c156a9f61` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:33.895671 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799d070-9303-4ddd-8f53-cafd83e90bfe None admin] RBAC: Authorizing `identity:get_user(user_id=a4286cd4929f4f41bbd3e15c156a9f61)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:33.900383 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799d070-9303-4ddd-8f53-cafd83e90bfe None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:33.902532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 183/360] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:28:33 2022] GET /identity/v3/users/a4286cd4929f4f41bbd3e15c156a9f61 => generated 294 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:33.904444 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799d070-9303-4ddd-8f53-cafd83e90bfe None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:33.998961 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:34.003960 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b107dba-c27c-4cde-a22c-edb677bd66a1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.039761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799d070-9303-4ddd-8f53-cafd83e90bfe None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.042519 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184f1da-dc4d-4944-8704-c68946ed7959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:34.043768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184f1da-dc4d-4944-8704-c68946ed7959 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.043768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184f1da-dc4d-4944-8704-c68946ed7959 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.043935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184f1da-dc4d-4944-8704-c68946ed7959 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.044588 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184f1da-dc4d-4944-8704-c68946ed7959 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:34.044895 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184f1da-dc4d-4944-8704-c68946ed7959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:34.046262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184f1da-dc4d-4944-8704-c68946ed7959 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:34.057529 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 178/361] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:33 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:34.063695 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184f1da-dc4d-4944-8704-c68946ed7959 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:34.067419 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:34.081344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349fc3f-c8ef-43da-af78-a43704890b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:34.082509 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349fc3f-c8ef-43da-af78-a43704890b3e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.083108 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349fc3f-c8ef-43da-af78-a43704890b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.084138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349fc3f-c8ef-43da-af78-a43704890b3e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.097087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349fc3f-c8ef-43da-af78-a43704890b3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:34.105784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-b349fc3f-c8ef-43da-af78-a43704890b3e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:34.105784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:34.105784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:34.105784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:34.105784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:34.105784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:34.105784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:34.105784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:34.105784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:34.105784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:34.105784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:34.105784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:34.105784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:34.105784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:34.105784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:34.105784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:34.106760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:34.106760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:34.106760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:34.106760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:34.106760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:34.106760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:34.106760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:34.106760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:34.106760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:34.106760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:34.106760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:34.106760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:34.106760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:34.106760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:34.106760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:34.106760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:34.107534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:34.107534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:34.107534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:34.107534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:34.107534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:34.107534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:34.107534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:34.107534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:34.107534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:34.107534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:34.107534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:34.107534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:34.109895 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 184/362] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:28:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:34.111610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e54dbf-1a69-4d4e-9111-a456276435e6 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.112149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e54dbf-1a69-4d4e-9111-a456276435e6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.112624 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e54dbf-1a69-4d4e-9111-a456276435e6 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.114108 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 185/363] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:34.115664 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e54dbf-1a69-4d4e-9111-a456276435e6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:34.179831 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184f1da-dc4d-4944-8704-c68946ed7959 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.218660 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6de848-c9d7-4075-8ed6-f10835ec474c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:34.219417 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6de848-c9d7-4075-8ed6-f10835ec474c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.219608 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6de848-c9d7-4075-8ed6-f10835ec474c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.219935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6de848-c9d7-4075-8ed6-f10835ec474c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.220860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6de848-c9d7-4075-8ed6-f10835ec474c None admin] RBAC: Adding query filter params (role.id=2c812f60cda548deb1893180061ff8e5, user.id=a4286cd4929f4f41bbd3e15c156a9f61, scope.system=all) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:34.221229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6de848-c9d7-4075-8ed6-f10835ec474c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:34.222780 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6de848-c9d7-4075-8ed6-f10835ec474c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:34.233745 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e54dbf-1a69-4d4e-9111-a456276435e6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.238467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 179/364] 10.222.0.110 () {56 vars in 1313 bytes} [Thu May 26 16:28:34 2022] GET /identity/v3/role_assignments?user.id=a4286cd4929f4f41bbd3e15c156a9f61&scope.system=all&role.id=2c812f60cda548deb1893180061ff8e5 => generated 512 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:34.243357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d251568-38f9-4fef-a4de-e69f18e54be8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.243647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d251568-38f9-4fef-a4de-e69f18e54be8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.243923 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d251568-38f9-4fef-a4de-e69f18e54be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.278174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bf780-65de-47e6-a763-af465f44c628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:34.279220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bf780-65de-47e6-a763-af465f44c628 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.279723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bf780-65de-47e6-a763-af465f44c628 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.279824 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4d251568-38f9-4fef-a4de-e69f18e54be8 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:34.280310 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bf780-65de-47e6-a763-af465f44c628 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.281049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4d251568-38f9-4fef-a4de-e69f18e54be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:34.318995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:34.340354 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:34.363094 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bf780-65de-47e6-a763-af465f44c628 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:34.364731 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bf780-65de-47e6-a763-af465f44c628 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:34.388326 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 180/365] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:34.389631 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d251568-38f9-4fef-a4de-e69f18e54be8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:34.487165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 186/366] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:34 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:34.488121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bf780-65de-47e6-a763-af465f44c628 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:34.577460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d251568-38f9-4fef-a4de-e69f18e54be8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.584366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:34.609473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bf780-65de-47e6-a763-af465f44c628 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.624987 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbbc96-19e0-45ae-bfcb-1a3cd3a0c98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:34.626209 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbbc96-19e0-45ae-bfcb-1a3cd3a0c98a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.626496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbbc96-19e0-45ae-bfcb-1a3cd3a0c98a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.626818 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbbc96-19e0-45ae-bfcb-1a3cd3a0c98a None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.627847 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbbc96-19e0-45ae-bfcb-1a3cd3a0c98a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:34.628661 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbbc96-19e0-45ae-bfcb-1a3cd3a0c98a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:34.630330 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbbc96-19e0-45ae-bfcb-1a3cd3a0c98a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:34.641827 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 181/367] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:28:34 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:34.643029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbbc96-19e0-45ae-bfcb-1a3cd3a0c98a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:34.653289 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668c1f9-aecc-4b24-9e94-3f01f3a30c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:34.654256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668c1f9-aecc-4b24-9e94-3f01f3a30c89 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.654547 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668c1f9-aecc-4b24-9e94-3f01f3a30c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.655148 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668c1f9-aecc-4b24-9e94-3f01f3a30c89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.658075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:34.671273 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668c1f9-aecc-4b24-9e94-3f01f3a30c89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:34.681702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-4668c1f9-aecc-4b24-9e94-3f01f3a30c89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:34.681702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:34.681702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:34.681702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:34.681702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:34.681702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:34.681702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:34.681702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:34.681702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:34.681702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:34.681702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:34.681702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:34.681702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:34.681702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:34.681702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:34.681702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:34.682654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:34.682654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:34.682654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:34.682654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:34.682654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:34.682654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:34.682654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:34.682654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:34.682654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:34.682654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:34.682654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:34.682654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:34.682654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:34.682654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:34.682654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:34.682654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:34.683425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:34.683425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:34.683425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:34.683425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:34.683425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:34.683425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:34.683425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:34.683425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:34.683425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:34.683425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:34.683425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:34.683425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:34.683425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 187/368] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:28:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:34.684740 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668c1f9-aecc-4b24-9e94-3f01f3a30c89 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:34.780971 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbbc96-19e0-45ae-bfcb-1a3cd3a0c98a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.817794 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668c1f9-aecc-4b24-9e94-3f01f3a30c89 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.818478 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd6dee-c5f2-4db1-84ba-efc52dbc791a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:34.819420 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd6dee-c5f2-4db1-84ba-efc52dbc791a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.819706 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd6dee-c5f2-4db1-84ba-efc52dbc791a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.819980 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd6dee-c5f2-4db1-84ba-efc52dbc791a None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.821174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd6dee-c5f2-4db1-84ba-efc52dbc791a None admin] RBAC: Authorizing `identity:get_project(project_id=eafb781b5fef4c2ebef0cb43793cf42e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:34.823138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd6dee-c5f2-4db1-84ba-efc52dbc791a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:34.825200 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 182/369] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:34 2022] GET /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e => generated 303 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:34.826105 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd6dee-c5f2-4db1-84ba-efc52dbc791a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:34.861570 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0da06b-2341-41c7-a297-1298d7f85dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:34.862398 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0da06b-2341-41c7-a297-1298d7f85dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.862720 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0da06b-2341-41c7-a297-1298d7f85dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.863409 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0da06b-2341-41c7-a297-1298d7f85dd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.879698 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:34.921727 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:34.950504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd6dee-c5f2-4db1-84ba-efc52dbc791a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.957619 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0da06b-2341-41c7-a297-1298d7f85dd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:34.959694 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0da06b-2341-41c7-a297-1298d7f85dd5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:35.005193 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6ad47-2b32-4a9b-aade-7a95fc5db72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:35.010599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6ad47-2b32-4a9b-aade-7a95fc5db72a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:35.010599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6ad47-2b32-4a9b-aade-7a95fc5db72a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:35.010599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6ad47-2b32-4a9b-aade-7a95fc5db72a None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:35.010599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6ad47-2b32-4a9b-aade-7a95fc5db72a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:35.010599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6ad47-2b32-4a9b-aade-7a95fc5db72a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:35.010599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6ad47-2b32-4a9b-aade-7a95fc5db72a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:35.021031 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 183/370] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:34 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:35.021803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6ad47-2b32-4a9b-aade-7a95fc5db72a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:35.100262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 188/371] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:34 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:35.101218 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0da06b-2341-41c7-a297-1298d7f85dd5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:35.149652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:35.156084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6ad47-2b32-4a9b-aade-7a95fc5db72a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:35.202724 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ccdb4-1aae-47a7-a9b8-db8d2affeb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:35.203598 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ccdb4-1aae-47a7-a9b8-db8d2affeb41 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:35.203881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ccdb4-1aae-47a7-a9b8-db8d2affeb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:35.204156 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ccdb4-1aae-47a7-a9b8-db8d2affeb41 None admin] PATH_INFO: `/v3/groups/d1887e62b2404c37b6fe062b53ba4483` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:35.205339 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ccdb4-1aae-47a7-a9b8-db8d2affeb41 None admin] RBAC: Authorizing `identity:get_group(group_id=d1887e62b2404c37b6fe062b53ba4483)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:35.206789 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ccdb4-1aae-47a7-a9b8-db8d2affeb41 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:35.209089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 184/372] 10.222.0.110 () {56 vars in 1185 bytes} [Thu May 26 16:28:35 2022] GET /identity/v3/groups/d1887e62b2404c37b6fe062b53ba4483 => generated 227 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:35.209940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ccdb4-1aae-47a7-a9b8-db8d2affeb41 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:35.221414 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:35.230264 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0da06b-2341-41c7-a297-1298d7f85dd5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:35.279599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cd95b-9d97-4fff-9f6d-eb1203112c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:35.280414 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cd95b-9d97-4fff-9f6d-eb1203112c2f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:35.280704 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cd95b-9d97-4fff-9f6d-eb1203112c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:35.280987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cd95b-9d97-4fff-9f6d-eb1203112c2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:35.333181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ccdb4-1aae-47a7-a9b8-db8d2affeb41 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:35.375569 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cd95b-9d97-4fff-9f6d-eb1203112c2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:35.375569 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cd95b-9d97-4fff-9f6d-eb1203112c2f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:35.377940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64831c83-fcfb-467b-bcce-bdbe757f4630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:35.378970 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64831c83-fcfb-467b-bcce-bdbe757f4630 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:35.379256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64831c83-fcfb-467b-bcce-bdbe757f4630 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:35.379533 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64831c83-fcfb-467b-bcce-bdbe757f4630 None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:35.380850 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64831c83-fcfb-467b-bcce-bdbe757f4630 None admin] RBAC: Authorizing `identity:get_project(project_id=eafb781b5fef4c2ebef0cb43793cf42e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:35.382277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64831c83-fcfb-467b-bcce-bdbe757f4630 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:35.384930 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 185/373] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:35 2022] GET /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e => generated 303 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:35.385800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64831c83-fcfb-467b-bcce-bdbe757f4630 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:35.431053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:35.480415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:35.503443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 189/374] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:35 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:35.504473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cd95b-9d97-4fff-9f6d-eb1203112c2f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:35.519898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64831c83-fcfb-467b-bcce-bdbe757f4630 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:35.571427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e65f0-60a4-44fc-a4dc-5edf4ff7f1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:35.572640 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e65f0-60a4-44fc-a4dc-5edf4ff7f1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:35.572916 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e65f0-60a4-44fc-a4dc-5edf4ff7f1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:35.573195 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e65f0-60a4-44fc-a4dc-5edf4ff7f1a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:35.574327 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e65f0-60a4-44fc-a4dc-5edf4ff7f1a3 None admin] RBAC: Adding query filter params (group.id=d1887e62b2404c37b6fe062b53ba4483, role.id=1fdf01beb7394da2a4ea549a7d1bccf1, scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:35.574666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e65f0-60a4-44fc-a4dc-5edf4ff7f1a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:35.577173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e65f0-60a4-44fc-a4dc-5edf4ff7f1a3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:35.585784 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 186/375] 10.222.0.110 () {56 vars in 1381 bytes} [Thu May 26 16:28:35 2022] GET /identity/v3/role_assignments?group.id=d1887e62b2404c37b6fe062b53ba4483&scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e&role.id=1fdf01beb7394da2a4ea549a7d1bccf1 => generated 261 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:35.586921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e65f0-60a4-44fc-a4dc-5edf4ff7f1a3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:35.628578 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cd95b-9d97-4fff-9f6d-eb1203112c2f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:35.668985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955139b-8b5a-464f-afc8-dbe85457ba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:35.670295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955139b-8b5a-464f-afc8-dbe85457ba72 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:35.670763 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955139b-8b5a-464f-afc8-dbe85457ba72 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:35.671259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955139b-8b5a-464f-afc8-dbe85457ba72 None admin] PATH_INFO: `/v3/groups/d1887e62b2404c37b6fe062b53ba4483` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:35.672691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955139b-8b5a-464f-afc8-dbe85457ba72 None admin] RBAC: Authorizing `identity:get_group(group_id=d1887e62b2404c37b6fe062b53ba4483)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:35.674876 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955139b-8b5a-464f-afc8-dbe85457ba72 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:35.677132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 190/376] 10.222.0.110 () {56 vars in 1185 bytes} [Thu May 26 16:28:35 2022] GET /identity/v3/groups/d1887e62b2404c37b6fe062b53ba4483 => generated 227 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:35.685261 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955139b-8b5a-464f-afc8-dbe85457ba72 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:35.727005 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:35.776653 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e65f0-60a4-44fc-a4dc-5edf4ff7f1a3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:35.842429 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588f2c2-d516-4981-9dd1-a0de1f60337b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:35.843271 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588f2c2-d516-4981-9dd1-a0de1f60337b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:35.843558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588f2c2-d516-4981-9dd1-a0de1f60337b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:35.843849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588f2c2-d516-4981-9dd1-a0de1f60337b None admin] PATH_INFO: `/v3/projects/d89de88c67114e9b9382e93ffe6a1176` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:35.845065 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588f2c2-d516-4981-9dd1-a0de1f60337b None admin] RBAC: Authorizing `identity:get_project(project_id=d89de88c67114e9b9382e93ffe6a1176)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:35.846507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588f2c2-d516-4981-9dd1-a0de1f60337b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:35.848246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 187/377] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:35 2022] GET /identity/v3/projects/d89de88c67114e9b9382e93ffe6a1176 => generated 345 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:35.853041 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955139b-8b5a-464f-afc8-dbe85457ba72 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:35.854102 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588f2c2-d516-4981-9dd1-a0de1f60337b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:35.869900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:35.904929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200af348-9b72-4abb-9202-f5d91e4410a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:35.906908 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200af348-9b72-4abb-9202-f5d91e4410a8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:35.908123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200af348-9b72-4abb-9202-f5d91e4410a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:35.908726 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200af348-9b72-4abb-9202-f5d91e4410a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:35.910346 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200af348-9b72-4abb-9202-f5d91e4410a8 None admin] RBAC: Adding query filter params (group.id=d1887e62b2404c37b6fe062b53ba4483, role.id=634cfaacf2e444359b518d8dc7ed122b, scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:35.911542 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200af348-9b72-4abb-9202-f5d91e4410a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:35.915049 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200af348-9b72-4abb-9202-f5d91e4410a8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:35.922883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 191/378] 10.222.0.110 () {56 vars in 1381 bytes} [Thu May 26 16:28:35 2022] GET /identity/v3/role_assignments?group.id=d1887e62b2404c37b6fe062b53ba4483&scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e&role.id=634cfaacf2e444359b518d8dc7ed122b => generated 261 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:36.008599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588f2c2-d516-4981-9dd1-a0de1f60337b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:36.050759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469659d-a9e7-495c-a64f-796c90e65154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:36.052689 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469659d-a9e7-495c-a64f-796c90e65154 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:36.053194 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469659d-a9e7-495c-a64f-796c90e65154 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:36.053636 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469659d-a9e7-495c-a64f-796c90e65154 None admin] PATH_INFO: `/v3/groups/298cfb867ddc4bdbb1eaf89804cb479f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:36.071443 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469659d-a9e7-495c-a64f-796c90e65154 None admin] RBAC: Authorizing `identity:get_group(group_id=298cfb867ddc4bdbb1eaf89804cb479f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:36.073204 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469659d-a9e7-495c-a64f-796c90e65154 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:36.075857 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 188/379] 10.222.0.110 () {56 vars in 1185 bytes} [Thu May 26 16:28:35 2022] GET /identity/v3/groups/298cfb867ddc4bdbb1eaf89804cb479f => generated 230 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:36.081433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200af348-9b72-4abb-9202-f5d91e4410a8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:36.198665 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:36.229820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200af348-9b72-4abb-9202-f5d91e4410a8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:36.276421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70be6c-b10e-41ce-b250-1c40d04fd9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:36.277327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70be6c-b10e-41ce-b250-1c40d04fd9bb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:36.277763 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70be6c-b10e-41ce-b250-1c40d04fd9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:36.278206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70be6c-b10e-41ce-b250-1c40d04fd9bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:36.279250 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70be6c-b10e-41ce-b250-1c40d04fd9bb None admin] RBAC: Adding query filter params (group.id=298cfb867ddc4bdbb1eaf89804cb479f, role.id=1393d128d39b4649b6cd71b6609846cb, scope.project.id=d89de88c67114e9b9382e93ffe6a1176) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:36.279712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70be6c-b10e-41ce-b250-1c40d04fd9bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:36.281306 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70be6c-b10e-41ce-b250-1c40d04fd9bb None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:36.288015 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 192/380] 10.222.0.110 () {56 vars in 1381 bytes} [Thu May 26 16:28:36 2022] GET /identity/v3/role_assignments?group.id=298cfb867ddc4bdbb1eaf89804cb479f&scope.project.id=d89de88c67114e9b9382e93ffe6a1176&role.id=1393d128d39b4649b6cd71b6609846cb => generated 261 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:36.386713 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e12ae8-b1d8-4c1a-a163-68e076686640 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:36.387260 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e12ae8-b1d8-4c1a-a163-68e076686640 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:36.387260 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e12ae8-b1d8-4c1a-a163-68e076686640 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:36.388924 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 189/381] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:36.394791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e660335-6b05-4eab-84f5-5627873b5b61 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:36.395321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e660335-6b05-4eab-84f5-5627873b5b61 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:36.395747 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e660335-6b05-4eab-84f5-5627873b5b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:36.413862 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6e660335-6b05-4eab-84f5-5627873b5b61 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:36.415387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6e660335-6b05-4eab-84f5-5627873b5b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:36.436428 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f6739-380e-4429-a6a8-608eb9f80ec3 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:36.436722 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f6739-380e-4429-a6a8-608eb9f80ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:36.437009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f6739-380e-4429-a6a8-608eb9f80ec3 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:36.438768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 190/382] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:36.447031 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42d0cf-2125-46fd-9971-d5eba905f4fd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:36.447322 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42d0cf-2125-46fd-9971-d5eba905f4fd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:36.447599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42d0cf-2125-46fd-9971-d5eba905f4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:36.491728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cd42d0cf-2125-46fd-9971-d5eba905f4fd None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:36.492979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cd42d0cf-2125-46fd-9971-d5eba905f4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:36.512351 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 193/383] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:36.556445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e660335-6b05-4eab-84f5-5627873b5b61 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:36.608004 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 191/384] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:36.637483 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42d0cf-2125-46fd-9971-d5eba905f4fd None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:36.642210 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:36.655524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:36.716755 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e660335-6b05-4eab-84f5-5627873b5b61 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:36.760026 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7ddbb-5eb9-420d-be24-cb15bd181064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:36.760834 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7ddbb-5eb9-420d-be24-cb15bd181064 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:36.761122 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7ddbb-5eb9-420d-be24-cb15bd181064 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:36.761403 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7ddbb-5eb9-420d-be24-cb15bd181064 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:36.773248 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7ddbb-5eb9-420d-be24-cb15bd181064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:36.786588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-4cf7ddbb-5eb9-420d-be24-cb15bd181064 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:36.786588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:36.786588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:36.786588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:36.786588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:36.786588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:36.786588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:36.786588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:36.786588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:36.786588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:36.786588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:36.786588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:36.786588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:36.786588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:36.786588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:36.786588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:36.787507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:36.787507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:36.787507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:36.787507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:36.787507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:36.787507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:36.787507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:36.787507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:36.787507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:36.787507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:36.787507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:36.787507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:36.787507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:36.787507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:36.787507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:36.787507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:36.788282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:36.788282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:36.788282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:36.788282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:36.788282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:36.788282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:36.788282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:36.788282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:36.788282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:36.788282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:36.788282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:36.788282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:36.788282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 194/385] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:36.788942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7ddbb-5eb9-420d-be24-cb15bd181064 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:36.827151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42d0cf-2125-46fd-9971-d5eba905f4fd None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:36.897796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14b7e2-062d-4961-9959-d3b08cea022d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:36.898661 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14b7e2-062d-4961-9959-d3b08cea022d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:36.898956 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14b7e2-062d-4961-9959-d3b08cea022d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:36.899238 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14b7e2-062d-4961-9959-d3b08cea022d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:36.920838 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14b7e2-062d-4961-9959-d3b08cea022d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:36.929348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-1b14b7e2-062d-4961-9959-d3b08cea022d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:36.929348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:36.929348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:36.929348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:36.929348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:36.929348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:36.929348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:36.929348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:36.929348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:36.929348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:36.929348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:36.929348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:36.929348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:36.929348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:36.929348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:36.929348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:36.930221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:36.930221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:36.930221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:36.930221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:36.930221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:36.930221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:36.930221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:36.930221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:36.930221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:36.930221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:36.930221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:36.930221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:36.930221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:36.930221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:36.930221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:36.930221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:36.931057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:36.931057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:36.931057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:36.931057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:36.931057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:36.931057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:36.931057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:36.931057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:36.931057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:36.931057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:36.931057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:36.931057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:36.938991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 192/386] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:28:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:36.942587 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14b7e2-062d-4961-9959-d3b08cea022d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:36.963292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7ddbb-5eb9-420d-be24-cb15bd181064 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:37.018941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:37.031479 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5a525-673d-4d19-a838-97e0463d5871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:37.032156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5a525-673d-4d19-a838-97e0463d5871 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:37.032445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5a525-673d-4d19-a838-97e0463d5871 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:37.032723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5a525-673d-4d19-a838-97e0463d5871 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:37.033477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5a525-673d-4d19-a838-97e0463d5871 None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:37.033785 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5a525-673d-4d19-a838-97e0463d5871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:37.035885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5a525-673d-4d19-a838-97e0463d5871 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:37.057027 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 195/387] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:36 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:37.063039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5a525-673d-4d19-a838-97e0463d5871 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:37.065950 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:37.136263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14b7e2-062d-4961-9959-d3b08cea022d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:37.196617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d854f-a71f-4d7e-a396-eeb683fd4266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:37.197298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d854f-a71f-4d7e-a396-eeb683fd4266 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:37.197580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d854f-a71f-4d7e-a396-eeb683fd4266 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:37.197854 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d854f-a71f-4d7e-a396-eeb683fd4266 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:37.198616 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d854f-a71f-4d7e-a396-eeb683fd4266 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:37.198927 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d854f-a71f-4d7e-a396-eeb683fd4266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:37.202090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d854f-a71f-4d7e-a396-eeb683fd4266 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:37.215682 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 193/388] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:28:36 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:37.222680 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d854f-a71f-4d7e-a396-eeb683fd4266 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:37.244783 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5a525-673d-4d19-a838-97e0463d5871 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:37.310334 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311aed8b-1c39-474f-b113-7d4a25462914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:37.311269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aed8b-1c39-474f-b113-7d4a25462914 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:37.311560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aed8b-1c39-474f-b113-7d4a25462914 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:37.311834 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aed8b-1c39-474f-b113-7d4a25462914 None admin] PATH_INFO: `/v3/groups/d1887e62b2404c37b6fe062b53ba4483` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:37.314075 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311aed8b-1c39-474f-b113-7d4a25462914 None admin] RBAC: Authorizing `identity:get_group(group_id=d1887e62b2404c37b6fe062b53ba4483)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:37.316412 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311aed8b-1c39-474f-b113-7d4a25462914 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:37.318691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 196/389] 10.222.0.110 () {56 vars in 1185 bytes} [Thu May 26 16:28:37 2022] GET /identity/v3/groups/d1887e62b2404c37b6fe062b53ba4483 => generated 227 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:37.325126 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311aed8b-1c39-474f-b113-7d4a25462914 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:37.399946 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d854f-a71f-4d7e-a396-eeb683fd4266 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:37.444785 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:37.445156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:37.467508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a2010-e48f-4d48-a044-9c72a5dac3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:37.468383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a2010-e48f-4d48-a044-9c72a5dac3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:37.468670 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a2010-e48f-4d48-a044-9c72a5dac3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:37.468946 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a2010-e48f-4d48-a044-9c72a5dac3b8 None admin] PATH_INFO: `/v3/groups/d1887e62b2404c37b6fe062b53ba4483` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:37.471349 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a2010-e48f-4d48-a044-9c72a5dac3b8 None admin] RBAC: Authorizing `identity:get_group(group_id=d1887e62b2404c37b6fe062b53ba4483)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:37.472812 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a2010-e48f-4d48-a044-9c72a5dac3b8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:37.478682 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 194/390] 10.222.0.110 () {56 vars in 1185 bytes} [Thu May 26 16:28:37 2022] GET /identity/v3/groups/d1887e62b2404c37b6fe062b53ba4483 => generated 227 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:37.480962 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a2010-e48f-4d48-a044-9c72a5dac3b8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:37.532737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311aed8b-1c39-474f-b113-7d4a25462914 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:37.594672 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a2010-e48f-4d48-a044-9c72a5dac3b8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:37.632084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf54382-0efe-4b3b-8a7e-0c45008578e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:37.632963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf54382-0efe-4b3b-8a7e-0c45008578e5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:37.633254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf54382-0efe-4b3b-8a7e-0c45008578e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:37.633536 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf54382-0efe-4b3b-8a7e-0c45008578e5 None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:37.634779 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf54382-0efe-4b3b-8a7e-0c45008578e5 None admin] RBAC: Authorizing `identity:get_project(project_id=24bc5f74b0d84b00b6067c0fbd6e896e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:37.636373 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf54382-0efe-4b3b-8a7e-0c45008578e5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:37.638495 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 195/391] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:37 2022] GET /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e => generated 299 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:37.646716 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2d345-a394-4c92-940b-273f69b594f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:37.647598 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2d345-a394-4c92-940b-273f69b594f5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:37.647888 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2d345-a394-4c92-940b-273f69b594f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:37.648167 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2d345-a394-4c92-940b-273f69b594f5 None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:37.649370 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2d345-a394-4c92-940b-273f69b594f5 None admin] RBAC: Authorizing `identity:get_project(project_id=24bc5f74b0d84b00b6067c0fbd6e896e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:37.651067 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2d345-a394-4c92-940b-273f69b594f5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:37.652786 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 197/392] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:37 2022] GET /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e => generated 299 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:37.654084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf54382-0efe-4b3b-8a7e-0c45008578e5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:37.680531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2d345-a394-4c92-940b-273f69b594f5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:37.733119 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:37.776860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf54382-0efe-4b3b-8a7e-0c45008578e5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:37.854046 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0692569-0cb4-4fd4-805d-b771ff85f262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:37.854991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0692569-0cb4-4fd4-805d-b771ff85f262 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:37.855278 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0692569-0cb4-4fd4-805d-b771ff85f262 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:37.855557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0692569-0cb4-4fd4-805d-b771ff85f262 None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e/groups/d1887e62b2404c37b6fe062b53ba4483/roles/634cfaacf2e444359b518d8dc7ed122b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:37.861016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0692569-0cb4-4fd4-805d-b771ff85f262 None admin] RBAC: Authorizing `identity:create_grant(project_id=24bc5f74b0d84b00b6067c0fbd6e896e, group_id=d1887e62b2404c37b6fe062b53ba4483, role_id=634cfaacf2e444359b518d8dc7ed122b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:37.862506 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0692569-0cb4-4fd4-805d-b771ff85f262 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:37.889786 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 196/393] 10.222.0.110 () {58 vars in 1447 bytes} [Thu May 26 16:28:37 2022] PUT /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e/groups/d1887e62b2404c37b6fe062b53ba4483/roles/634cfaacf2e444359b518d8dc7ed122b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:37.894949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2d345-a394-4c92-940b-273f69b594f5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:37.925214 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:37.935015 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fbafb-13f2-456f-80e0-c6b6a9722fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:37.935929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fbafb-13f2-456f-80e0-c6b6a9722fce None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:37.936219 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fbafb-13f2-456f-80e0-c6b6a9722fce None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:37.936504 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fbafb-13f2-456f-80e0-c6b6a9722fce None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e/groups/d1887e62b2404c37b6fe062b53ba4483/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:37.938650 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fbafb-13f2-456f-80e0-c6b6a9722fce None admin] RBAC: Authorizing `identity:create_grant(project_id=24bc5f74b0d84b00b6067c0fbd6e896e, group_id=d1887e62b2404c37b6fe062b53ba4483, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:37.940122 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fbafb-13f2-456f-80e0-c6b6a9722fce None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:37.961624 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 198/394] 10.222.0.110 () {58 vars in 1447 bytes} [Thu May 26 16:28:37 2022] PUT /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e/groups/d1887e62b2404c37b6fe062b53ba4483/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:38.581519 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8e679-4545-4090-bbc8-84cce0428b2c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:38.582026 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8e679-4545-4090-bbc8-84cce0428b2c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:38.582100 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8e679-4545-4090-bbc8-84cce0428b2c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:38.584755 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 197/395] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:38.592504 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271364a-d3ce-4965-a7d0-223b051b5821 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:38.592504 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271364a-d3ce-4965-a7d0-223b051b5821 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:38.592504 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271364a-d3ce-4965-a7d0-223b051b5821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:38.611743 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2271364a-d3ce-4965-a7d0-223b051b5821 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:38.613262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2271364a-d3ce-4965-a7d0-223b051b5821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:38.663512 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048f318-187f-4267-8b12-0c8fc556b270 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:38.663804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048f318-187f-4267-8b12-0c8fc556b270 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:38.663996 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048f318-187f-4267-8b12-0c8fc556b270 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:38.665506 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 198/396] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:38.671159 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137c7ea-91c8-466d-9eef-75d362d2b90a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:38.671752 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137c7ea-91c8-466d-9eef-75d362d2b90a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:38.672223 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137c7ea-91c8-466d-9eef-75d362d2b90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:38.694593 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 199/397] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:38.699188 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3137c7ea-91c8-466d-9eef-75d362d2b90a None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:38.700628 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3137c7ea-91c8-466d-9eef-75d362d2b90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:38.718604 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271364a-d3ce-4965-a7d0-223b051b5821 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:38.821898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 199/398] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:38.843343 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271364a-d3ce-4965-a7d0-223b051b5821 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:38.847652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137c7ea-91c8-466d-9eef-75d362d2b90a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:38.882195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:38.906647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8838f12-98af-4ebc-97ae-35b3e5ffc8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:38.907460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8838f12-98af-4ebc-97ae-35b3e5ffc8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:38.907749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8838f12-98af-4ebc-97ae-35b3e5ffc8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:38.908029 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8838f12-98af-4ebc-97ae-35b3e5ffc8f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:38.914415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:38.923698 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8838f12-98af-4ebc-97ae-35b3e5ffc8f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:38.933320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-a8838f12-98af-4ebc-97ae-35b3e5ffc8f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:38.933320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:38.933320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:38.933320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:38.933320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:38.933320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:38.933320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:38.933320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:38.933320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:38.933320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:38.933320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:38.933320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:38.933320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:38.933320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:38.933320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:38.933320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:38.934252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:38.934252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:38.934252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:38.934252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:38.934252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:38.934252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:38.934252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:38.934252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:38.934252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:38.934252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:38.934252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:38.934252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:38.934252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:38.934252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:38.934252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:38.934252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:38.935052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:38.935052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:38.935052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:38.935052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:38.935052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:38.935052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:38.935052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:38.935052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:38.935052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:38.935052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:38.935052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:38.935052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:38.935052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 200/399] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:38.945910 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8838f12-98af-4ebc-97ae-35b3e5ffc8f2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:38.996050 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137c7ea-91c8-466d-9eef-75d362d2b90a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:39.056733 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa82293-cbe9-482f-98e2-2cfc74021628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:39.057860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa82293-cbe9-482f-98e2-2cfc74021628 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:39.058347 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa82293-cbe9-482f-98e2-2cfc74021628 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:39.058849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa82293-cbe9-482f-98e2-2cfc74021628 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.060792 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8838f12-98af-4ebc-97ae-35b3e5ffc8f2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:39.078868 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa82293-cbe9-482f-98e2-2cfc74021628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:39.096121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-daa82293-cbe9-482f-98e2-2cfc74021628 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:39.096121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:39.096121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:39.096121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:39.096121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:39.096121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:39.096121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:39.096121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:39.096121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:39.096121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:39.096121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:39.096121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:39.096121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:39.096121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:39.096121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:39.096121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:39.097167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:39.097167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:39.097167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:39.097167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:39.097167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:39.097167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:39.097167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:39.097167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:39.097167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:39.097167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:39.097167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:39.097167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:39.097167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:39.097167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:39.097167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:39.097167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:39.097958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:39.097958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:39.097958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:39.097958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:39.097958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:39.097958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:39.097958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:39.097958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:39.097958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:39.097958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:39.097958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:39.097958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:39.098630 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab453116-1c3e-4c62-ad84-6e821dcf0c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:39.098630 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab453116-1c3e-4c62-ad84-6e821dcf0c46 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:39.098630 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab453116-1c3e-4c62-ad84-6e821dcf0c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:39.098630 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab453116-1c3e-4c62-ad84-6e821dcf0c46 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.098941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab453116-1c3e-4c62-ad84-6e821dcf0c46 None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:39.099705 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab453116-1c3e-4c62-ad84-6e821dcf0c46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:39.101184 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab453116-1c3e-4c62-ad84-6e821dcf0c46 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:39.101529 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 200/400] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:28:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:39.106663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa82293-cbe9-482f-98e2-2cfc74021628 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:39.118597 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 201/401] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:38 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:39.126130 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab453116-1c3e-4c62-ad84-6e821dcf0c46 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:39.191157 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:39.249864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab453116-1c3e-4c62-ad84-6e821dcf0c46 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:39.270399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa82293-cbe9-482f-98e2-2cfc74021628 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:39.290253 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:39.292536 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2aca38-cdcc-433e-a60d-ab05986d1419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:39.293609 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2aca38-cdcc-433e-a60d-ab05986d1419 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:39.294033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2aca38-cdcc-433e-a60d-ab05986d1419 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:39.294477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2aca38-cdcc-433e-a60d-ab05986d1419 None admin] PATH_INFO: `/v3/groups/d1887e62b2404c37b6fe062b53ba4483` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.296092 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2aca38-cdcc-433e-a60d-ab05986d1419 None admin] RBAC: Authorizing `identity:get_group(group_id=d1887e62b2404c37b6fe062b53ba4483)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:39.297721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2aca38-cdcc-433e-a60d-ab05986d1419 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:39.300729 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 202/402] 10.222.0.110 () {56 vars in 1185 bytes} [Thu May 26 16:28:39 2022] GET /identity/v3/groups/d1887e62b2404c37b6fe062b53ba4483 => generated 227 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:39.307074 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2aca38-cdcc-433e-a60d-ab05986d1419 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:39.343142 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b322f8-e3a6-4024-b2c2-1a0e6d69d222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:39.344091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b322f8-e3a6-4024-b2c2-1a0e6d69d222 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:39.344529 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b322f8-e3a6-4024-b2c2-1a0e6d69d222 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:39.345105 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b322f8-e3a6-4024-b2c2-1a0e6d69d222 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.346005 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b322f8-e3a6-4024-b2c2-1a0e6d69d222 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:39.346462 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b322f8-e3a6-4024-b2c2-1a0e6d69d222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:39.348171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b322f8-e3a6-4024-b2c2-1a0e6d69d222 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:39.370087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 201/403] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:28:39 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:39.376034 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b322f8-e3a6-4024-b2c2-1a0e6d69d222 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:39.460416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2aca38-cdcc-433e-a60d-ab05986d1419 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:39.468806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:39.527303 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b623f7e-47cf-4472-963d-ae0b2cecf7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:39.528190 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b623f7e-47cf-4472-963d-ae0b2cecf7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:39.528476 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b623f7e-47cf-4472-963d-ae0b2cecf7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:39.528751 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b623f7e-47cf-4472-963d-ae0b2cecf7a1 None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.531367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b623f7e-47cf-4472-963d-ae0b2cecf7a1 None admin] RBAC: Authorizing `identity:get_project(project_id=eafb781b5fef4c2ebef0cb43793cf42e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:39.532821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b623f7e-47cf-4472-963d-ae0b2cecf7a1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:39.534873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 203/404] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:39 2022] GET /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e => generated 303 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:39.544362 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f226ed1-95f0-41d4-bf73-33a3c6bcbc11 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:39.545142 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f226ed1-95f0-41d4-bf73-33a3c6bcbc11 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:39.545438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f226ed1-95f0-41d4-bf73-33a3c6bcbc11 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.548496 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 204/405] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:39.549738 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f226ed1-95f0-41d4-bf73-33a3c6bcbc11 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:39.570257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b322f8-e3a6-4024-b2c2-1a0e6d69d222 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:39.623052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90428313-30aa-4574-aa69-c06d9b3cc07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:39.624836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90428313-30aa-4574-aa69-c06d9b3cc07f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:39.625521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90428313-30aa-4574-aa69-c06d9b3cc07f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:39.626080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90428313-30aa-4574-aa69-c06d9b3cc07f None admin] PATH_INFO: `/v3/groups/d1887e62b2404c37b6fe062b53ba4483` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.627746 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90428313-30aa-4574-aa69-c06d9b3cc07f None admin] RBAC: Authorizing `identity:get_group(group_id=d1887e62b2404c37b6fe062b53ba4483)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:39.629339 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90428313-30aa-4574-aa69-c06d9b3cc07f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:39.632272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 202/406] 10.222.0.110 () {56 vars in 1185 bytes} [Thu May 26 16:28:39 2022] GET /identity/v3/groups/d1887e62b2404c37b6fe062b53ba4483 => generated 227 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:39.634118 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455370eb-cc47-4431-b8f2-b4a5bc48ab55 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:39.634848 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455370eb-cc47-4431-b8f2-b4a5bc48ab55 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:39.635302 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455370eb-cc47-4431-b8f2-b4a5bc48ab55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.656474 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-455370eb-cc47-4431-b8f2-b4a5bc48ab55 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:39.658510 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-455370eb-cc47-4431-b8f2-b4a5bc48ab55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:39.683919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f226ed1-95f0-41d4-bf73-33a3c6bcbc11 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:39.701932 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:39.731672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409af68f-bdd1-4682-8823-ba8e661d1048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:39.732565 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409af68f-bdd1-4682-8823-ba8e661d1048 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:39.732854 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409af68f-bdd1-4682-8823-ba8e661d1048 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:39.733191 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409af68f-bdd1-4682-8823-ba8e661d1048 None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e/groups/d1887e62b2404c37b6fe062b53ba4483/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.736010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409af68f-bdd1-4682-8823-ba8e661d1048 None admin] RBAC: Authorizing `identity:create_grant(project_id=eafb781b5fef4c2ebef0cb43793cf42e, group_id=d1887e62b2404c37b6fe062b53ba4483, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:39.737666 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409af68f-bdd1-4682-8823-ba8e661d1048 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:39.744054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 203/407] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:39.745383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455370eb-cc47-4431-b8f2-b4a5bc48ab55 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:39.756732 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 205/408] 10.222.0.110 () {58 vars in 1447 bytes} [Thu May 26 16:28:39 2022] PUT /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e/groups/d1887e62b2404c37b6fe062b53ba4483/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:39.779770 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409af68f-bdd1-4682-8823-ba8e661d1048 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:39.827552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:39.911462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409af68f-bdd1-4682-8823-ba8e661d1048 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:39.955952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535d51e-2750-4f0c-98c7-839a87eeb5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:39.957297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535d51e-2750-4f0c-98c7-839a87eeb5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:39.957929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535d51e-2750-4f0c-98c7-839a87eeb5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:39.958952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535d51e-2750-4f0c-98c7-839a87eeb5b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.973603 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535d51e-2750-4f0c-98c7-839a87eeb5b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:39.977852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455370eb-cc47-4431-b8f2-b4a5bc48ab55 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:39.984928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-4535d51e-2750-4f0c-98c7-839a87eeb5b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:39.984928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:39.984928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:39.984928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:39.984928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:39.984928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:39.984928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:39.984928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:39.984928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:39.984928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:39.984928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:39.984928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:39.984928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:39.984928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:39.984928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:39.984928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:39.985806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:39.985806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:39.985806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:39.985806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:39.985806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:39.985806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:39.985806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:39.985806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:39.985806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:39.985806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:39.985806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:39.985806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:39.985806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:39.985806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:39.985806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:39.985806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:39.986608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:39.986608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:39.986608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:39.986608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:39.986608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:39.986608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:39.986608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:39.986608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:39.986608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:39.986608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:39.986608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:39.986608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:39.990032 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 206/409] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:28:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:39.995948 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535d51e-2750-4f0c-98c7-839a87eeb5b5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:40.027040 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304f0d4-3a2f-4409-bf86-3f4790465142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:40.028113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304f0d4-3a2f-4409-bf86-3f4790465142 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:40.028676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304f0d4-3a2f-4409-bf86-3f4790465142 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:40.029012 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304f0d4-3a2f-4409-bf86-3f4790465142 None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:40.030419 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304f0d4-3a2f-4409-bf86-3f4790465142 None admin] RBAC: Authorizing `identity:get_project(project_id=eafb781b5fef4c2ebef0cb43793cf42e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:40.031998 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304f0d4-3a2f-4409-bf86-3f4790465142 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:40.034365 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 204/410] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:39 2022] GET /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e => generated 303 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:40.040034 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304f0d4-3a2f-4409-bf86-3f4790465142 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:40.099980 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:40.143698 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:40.158307 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535d51e-2750-4f0c-98c7-839a87eeb5b5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:40.223431 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304f0d4-3a2f-4409-bf86-3f4790465142 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:40.228552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8717b-5392-45b9-a6a9-5a79b49cb8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:40.230315 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8717b-5392-45b9-a6a9-5a79b49cb8ff None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:40.232191 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8717b-5392-45b9-a6a9-5a79b49cb8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:40.232631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8717b-5392-45b9-a6a9-5a79b49cb8ff None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:40.237867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8717b-5392-45b9-a6a9-5a79b49cb8ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:40.238353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8717b-5392-45b9-a6a9-5a79b49cb8ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:40.240055 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8717b-5392-45b9-a6a9-5a79b49cb8ff None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:40.255796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 207/411] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:39 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:40.261775 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8717b-5392-45b9-a6a9-5a79b49cb8ff None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:40.302991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522de511-042e-4207-9da5-ca430921a784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:40.304818 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522de511-042e-4207-9da5-ca430921a784 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:40.305864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522de511-042e-4207-9da5-ca430921a784 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:40.306487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522de511-042e-4207-9da5-ca430921a784 None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e/groups/d1887e62b2404c37b6fe062b53ba4483/roles/634cfaacf2e444359b518d8dc7ed122b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:40.311629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522de511-042e-4207-9da5-ca430921a784 None admin] RBAC: Authorizing `identity:create_grant(project_id=eafb781b5fef4c2ebef0cb43793cf42e, group_id=d1887e62b2404c37b6fe062b53ba4483, role_id=634cfaacf2e444359b518d8dc7ed122b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:40.315700 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522de511-042e-4207-9da5-ca430921a784 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:40.336737 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 205/412] 10.222.0.110 () {58 vars in 1447 bytes} [Thu May 26 16:28:40 2022] PUT /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e/groups/d1887e62b2404c37b6fe062b53ba4483/roles/634cfaacf2e444359b518d8dc7ed122b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:40.409326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8717b-5392-45b9-a6a9-5a79b49cb8ff None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:40.449374 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f03ab3-6373-44a2-be76-b296b02e2b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:40.450353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f03ab3-6373-44a2-be76-b296b02e2b28 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:40.450669 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f03ab3-6373-44a2-be76-b296b02e2b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:40.450958 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f03ab3-6373-44a2-be76-b296b02e2b28 None admin] PATH_INFO: `/v3/groups/298cfb867ddc4bdbb1eaf89804cb479f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:40.452184 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f03ab3-6373-44a2-be76-b296b02e2b28 None admin] RBAC: Authorizing `identity:get_group(group_id=298cfb867ddc4bdbb1eaf89804cb479f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:40.453644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f03ab3-6373-44a2-be76-b296b02e2b28 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:40.455656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 208/413] 10.222.0.110 () {56 vars in 1185 bytes} [Thu May 26 16:28:40 2022] GET /identity/v3/groups/298cfb867ddc4bdbb1eaf89804cb479f => generated 230 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:40.463347 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522de511-042e-4207-9da5-ca430921a784 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:40.601844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:40.606008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522de511-042e-4207-9da5-ca430921a784 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:40.642764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6d0c2-f483-472d-8ce0-78f278f0f5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:40.643699 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6d0c2-f483-472d-8ce0-78f278f0f5cd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:40.643993 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6d0c2-f483-472d-8ce0-78f278f0f5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:40.644274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6d0c2-f483-472d-8ce0-78f278f0f5cd None admin] PATH_INFO: `/v3/projects/d89de88c67114e9b9382e93ffe6a1176` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:40.646028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6d0c2-f483-472d-8ce0-78f278f0f5cd None admin] RBAC: Authorizing `identity:get_project(project_id=d89de88c67114e9b9382e93ffe6a1176)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:40.647582 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6d0c2-f483-472d-8ce0-78f278f0f5cd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:40.649599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 206/414] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:40 2022] GET /identity/v3/projects/d89de88c67114e9b9382e93ffe6a1176 => generated 345 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:40.655700 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f03ab3-6373-44a2-be76-b296b02e2b28 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:40.686971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:40.715175 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff5b58-aed6-4527-a605-067afd738088 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:40.715462 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff5b58-aed6-4527-a605-067afd738088 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:40.716076 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff5b58-aed6-4527-a605-067afd738088 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:40.717871 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 207/415] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:40.725091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6b98-62c6-4d86-9267-8062cca2ed31 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:40.725384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6b98-62c6-4d86-9267-8062cca2ed31 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:40.725663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6b98-62c6-4d86-9267-8062cca2ed31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:40.744980 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e3af6b98-62c6-4d86-9267-8062cca2ed31 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:40.746533 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e3af6b98-62c6-4d86-9267-8062cca2ed31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:40.836817 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f03ab3-6373-44a2-be76-b296b02e2b28 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:40.875486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 208/416] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:40.894429 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af6b98-62c6-4d86-9267-8062cca2ed31 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:40.947878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072d236-6a01-40e4-8476-d1ff2507a0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:40.948773 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072d236-6a01-40e4-8476-d1ff2507a0c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:40.949220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072d236-6a01-40e4-8476-d1ff2507a0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:40.949669 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072d236-6a01-40e4-8476-d1ff2507a0c1 None admin] PATH_INFO: `/v3/projects/d89de88c67114e9b9382e93ffe6a1176/groups/298cfb867ddc4bdbb1eaf89804cb479f/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:40.951835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072d236-6a01-40e4-8476-d1ff2507a0c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d89de88c67114e9b9382e93ffe6a1176, group_id=298cfb867ddc4bdbb1eaf89804cb479f, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:40.953442 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072d236-6a01-40e4-8476-d1ff2507a0c1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:40.975754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 209/417] 10.222.0.110 () {58 vars in 1447 bytes} [Thu May 26 16:28:40 2022] PUT /identity/v3/projects/d89de88c67114e9b9382e93ffe6a1176/groups/298cfb867ddc4bdbb1eaf89804cb479f/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:28:41.042309 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:41.049971 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af6b98-62c6-4d86-9267-8062cca2ed31 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:41.105600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3c3ed-2192-4a45-a672-bc9c815db1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:41.106459 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3c3ed-2192-4a45-a672-bc9c815db1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:41.106777 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3c3ed-2192-4a45-a672-bc9c815db1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:41.107062 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3c3ed-2192-4a45-a672-bc9c815db1e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:41.121493 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3c3ed-2192-4a45-a672-bc9c815db1e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:41.131151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4ae3c3ed-2192-4a45-a672-bc9c815db1e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:41.131151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:41.131151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:41.131151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:41.131151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:41.131151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:41.131151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:41.131151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:41.131151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:41.131151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:41.131151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:41.131151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:41.131151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:41.131151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:41.131151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:41.131151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:41.132101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:41.132101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:41.132101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:41.132101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:41.132101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:41.132101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:41.132101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:41.132101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:41.132101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:41.132101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:41.132101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:41.132101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:41.132101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:41.132101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:41.132101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:41.132101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:41.132897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:41.132897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:41.132897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:41.132897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:41.132897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:41.132897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:41.132897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:41.132897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:41.132897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:41.132897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:41.132897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:41.132897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:41.140368 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 209/418] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:28:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:41.142481 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072d236-6a01-40e4-8476-d1ff2507a0c1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:41.150966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7fb52-f596-418a-93c0-7c94a9a66542 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:41.151752 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7fb52-f596-418a-93c0-7c94a9a66542 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:41.152236 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7fb52-f596-418a-93c0-7c94a9a66542 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:41.154249 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 210/419] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:28:41.164930 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f21db-0bee-4e55-a85f-8740241c6c93 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:41.165558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f21db-0bee-4e55-a85f-8740241c6c93 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:41.166085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f21db-0bee-4e55-a85f-8740241c6c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:41.189417 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4c8f21db-0bee-4e55-a85f-8740241c6c93 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:41.190644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4c8f21db-0bee-4e55-a85f-8740241c6c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:41.264738 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:41.283844 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072d236-6a01-40e4-8476-d1ff2507a0c1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:41.289634 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 211/420] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:41.320781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f21db-0bee-4e55-a85f-8740241c6c93 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:41.323000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b8875-37af-471b-970f-963fc8fe4eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:41.323916 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b8875-37af-471b-970f-963fc8fe4eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:41.324425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b8875-37af-471b-970f-963fc8fe4eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:41.324932 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b8875-37af-471b-970f-963fc8fe4eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:41.325940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b8875-37af-471b-970f-963fc8fe4eb9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:41.326463 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b8875-37af-471b-970f-963fc8fe4eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:41.328255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b8875-37af-471b-970f-963fc8fe4eb9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:41.342691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 210/421] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:28:41 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:41.345138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b8875-37af-471b-970f-963fc8fe4eb9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:41.455512 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b8875-37af-471b-970f-963fc8fe4eb9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:41.491353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dea4d-c76c-4ff1-9d24-349bbac7a93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:41.492189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dea4d-c76c-4ff1-9d24-349bbac7a93b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:41.492579 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dea4d-c76c-4ff1-9d24-349bbac7a93b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:41.492965 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dea4d-c76c-4ff1-9d24-349bbac7a93b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:41.495927 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:41.510947 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:41.541478 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f21db-0bee-4e55-a85f-8740241c6c93 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:41.568242 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952dea4d-c76c-4ff1-9d24-349bbac7a93b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:41.569901 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952dea4d-c76c-4ff1-9d24-349bbac7a93b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:41.627874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639abb3-db28-49e8-8eb5-7d7e1f7eb730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:41.628696 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639abb3-db28-49e8-8eb5-7d7e1f7eb730 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:41.628988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639abb3-db28-49e8-8eb5-7d7e1f7eb730 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:41.629270 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639abb3-db28-49e8-8eb5-7d7e1f7eb730 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:41.651948 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639abb3-db28-49e8-8eb5-7d7e1f7eb730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:41.668201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5639abb3-db28-49e8-8eb5-7d7e1f7eb730 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:41.668201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:41.668201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:41.668201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:41.668201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:41.668201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:41.668201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:41.668201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:41.668201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:41.668201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:41.668201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:41.668201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:41.668201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:41.668201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:41.668201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:41.668201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:41.669125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:41.669125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:41.669125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:41.669125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:41.669125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:41.669125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:41.669125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:41.669125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:41.669125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:41.669125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:41.669125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:41.669125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:41.669125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:41.669125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:41.669125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:41.669125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:41.669913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:41.669913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:41.669913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:41.669913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:41.669913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:41.669913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:41.669913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:41.669913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:41.669913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:41.669913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:41.669913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:41.669913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:41.669913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 212/422] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:41.680113 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 211/423] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:41 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:41.684738 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639abb3-db28-49e8-8eb5-7d7e1f7eb730 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:41.684936 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dea4d-c76c-4ff1-9d24-349bbac7a93b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:41.762986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:41.866813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dea4d-c76c-4ff1-9d24-349bbac7a93b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:41.886444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639abb3-db28-49e8-8eb5-7d7e1f7eb730 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:41.903323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911d9fa-8c0d-4220-b004-e2905aa7c5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:41.904370 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911d9fa-8c0d-4220-b004-e2905aa7c5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:41.904878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911d9fa-8c0d-4220-b004-e2905aa7c5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:41.905621 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911d9fa-8c0d-4220-b004-e2905aa7c5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:41.906829 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911d9fa-8c0d-4220-b004-e2905aa7c5e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:41.907380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911d9fa-8c0d-4220-b004-e2905aa7c5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:41.909002 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911d9fa-8c0d-4220-b004-e2905aa7c5e0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:41.923814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 212/424] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:41 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:41.925469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911d9fa-8c0d-4220-b004-e2905aa7c5e0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:41.975356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cca89-6bd9-4b9e-98ae-32660e118495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:41.976255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cca89-6bd9-4b9e-98ae-32660e118495 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:41.976538 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cca89-6bd9-4b9e-98ae-32660e118495 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:41.976813 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cca89-6bd9-4b9e-98ae-32660e118495 None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:41.978111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cca89-6bd9-4b9e-98ae-32660e118495 None admin] RBAC: Authorizing `identity:get_project(project_id=24bc5f74b0d84b00b6067c0fbd6e896e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:41.979648 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cca89-6bd9-4b9e-98ae-32660e118495 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:41.985683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 213/425] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:41 2022] GET /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e => generated 299 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:41.997705 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cca89-6bd9-4b9e-98ae-32660e118495 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:42.039038 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:42.050859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911d9fa-8c0d-4220-b004-e2905aa7c5e0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:42.068302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:42.123194 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cca89-6bd9-4b9e-98ae-32660e118495 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:42.123414 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e78674-324b-4ff3-ba64-e088f2b8b9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:42.123960 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e78674-324b-4ff3-ba64-e088f2b8b9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:42.124263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e78674-324b-4ff3-ba64-e088f2b8b9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:42.124549 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e78674-324b-4ff3-ba64-e088f2b8b9f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:42.159589 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c802b-59ed-47e5-8e33-3824e93524ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:42.160473 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c802b-59ed-47e5-8e33-3824e93524ad None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:42.160860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c802b-59ed-47e5-8e33-3824e93524ad None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:42.161199 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c802b-59ed-47e5-8e33-3824e93524ad None admin] PATH_INFO: `/v3/groups/d1887e62b2404c37b6fe062b53ba4483` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:42.162393 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c802b-59ed-47e5-8e33-3824e93524ad None admin] RBAC: Authorizing `identity:get_group(group_id=d1887e62b2404c37b6fe062b53ba4483)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:42.164116 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c802b-59ed-47e5-8e33-3824e93524ad None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:42.166126 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 214/426] 10.222.0.110 () {56 vars in 1185 bytes} [Thu May 26 16:28:41 2022] GET /identity/v3/groups/d1887e62b2404c37b6fe062b53ba4483 => generated 227 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:42.172161 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c802b-59ed-47e5-8e33-3824e93524ad None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:42.266945 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:42.279572 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c802b-59ed-47e5-8e33-3824e93524ad None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:42.300942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e78674-324b-4ff3-ba64-e088f2b8b9f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:42.303018 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e78674-324b-4ff3-ba64-e088f2b8b9f1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:42.337582 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f78d3-930d-4943-8e92-0d97698ea2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:42.338312 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f78d3-930d-4943-8e92-0d97698ea2cd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:42.338629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f78d3-930d-4943-8e92-0d97698ea2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:42.338915 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f78d3-930d-4943-8e92-0d97698ea2cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:42.339908 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f78d3-930d-4943-8e92-0d97698ea2cd None admin] RBAC: Adding query filter params (group.id=d1887e62b2404c37b6fe062b53ba4483, role.id=634cfaacf2e444359b518d8dc7ed122b, scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:42.340234 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f78d3-930d-4943-8e92-0d97698ea2cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:42.341740 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f78d3-930d-4943-8e92-0d97698ea2cd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:42.349462 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 215/427] 10.222.0.110 () {56 vars in 1381 bytes} [Thu May 26 16:28:42 2022] GET /identity/v3/role_assignments?group.id=d1887e62b2404c37b6fe062b53ba4483&scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e&role.id=634cfaacf2e444359b518d8dc7ed122b => generated 613 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:42.501794 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 213/428] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:41 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:42.503310 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f78d3-930d-4943-8e92-0d97698ea2cd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:42.543059 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bf96a-48c4-42d8-9d7c-ef8b6761e355 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:42.543773 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bf96a-48c4-42d8-9d7c-ef8b6761e355 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:42.544255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bf96a-48c4-42d8-9d7c-ef8b6761e355 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:42.546123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 214/429] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:28:42.552284 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783c7c0-8e99-478c-8b3a-188a65645f2e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:42.552978 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783c7c0-8e99-478c-8b3a-188a65645f2e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:42.553462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783c7c0-8e99-478c-8b3a-188a65645f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:42.571809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8783c7c0-8e99-478c-8b3a-188a65645f2e None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:42.573355 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8783c7c0-8e99-478c-8b3a-188a65645f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:42.584331 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:42.648872 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 215/430] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:42.663986 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f78d3-930d-4943-8e92-0d97698ea2cd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:42.676586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783c7c0-8e99-478c-8b3a-188a65645f2e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:42.700245 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033150a1-17cd-4286-9b67-85b1362c535f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:42.701318 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033150a1-17cd-4286-9b67-85b1362c535f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:42.702417 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033150a1-17cd-4286-9b67-85b1362c535f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:42.702855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033150a1-17cd-4286-9b67-85b1362c535f None admin] PATH_INFO: `/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:42.704087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033150a1-17cd-4286-9b67-85b1362c535f None admin] RBAC: Authorizing `identity:get_project(project_id=24bc5f74b0d84b00b6067c0fbd6e896e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:42.705583 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033150a1-17cd-4286-9b67-85b1362c535f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:42.707642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 216/431] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:42 2022] GET /identity/v3/projects/24bc5f74b0d84b00b6067c0fbd6e896e => generated 299 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:42.717304 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033150a1-17cd-4286-9b67-85b1362c535f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:42.743752 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:42.823359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783c7c0-8e99-478c-8b3a-188a65645f2e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:42.860685 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033150a1-17cd-4286-9b67-85b1362c535f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:42.865563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24d21f-f17a-4c5f-b469-1f123691daf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:42.866688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24d21f-f17a-4c5f-b469-1f123691daf5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:42.867239 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24d21f-f17a-4c5f-b469-1f123691daf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:42.867713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24d21f-f17a-4c5f-b469-1f123691daf5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:42.876305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:42.884072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24d21f-f17a-4c5f-b469-1f123691daf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:42.892538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-1e24d21f-f17a-4c5f-b469-1f123691daf5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:42.892538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:42.892538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:42.892538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:42.892538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:42.892538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:42.892538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:42.892538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:42.892538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:42.892538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:42.892538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:42.892538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:42.892538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:42.892538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:42.892538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:42.892538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:42.893438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:42.893438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:42.893438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:42.893438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:42.893438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:42.893438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:42.893438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:42.893438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:42.893438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:42.893438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:42.893438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:42.893438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:42.893438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:42.893438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:42.893438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:42.893438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:42.894266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:42.894266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:42.894266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:42.894266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:42.894266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:42.894266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:42.894266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:42.894266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:42.894266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:42.894266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:42.894266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:42.894266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:42.902713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 216/432] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:42.905838 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9c83d-d2b8-4770-8a63-923c7ac6da78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:42.905987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24d21f-f17a-4c5f-b469-1f123691daf5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:42.907245 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9c83d-d2b8-4770-8a63-923c7ac6da78 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:42.907760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9c83d-d2b8-4770-8a63-923c7ac6da78 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:42.908313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9c83d-d2b8-4770-8a63-923c7ac6da78 None admin] PATH_INFO: `/v3/groups/d1887e62b2404c37b6fe062b53ba4483` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:42.909746 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9c83d-d2b8-4770-8a63-923c7ac6da78 None admin] RBAC: Authorizing `identity:get_group(group_id=d1887e62b2404c37b6fe062b53ba4483)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:42.911487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9c83d-d2b8-4770-8a63-923c7ac6da78 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:42.913644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 217/433] 10.222.0.110 () {56 vars in 1185 bytes} [Thu May 26 16:28:42 2022] GET /identity/v3/groups/d1887e62b2404c37b6fe062b53ba4483 => generated 227 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:42.919575 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9c83d-d2b8-4770-8a63-923c7ac6da78 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.016360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:43.039437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24d21f-f17a-4c5f-b469-1f123691daf5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:43.040886 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9c83d-d2b8-4770-8a63-923c7ac6da78 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:43.079029 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4854b42-df58-4532-b45e-e7634f584c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:43.079950 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4854b42-df58-4532-b45e-e7634f584c87 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.080398 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4854b42-df58-4532-b45e-e7634f584c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.080825 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4854b42-df58-4532-b45e-e7634f584c87 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.081728 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4854b42-df58-4532-b45e-e7634f584c87 None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:43.082191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034b9c8-3a7e-4c26-a90e-86361a4318bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:43.082372 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4854b42-df58-4532-b45e-e7634f584c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:43.083575 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034b9c8-3a7e-4c26-a90e-86361a4318bf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.083927 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034b9c8-3a7e-4c26-a90e-86361a4318bf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.084270 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034b9c8-3a7e-4c26-a90e-86361a4318bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.085169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034b9c8-3a7e-4c26-a90e-86361a4318bf None admin] RBAC: Adding query filter params (group.id=d1887e62b2404c37b6fe062b53ba4483, role.id=1fdf01beb7394da2a4ea549a7d1bccf1, scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:43.085398 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4854b42-df58-4532-b45e-e7634f584c87 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:43.085604 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034b9c8-3a7e-4c26-a90e-86361a4318bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:43.087327 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034b9c8-3a7e-4c26-a90e-86361a4318bf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:43.098637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 218/434] 10.222.0.110 () {56 vars in 1381 bytes} [Thu May 26 16:28:42 2022] GET /identity/v3/role_assignments?group.id=d1887e62b2404c37b6fe062b53ba4483&scope.project.id=24bc5f74b0d84b00b6067c0fbd6e896e&role.id=1fdf01beb7394da2a4ea549a7d1bccf1 => generated 613 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:43.100874 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 217/435] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:28:42 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:43.107792 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034b9c8-3a7e-4c26-a90e-86361a4318bf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.164582 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400d550-04ed-4068-874d-9fba5190e4d2 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.164872 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400d550-04ed-4068-874d-9fba5190e4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.165151 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400d550-04ed-4068-874d-9fba5190e4d2 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.166824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 218/436] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:28:43.172368 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c27afb-2f63-4df4-a8ec-a6f15c1f988a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.172753 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c27afb-2f63-4df4-a8ec-a6f15c1f988a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.172958 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c27afb-2f63-4df4-a8ec-a6f15c1f988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.191380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c7c27afb-2f63-4df4-a8ec-a6f15c1f988a None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:43.194089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c7c27afb-2f63-4df4-a8ec-a6f15c1f988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:43.229727 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034b9c8-3a7e-4c26-a90e-86361a4318bf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:43.271081 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2af87f-60e8-490f-9418-055e9630e585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:43.271768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2af87f-60e8-490f-9418-055e9630e585 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.272057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2af87f-60e8-490f-9418-055e9630e585 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.272337 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2af87f-60e8-490f-9418-055e9630e585 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.273477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:43.290718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 219/437] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:43.299006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:43.315750 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c27afb-2f63-4df4-a8ec-a6f15c1f988a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.367816 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2af87f-60e8-490f-9418-055e9630e585 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:43.369217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2af87f-60e8-490f-9418-055e9630e585 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:43.455343 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c27afb-2f63-4df4-a8ec-a6f15c1f988a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:43.508012 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d484520-d978-4ab1-8219-dd709341a16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:43.508930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d484520-d978-4ab1-8219-dd709341a16d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.509299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d484520-d978-4ab1-8219-dd709341a16d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.509574 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d484520-d978-4ab1-8219-dd709341a16d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.518623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 219/438] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:43 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:43.525269 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2af87f-60e8-490f-9418-055e9630e585 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.529502 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d484520-d978-4ab1-8219-dd709341a16d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:43.537987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-3d484520-d978-4ab1-8219-dd709341a16d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:43.537987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:43.537987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:43.537987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:43.537987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:43.537987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:43.537987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:43.537987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:43.537987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:43.537987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:43.537987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:43.537987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:43.537987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:43.537987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:43.537987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:43.537987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:43.538912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:43.538912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:43.538912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:43.538912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:43.538912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:43.538912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:43.538912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:43.538912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:43.538912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:43.538912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:43.538912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:43.538912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:43.538912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:43.538912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:43.538912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:43.538912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:43.539693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:43.539693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:43.539693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:43.539693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:43.539693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:43.539693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:43.539693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:43.539693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:43.539693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:43.539693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:43.539693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:43.539693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:43.539693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 220/439] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:28:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:43.546017 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d484520-d978-4ab1-8219-dd709341a16d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.587246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:43.621969 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:43.652849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2af87f-60e8-490f-9418-055e9630e585 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:43.678929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d484520-d978-4ab1-8219-dd709341a16d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:43.695546 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6c21d-112f-4e3b-a8b4-de6561293082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:43.696433 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6c21d-112f-4e3b-a8b4-de6561293082 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.696716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6c21d-112f-4e3b-a8b4-de6561293082 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.696993 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6c21d-112f-4e3b-a8b4-de6561293082 None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.698203 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6c21d-112f-4e3b-a8b4-de6561293082 None admin] RBAC: Authorizing `identity:get_project(project_id=eafb781b5fef4c2ebef0cb43793cf42e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:43.699687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6c21d-112f-4e3b-a8b4-de6561293082 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:43.702760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 220/440] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:43 2022] GET /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e => generated 303 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:43.703993 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19445432-774a-4f98-a1bb-4c16ec506c0f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.704283 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19445432-774a-4f98-a1bb-4c16ec506c0f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.704568 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19445432-774a-4f98-a1bb-4c16ec506c0f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.706094 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 221/441] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:43.711950 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19445432-774a-4f98-a1bb-4c16ec506c0f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.720592 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb4960-769d-4426-bc7f-1d4d945d296c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:43.721496 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb4960-769d-4426-bc7f-1d4d945d296c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.721947 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb4960-769d-4426-bc7f-1d4d945d296c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.722376 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb4960-769d-4426-bc7f-1d4d945d296c None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.723306 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb4960-769d-4426-bc7f-1d4d945d296c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:43.723704 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb4960-769d-4426-bc7f-1d4d945d296c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:43.725101 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb4960-769d-4426-bc7f-1d4d945d296c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:43.735746 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 221/442] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:28:43 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:43.736972 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5f4ea-212d-4319-99d0-33b7dee2e3f3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.737267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5f4ea-212d-4319-99d0-33b7dee2e3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.737551 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5f4ea-212d-4319-99d0-33b7dee2e3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.755236 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3fb5f4ea-212d-4319-99d0-33b7dee2e3f3 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:43.756453 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3fb5f4ea-212d-4319-99d0-33b7dee2e3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:43.827915 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19445432-774a-4f98-a1bb-4c16ec506c0f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:43.830015 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 222/443] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:43.830885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5f4ea-212d-4319-99d0-33b7dee2e3f3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.843353 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:43.865335 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a704e-903e-43ac-874b-caeae8ca3088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:43.866205 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a704e-903e-43ac-874b-caeae8ca3088 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.866492 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a704e-903e-43ac-874b-caeae8ca3088 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.866800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a704e-903e-43ac-874b-caeae8ca3088 None admin] PATH_INFO: `/v3/groups/d1887e62b2404c37b6fe062b53ba4483` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.867971 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a704e-903e-43ac-874b-caeae8ca3088 None admin] RBAC: Authorizing `identity:get_group(group_id=d1887e62b2404c37b6fe062b53ba4483)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:43.869408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a704e-903e-43ac-874b-caeae8ca3088 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:43.874406 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 222/444] 10.222.0.110 () {56 vars in 1185 bytes} [Thu May 26 16:28:43 2022] GET /identity/v3/groups/d1887e62b2404c37b6fe062b53ba4483 => generated 227 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:43.874406 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a704e-903e-43ac-874b-caeae8ca3088 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.876818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:43.934435 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5f4ea-212d-4319-99d0-33b7dee2e3f3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:43.969418 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44feb38a-7701-49c0-98ec-130e59c7b61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:43.970071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44feb38a-7701-49c0-98ec-130e59c7b61c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.970357 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44feb38a-7701-49c0-98ec-130e59c7b61c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.970672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44feb38a-7701-49c0-98ec-130e59c7b61c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.971078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a704e-903e-43ac-874b-caeae8ca3088 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:44.003942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a667c5-21db-46d0-9a9d-ded45e37999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:44.005257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a667c5-21db-46d0-9a9d-ded45e37999f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:44.005570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a667c5-21db-46d0-9a9d-ded45e37999f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:44.005849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a667c5-21db-46d0-9a9d-ded45e37999f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:44.016441 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a667c5-21db-46d0-9a9d-ded45e37999f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:44.025027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d2a667c5-21db-46d0-9a9d-ded45e37999f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:44.025027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:44.025027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:44.025027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:44.025027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:44.025027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:44.025027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:44.025027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:44.025027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:44.025027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:44.025027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:44.025027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:44.025027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:44.025027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:44.025027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:44.025027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:44.025982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:44.025982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:44.025982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:44.025982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:44.025982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:44.025982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:44.025982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:44.025982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:44.025982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:44.025982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:44.025982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:44.025982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:44.025982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:44.025982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:44.025982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:44.025982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:44.026800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:44.026800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:44.026800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:44.026800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:44.026800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:44.026800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:44.026800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:44.026800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:44.026800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:44.026800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:44.026800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:44.026800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:44.026800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 223/445] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:28:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:44.027457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a667c5-21db-46d0-9a9d-ded45e37999f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:44.043288 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44feb38a-7701-49c0-98ec-130e59c7b61c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:44.044742 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44feb38a-7701-49c0-98ec-130e59c7b61c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:44.069721 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:44.085984 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:44.128964 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a667c5-21db-46d0-9a9d-ded45e37999f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:44.143578 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 223/446] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:43 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:44.144423 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44feb38a-7701-49c0-98ec-130e59c7b61c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:44.164560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e337d3-6fa3-4c03-ab92-eda6d26b03fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:44.165227 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e337d3-6fa3-4c03-ab92-eda6d26b03fb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:44.165518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e337d3-6fa3-4c03-ab92-eda6d26b03fb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:44.165798 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e337d3-6fa3-4c03-ab92-eda6d26b03fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:44.166655 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e337d3-6fa3-4c03-ab92-eda6d26b03fb None admin] RBAC: Adding query filter params (group.id=d1887e62b2404c37b6fe062b53ba4483, role.id=1fdf01beb7394da2a4ea549a7d1bccf1, scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:44.166978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e337d3-6fa3-4c03-ab92-eda6d26b03fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:44.168416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e337d3-6fa3-4c03-ab92-eda6d26b03fb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:44.174152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 224/447] 10.222.0.110 () {56 vars in 1381 bytes} [Thu May 26 16:28:44 2022] GET /identity/v3/role_assignments?group.id=d1887e62b2404c37b6fe062b53ba4483&scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e&role.id=1fdf01beb7394da2a4ea549a7d1bccf1 => generated 613 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:44.174952 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e337d3-6fa3-4c03-ab92-eda6d26b03fb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:44.273560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44feb38a-7701-49c0-98ec-130e59c7b61c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:44.295253 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e337d3-6fa3-4c03-ab92-eda6d26b03fb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:44.305797 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:44.312638 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0915f8b-4142-4a02-b576-ab4a05073507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:44.313340 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0915f8b-4142-4a02-b576-ab4a05073507 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:44.313679 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0915f8b-4142-4a02-b576-ab4a05073507 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:44.313962 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0915f8b-4142-4a02-b576-ab4a05073507 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:44.314781 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0915f8b-4142-4a02-b576-ab4a05073507 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:44.315091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0915f8b-4142-4a02-b576-ab4a05073507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:44.316511 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0915f8b-4142-4a02-b576-ab4a05073507 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:44.325798 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 224/448] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:44 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:44.331569 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0915f8b-4142-4a02-b576-ab4a05073507 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:44.336334 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:44.344418 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117cc9c-269d-48ab-9ffe-abe17517004f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:44.345693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117cc9c-269d-48ab-9ffe-abe17517004f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:44.345980 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117cc9c-269d-48ab-9ffe-abe17517004f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:44.346258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117cc9c-269d-48ab-9ffe-abe17517004f None admin] PATH_INFO: `/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:44.347840 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117cc9c-269d-48ab-9ffe-abe17517004f None admin] RBAC: Authorizing `identity:get_project(project_id=eafb781b5fef4c2ebef0cb43793cf42e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:44.349457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117cc9c-269d-48ab-9ffe-abe17517004f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:44.351212 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 225/449] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:44 2022] GET /identity/v3/projects/eafb781b5fef4c2ebef0cb43793cf42e => generated 303 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:44.357036 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117cc9c-269d-48ab-9ffe-abe17517004f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:44.463729 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0915f8b-4142-4a02-b576-ab4a05073507 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:44.492552 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117cc9c-269d-48ab-9ffe-abe17517004f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:44.509979 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8d301-0e38-4ee6-9fff-27d6dc27c991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:44.510689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8d301-0e38-4ee6-9fff-27d6dc27c991 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:44.510961 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8d301-0e38-4ee6-9fff-27d6dc27c991 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:44.511234 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8d301-0e38-4ee6-9fff-27d6dc27c991 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:44.533494 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8063f-5c0b-4988-a16a-83c3a6225b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:44.534370 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8063f-5c0b-4988-a16a-83c3a6225b7c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:44.534708 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8063f-5c0b-4988-a16a-83c3a6225b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:44.534992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8063f-5c0b-4988-a16a-83c3a6225b7c None admin] PATH_INFO: `/v3/groups/d1887e62b2404c37b6fe062b53ba4483` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:44.536264 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8063f-5c0b-4988-a16a-83c3a6225b7c None admin] RBAC: Authorizing `identity:get_group(group_id=d1887e62b2404c37b6fe062b53ba4483)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:44.537727 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8063f-5c0b-4988-a16a-83c3a6225b7c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:44.539415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 226/450] 10.222.0.110 () {56 vars in 1185 bytes} [Thu May 26 16:28:44 2022] GET /identity/v3/groups/d1887e62b2404c37b6fe062b53ba4483 => generated 227 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:44.545390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8063f-5c0b-4988-a16a-83c3a6225b7c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:44.587607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8d301-0e38-4ee6-9fff-27d6dc27c991 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:44.589072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8d301-0e38-4ee6-9fff-27d6dc27c991 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:44.591800 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:44.594455 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:44.654593 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8063f-5c0b-4988-a16a-83c3a6225b7c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:44.687949 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4e1e9-c894-44b1-8bfd-6adafe56a5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:44.688428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 225/451] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:44 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:44.688669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4e1e9-c894-44b1-8bfd-6adafe56a5ef None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:44.688957 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4e1e9-c894-44b1-8bfd-6adafe56a5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:44.689232 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4e1e9-c894-44b1-8bfd-6adafe56a5ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:44.690122 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4e1e9-c894-44b1-8bfd-6adafe56a5ef None admin] RBAC: Adding query filter params (group.id=d1887e62b2404c37b6fe062b53ba4483, role.id=634cfaacf2e444359b518d8dc7ed122b, scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:44.690436 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4e1e9-c894-44b1-8bfd-6adafe56a5ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:44.691890 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4e1e9-c894-44b1-8bfd-6adafe56a5ef None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:44.693933 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8d301-0e38-4ee6-9fff-27d6dc27c991 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:44.697796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 227/452] 10.222.0.110 () {56 vars in 1381 bytes} [Thu May 26 16:28:44 2022] GET /identity/v3/role_assignments?group.id=d1887e62b2404c37b6fe062b53ba4483&scope.project.id=eafb781b5fef4c2ebef0cb43793cf42e&role.id=634cfaacf2e444359b518d8dc7ed122b => generated 613 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:44.799082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8d301-0e38-4ee6-9fff-27d6dc27c991 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:44.801578 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:44.835214 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a71c2a-167e-4f09-843f-b5b9dc76cd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:44.836095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a71c2a-167e-4f09-843f-b5b9dc76cd78 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:44.836381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a71c2a-167e-4f09-843f-b5b9dc76cd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:44.836660 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a71c2a-167e-4f09-843f-b5b9dc76cd78 None admin] PATH_INFO: `/v3/projects/d89de88c67114e9b9382e93ffe6a1176` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:44.837897 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a71c2a-167e-4f09-843f-b5b9dc76cd78 None admin] RBAC: Authorizing `identity:get_project(project_id=d89de88c67114e9b9382e93ffe6a1176)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:44.839386 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a71c2a-167e-4f09-843f-b5b9dc76cd78 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:44.841111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 226/453] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:28:44 2022] GET /identity/v3/projects/d89de88c67114e9b9382e93ffe6a1176 => generated 345 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:44.846775 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4e1e9-c894-44b1-8bfd-6adafe56a5ef None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:44.952359 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4e1e9-c894-44b1-8bfd-6adafe56a5ef None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:44.959564 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:44.987858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1ffee-4af2-4433-b583-a76954caafef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:44.988862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1ffee-4af2-4433-b583-a76954caafef None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:44.989368 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1ffee-4af2-4433-b583-a76954caafef None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:44.990022 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1ffee-4af2-4433-b583-a76954caafef None admin] PATH_INFO: `/v3/groups/298cfb867ddc4bdbb1eaf89804cb479f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:44.991318 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1ffee-4af2-4433-b583-a76954caafef None admin] RBAC: Authorizing `identity:get_group(group_id=298cfb867ddc4bdbb1eaf89804cb479f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:44.992976 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1ffee-4af2-4433-b583-a76954caafef None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:44.995637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 228/454] 10.222.0.110 () {56 vars in 1185 bytes} [Thu May 26 16:28:44 2022] GET /identity/v3/groups/298cfb867ddc4bdbb1eaf89804cb479f => generated 230 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:45.001793 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a71c2a-167e-4f09-843f-b5b9dc76cd78 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:45.104738 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a71c2a-167e-4f09-843f-b5b9dc76cd78 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:45.139313 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753aad27-d464-48e9-bbec-af88f52042a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:45.139956 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753aad27-d464-48e9-bbec-af88f52042a0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:45.140237 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753aad27-d464-48e9-bbec-af88f52042a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:45.140515 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753aad27-d464-48e9-bbec-af88f52042a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:45.141329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753aad27-d464-48e9-bbec-af88f52042a0 None admin] RBAC: Adding query filter params (group.id=298cfb867ddc4bdbb1eaf89804cb479f, role.id=1393d128d39b4649b6cd71b6609846cb, scope.project.id=d89de88c67114e9b9382e93ffe6a1176) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:45.141638 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753aad27-d464-48e9-bbec-af88f52042a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:45.143085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753aad27-d464-48e9-bbec-af88f52042a0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:45.148732 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 227/455] 10.222.0.110 () {56 vars in 1381 bytes} [Thu May 26 16:28:45 2022] GET /identity/v3/role_assignments?group.id=298cfb867ddc4bdbb1eaf89804cb479f&scope.project.id=d89de88c67114e9b9382e93ffe6a1176&role.id=1393d128d39b4649b6cd71b6609846cb => generated 613 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:47.825466 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ebd0a-7def-4212-992e-a58896f9b478 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:47.825993 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ebd0a-7def-4212-992e-a58896f9b478 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:47.825993 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ebd0a-7def-4212-992e-a58896f9b478 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:47.827683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 229/456] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:47.833551 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0af54c-0c67-48d2-aa38-cd7607ff4319 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:47.834016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0af54c-0c67-48d2-aa38-cd7607ff4319 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:47.834095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0af54c-0c67-48d2-aa38-cd7607ff4319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:47.858990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4f0af54c-0c67-48d2-aa38-cd7607ff4319 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:47.860180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4f0af54c-0c67-48d2-aa38-cd7607ff4319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:47.903272 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:47.961329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 228/457] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:48.002605 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ebd0a-7def-4212-992e-a58896f9b478 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:48.025579 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d957e-303e-433b-9cd7-13cd390e0977 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.025935 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d957e-303e-433b-9cd7-13cd390e0977 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.026157 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d957e-303e-433b-9cd7-13cd390e0977 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.027540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 229/458] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:28:48.033313 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0d58e-fbd1-490a-84cd-965b2c393ecc None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.033845 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0d58e-fbd1-490a-84cd-965b2c393ecc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.034294 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0d58e-fbd1-490a-84cd-965b2c393ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.053962 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b2d0d58e-fbd1-490a-84cd-965b2c393ecc None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:48.055531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b2d0d58e-fbd1-490a-84cd-965b2c393ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:48.164828 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ebd0a-7def-4212-992e-a58896f9b478 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:48.206137 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 230/459] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:48.224719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bc08a-f306-48b1-ba4a-ab887d8bcf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:48.225538 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bc08a-f306-48b1-ba4a-ab887d8bcf56 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.225824 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bc08a-f306-48b1-ba4a-ab887d8bcf56 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.226104 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bc08a-f306-48b1-ba4a-ab887d8bcf56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.232817 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0d58e-fbd1-490a-84cd-965b2c393ecc None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:48.241796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bc08a-f306-48b1-ba4a-ab887d8bcf56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:48.243313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bc08a-f306-48b1-ba4a-ab887d8bcf56 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:48.271758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ae4bc08a-f306-48b1-ba4a-ab887d8bcf56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:48.271758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:48.271758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:48.271758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:48.271758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:48.271758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:48.271758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:48.271758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:48.271758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:48.271758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:48.271758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:48.271758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:48.271758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:48.271758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:48.271758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:48.273068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:48.273068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:48.273068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:48.273068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:48.273068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:48.273068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:48.273068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:48.273068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:48.273068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:48.273068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:48.273068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:48.273068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:48.273068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:48.273068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:48.273068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:48.273068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:48.273068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:48.273945 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:48.273945 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:48.273945 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:48.273945 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:48.275063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 230/460] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:48.276528 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfd5dd-e65b-4652-a55c-f53475ca788a None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.276970 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfd5dd-e65b-4652-a55c-f53475ca788a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.277899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfd5dd-e65b-4652-a55c-f53475ca788a None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.279638 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 231/461] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:48.281661 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfd5dd-e65b-4652-a55c-f53475ca788a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:48.312166 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:48.364747 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:48.370558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0d58e-fbd1-490a-84cd-965b2c393ecc None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:48.404006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfd5dd-e65b-4652-a55c-f53475ca788a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:48.410660 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bc1d7-0302-4a79-854f-9ea220209e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:48.411774 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc1d7-0302-4a79-854f-9ea220209e81 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.412327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc1d7-0302-4a79-854f-9ea220209e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.412756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc1d7-0302-4a79-854f-9ea220209e81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.424964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bc1d7-0302-4a79-854f-9ea220209e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:48.426859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bc1d7-0302-4a79-854f-9ea220209e81 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:48.440779 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15814d-5f79-4fe0-a85e-bceaf323facd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:48.441449 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15814d-5f79-4fe0-a85e-bceaf323facd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.441737 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15814d-5f79-4fe0-a85e-bceaf323facd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.442609 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15814d-5f79-4fe0-a85e-bceaf323facd None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.443338 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15814d-5f79-4fe0-a85e-bceaf323facd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:48.443650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15814d-5f79-4fe0-a85e-bceaf323facd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:48.445036 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15814d-5f79-4fe0-a85e-bceaf323facd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:48.452448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-d82bc1d7-0302-4a79-854f-9ea220209e81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:48.452448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:48.452448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:48.452448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:48.452448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:48.452448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:48.452448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:48.452448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:48.452448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:48.452448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:48.452448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:48.452448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:48.452448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:48.452448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:48.452448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:48.453516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:48.453516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:48.453516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:48.453516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:48.453516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:48.453516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:48.453516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:48.453516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:48.453516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:48.453516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:48.453516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:48.453516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:48.453516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:48.453516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:48.453516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:48.453516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:48.453516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:48.454545 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:48.454545 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:48.454545 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:48.454545 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:48.456220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 231/462] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:48.457702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a728e-a607-4e4d-8cec-2b504fc3aa12 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.458211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a728e-a607-4e4d-8cec-2b504fc3aa12 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.458727 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a728e-a607-4e4d-8cec-2b504fc3aa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.464006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 232/463] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:28:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:48.464857 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15814d-5f79-4fe0-a85e-bceaf323facd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:48.477592 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e32a728e-a607-4e4d-8cec-2b504fc3aa12 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:48.479204 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e32a728e-a607-4e4d-8cec-2b504fc3aa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:48.551815 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:48.553901 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 232/464] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:48.555901 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a728e-a607-4e4d-8cec-2b504fc3aa12 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:48.579788 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15814d-5f79-4fe0-a85e-bceaf323facd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:48.615609 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9ce85-4359-476a-ae2f-e688f7894f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:48.616298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9ce85-4359-476a-ae2f-e688f7894f0d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.616588 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9ce85-4359-476a-ae2f-e688f7894f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.616866 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9ce85-4359-476a-ae2f-e688f7894f0d None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.617593 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9ce85-4359-476a-ae2f-e688f7894f0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:48.617903 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9ce85-4359-476a-ae2f-e688f7894f0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:48.619312 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9ce85-4359-476a-ae2f-e688f7894f0d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:48.631608 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 233/465] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:28:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:48.632816 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9ce85-4359-476a-ae2f-e688f7894f0d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:48.641278 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:48.665705 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a728e-a607-4e4d-8cec-2b504fc3aa12 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:48.703401 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99f45a-19f6-4a83-9016-c6b3142a0a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:48.704155 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99f45a-19f6-4a83-9016-c6b3142a0a55 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.704444 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99f45a-19f6-4a83-9016-c6b3142a0a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.704840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99f45a-19f6-4a83-9016-c6b3142a0a55 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.705553 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99f45a-19f6-4a83-9016-c6b3142a0a55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:48.707025 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99f45a-19f6-4a83-9016-c6b3142a0a55 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:48.731526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 233/466] 10.222.0.110 () {60 vars in 1137 bytes} [Thu May 26 16:28:48 2022] POST /identity/v3/users => generated 247 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:48.733439 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b4421-5cb0-4942-89e6-c8fe6e8b8297 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.733736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b4421-5cb0-4942-89e6-c8fe6e8b8297 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.734020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b4421-5cb0-4942-89e6-c8fe6e8b8297 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.740076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 234/467] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:48.740076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b4421-5cb0-4942-89e6-c8fe6e8b8297 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:48.741770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9ce85-4359-476a-ae2f-e688f7894f0d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:48.789308 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6d289-f1ea-45d9-9697-c5108df41b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:48.790750 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6d289-f1ea-45d9-9697-c5108df41b92 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.791044 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6d289-f1ea-45d9-9697-c5108df41b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.791328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6d289-f1ea-45d9-9697-c5108df41b92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.808102 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6d289-f1ea-45d9-9697-c5108df41b92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:48.809853 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6d289-f1ea-45d9-9697-c5108df41b92 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:48.819836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:48.838745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8ab6d289-f1ea-45d9-9697-c5108df41b92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:48.838745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:48.838745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:48.838745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:48.838745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:48.838745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:48.838745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:48.838745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:48.838745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:48.838745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:48.838745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:48.838745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:48.838745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:48.838745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:48.838745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:48.840138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:48.840138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:48.840138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:48.840138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:48.840138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:48.840138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:48.840138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:48.840138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:48.840138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:48.840138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:48.840138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:48.840138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:48.840138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:48.840138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:48.840138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:48.840138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:48.840138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:48.841498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:48.841498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:48.841498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:48.841498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:48.845732 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 234/468] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:48.847689 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357962c-d091-4542-bee0-f73fce62bac8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.848008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357962c-d091-4542-bee0-f73fce62bac8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.848306 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357962c-d091-4542-bee0-f73fce62bac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.872254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2357962c-d091-4542-bee0-f73fce62bac8 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:48.873856 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2357962c-d091-4542-bee0-f73fce62bac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:48.876581 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b4421-5cb0-4942-89e6-c8fe6e8b8297 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:48.917360 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa463fa5-e05a-48a0-bdb3-b39fd34ecfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:48.918439 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa463fa5-e05a-48a0-bdb3-b39fd34ecfe6 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.919045 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa463fa5-e05a-48a0-bdb3-b39fd34ecfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.919542 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa463fa5-e05a-48a0-bdb3-b39fd34ecfe6 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.920516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa463fa5-e05a-48a0-bdb3-b39fd34ecfe6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:48.922197 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa463fa5-e05a-48a0-bdb3-b39fd34ecfe6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:48.929942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:48.948612 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 235/469] 10.222.0.110 () {60 vars in 1137 bytes} [Thu May 26 16:28:48 2022] POST /identity/v3/users => generated 249 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:48.955666 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa463fa5-e05a-48a0-bdb3-b39fd34ecfe6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:48.964453 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 235/470] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:48.993803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357962c-d091-4542-bee0-f73fce62bac8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:49.107324 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa463fa5-e05a-48a0-bdb3-b39fd34ecfe6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:49.128668 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357962c-d091-4542-bee0-f73fce62bac8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:49.159306 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5645428-1f61-4b1d-a010-6cda65d3187e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:49.160897 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5645428-1f61-4b1d-a010-6cda65d3187e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:49.161402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5645428-1f61-4b1d-a010-6cda65d3187e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:49.162147 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5645428-1f61-4b1d-a010-6cda65d3187e None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:49.163159 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5645428-1f61-4b1d-a010-6cda65d3187e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:49.163845 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5645428-1f61-4b1d-a010-6cda65d3187e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:49.164341 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:49.166035 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5645428-1f61-4b1d-a010-6cda65d3187e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:49.175093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb62d3-49a8-4829-9af0-30c7db43f051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:49.176353 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb62d3-49a8-4829-9af0-30c7db43f051 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:49.176851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb62d3-49a8-4829-9af0-30c7db43f051 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:49.177297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb62d3-49a8-4829-9af0-30c7db43f051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:49.181974 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 236/471] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:28:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:49.190863 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb62d3-49a8-4829-9af0-30c7db43f051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:49.191693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5645428-1f61-4b1d-a010-6cda65d3187e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:49.194001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb62d3-49a8-4829-9af0-30c7db43f051 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:49.213656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-2efb62d3-49a8-4829-9af0-30c7db43f051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:49.213656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:49.213656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:49.213656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:49.213656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:49.213656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:49.213656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:49.213656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:49.213656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:49.213656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:49.213656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:49.213656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:49.213656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:49.213656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:49.213656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:49.214553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:49.214553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:49.214553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:49.214553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:49.214553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:49.214553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:49.214553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:49.214553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:49.214553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:49.214553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:49.214553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:49.214553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:49.214553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:49.214553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:49.214553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:49.214553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:49.214553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:49.215916 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:49.215916 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:49.215916 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:49.215916 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:49.218180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 236/472] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:49.221006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb62d3-49a8-4829-9af0-30c7db43f051 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:49.259714 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:49.314351 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5645428-1f61-4b1d-a010-6cda65d3187e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:49.340019 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb62d3-49a8-4829-9af0-30c7db43f051 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:49.361536 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44dce7-ad29-4790-b9d4-538ebe786984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:49.362237 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44dce7-ad29-4790-b9d4-538ebe786984 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:49.362529 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44dce7-ad29-4790-b9d4-538ebe786984 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:49.362843 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44dce7-ad29-4790-b9d4-538ebe786984 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:49.363633 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44dce7-ad29-4790-b9d4-538ebe786984 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:49.365080 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44dce7-ad29-4790-b9d4-538ebe786984 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:49.389012 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 237/473] 10.222.0.110 () {60 vars in 1137 bytes} [Thu May 26 16:28:49 2022] POST /identity/v3/users => generated 249 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:49.394932 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18caa7a4-7d05-41b3-b981-fcddd9a3ed25 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:49.394932 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18caa7a4-7d05-41b3-b981-fcddd9a3ed25 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:49.394932 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18caa7a4-7d05-41b3-b981-fcddd9a3ed25 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:49.394932 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 238/474] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:49.400194 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331b98f-b381-4fe9-8b7d-f50b5a950be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:49.400962 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331b98f-b381-4fe9-8b7d-f50b5a950be0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:49.401319 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331b98f-b381-4fe9-8b7d-f50b5a950be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:49.401671 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331b98f-b381-4fe9-8b7d-f50b5a950be0 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:49.401878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb141e-b268-4cec-bc28-3722c7fe6f63 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:49.402386 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb141e-b268-4cec-bc28-3722c7fe6f63 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:49.402547 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331b98f-b381-4fe9-8b7d-f50b5a950be0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:49.403060 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb141e-b268-4cec-bc28-3722c7fe6f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:49.407020 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331b98f-b381-4fe9-8b7d-f50b5a950be0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:49.408877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331b98f-b381-4fe9-8b7d-f50b5a950be0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:49.438588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-86cb141e-b268-4cec-bc28-3722c7fe6f63 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:49.441223 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 237/475] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:28:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:49.443504 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-86cb141e-b268-4cec-bc28-3722c7fe6f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:49.447418 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331b98f-b381-4fe9-8b7d-f50b5a950be0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:49.547711 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:49.581295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 239/476] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:49.627211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb141e-b268-4cec-bc28-3722c7fe6f63 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:49.640088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331b98f-b381-4fe9-8b7d-f50b5a950be0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:49.670597 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:49.678024 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d219ec7-b9c9-4e61-afdf-61dc06851f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:49.678783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d219ec7-b9c9-4e61-afdf-61dc06851f1e None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:49.679077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d219ec7-b9c9-4e61-afdf-61dc06851f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:49.679359 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d219ec7-b9c9-4e61-afdf-61dc06851f1e None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:49.680074 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d219ec7-b9c9-4e61-afdf-61dc06851f1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:49.681521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d219ec7-b9c9-4e61-afdf-61dc06851f1e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:49.710754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 238/477] 10.222.0.110 () {60 vars in 1137 bytes} [Thu May 26 16:28:49 2022] POST /identity/v3/users => generated 250 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:28:49.747792 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb141e-b268-4cec-bc28-3722c7fe6f63 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:49.789223 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d65c4-3d4e-4089-b7a5-0b125c667f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:49.789927 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d65c4-3d4e-4089-b7a5-0b125c667f28 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:49.790217 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d65c4-3d4e-4089-b7a5-0b125c667f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:49.790495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d65c4-3d4e-4089-b7a5-0b125c667f28 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:49.791439 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d65c4-3d4e-4089-b7a5-0b125c667f28 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:49.792925 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d65c4-3d4e-4089-b7a5-0b125c667f28 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:49.803507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.sql.core [None req-b05d65c4-3d4e-4089-b7a5-0b125c667f28 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 16:28:49.803507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 16:28:49.803507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [parameters: {'id': 'edbe13841f3b494a9e83c81b3dd258e8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 16:28:49.803507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80420) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 16:28:49.821644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-b05d65c4-3d4e-4089-b7a5-0b125c667f28 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 16:28:49.821644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:49.821644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:28:49.821644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:28:49.821644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:28:49.821644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:28:49.821644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:28:49.821644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:28:49.821644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:28:49.821644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application conn.query(q) May 26 16:28:49.821644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:28:49.821644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:28:49.821644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:28:49.821644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result.read() May 26 16:28:49.821644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:28:49.822625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:28:49.822625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:28:49.822625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:28:49.822625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:28:49.822625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:28:49.822625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:28:49.822625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:28:49.822625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 16:28:49.822625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:49.822625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 16:28:49.822625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:49.822625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:49.822625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 16:28:49.822625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 16:28:49.822625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 16:28:49.822625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return ref.to_dict() May 26 16:28:49.822625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:28:49.822625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application next(self.gen) May 26 16:28:49.823522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 16:28:49.823522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application yield resource May 26 16:28:49.823522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:28:49.823522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application next(self.gen) May 26 16:28:49.823522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 16:28:49.823522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.session.rollback() May 26 16:28:49.823522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 16:28:49.823522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.force_reraise() May 26 16:28:49.823522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 16:28:49.823522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise self.value May 26 16:28:49.823522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 16:28:49.823522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 16:28:49.823522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 16:28:49.823522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application session.commit() May 26 16:28:49.823522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 16:28:49.823522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 16:28:49.823522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 16:28:49.824367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._prepare_impl() May 26 16:28:49.824367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 16:28:49.824367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.session.flush() May 26 16:28:49.824367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 16:28:49.824367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._flush(objects) May 26 16:28:49.824367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 16:28:49.824367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 16:28:49.824367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 16:28:49.824367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application compat.raise_( May 26 16:28:49.824367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:28:49.824367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception May 26 16:28:49.824367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 16:28:49.824367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application flush_context.execute() May 26 16:28:49.824367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 16:28:49.824367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rec.execute(self) May 26 16:28:49.824367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 16:28:49.824367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 16:28:49.825231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 16:28:49.825231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 16:28:49.825231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 16:28:49.825231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 16:28:49.825231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 16:28:49.825231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 16:28:49.825231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 16:28:49.825231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 16:28:49.825231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 16:28:49.825231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 16:28:49.825231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 16:28:49.825231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 16:28:49.825231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 16:28:49.825231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 16:28:49.825231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:28:49.825231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception May 26 16:28:49.826037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:28:49.826037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:28:49.826037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:28:49.826037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:28:49.826037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:28:49.826037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:28:49.826037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:28:49.826037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application conn.query(q) May 26 16:28:49.826037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:28:49.826037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:28:49.826037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:28:49.826037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result.read() May 26 16:28:49.826037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:28:49.826037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:28:49.826037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:28:49.826037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:28:49.828168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:28:49.828168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:28:49.828168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:28:49.828168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:28:49.828168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 16:28:49.828168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 16:28:49.828168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [parameters: {'id': 'edbe13841f3b494a9e83c81b3dd258e8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 16:28:49.828168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 16:28:49.828168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:49.828168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:28:49.828168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:49.828168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:49.828168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:49.828168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:49.828168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:49.828168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:49.830118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:49.830118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:49.830118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:49.830118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:49.830118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:49.830118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:49.830118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 16:28:49.830118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 16:28:49.830118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:49.830118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:49.830118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 16:28:49.830118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 16:28:49.830118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 16:28:49.830118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 16:28:49.830118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 16:28:49.830118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:49.837688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 240/478] 10.222.0.110 () {60 vars in 1136 bytes} [Thu May 26 16:28:49 2022] POST /identity/v3/roles => generated 144 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:49.843748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d219ec7-b9c9-4e61-afdf-61dc06851f1e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:49.959795 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:49.967505 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d219ec7-b9c9-4e61-afdf-61dc06851f1e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:50.004117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa6e32-d584-40c7-83c3-3cab750adce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:50.005467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa6e32-d584-40c7-83c3-3cab750adce2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:50.005754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa6e32-d584-40c7-83c3-3cab750adce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:50.006029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa6e32-d584-40c7-83c3-3cab750adce2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:50.017130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa6e32-d584-40c7-83c3-3cab750adce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:50.025673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-36aa6e32-d584-40c7-83c3-3cab750adce2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:50.025673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:50.025673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:50.025673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:50.025673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:50.025673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:50.025673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:50.025673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:50.025673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:50.025673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:50.025673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:50.025673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:50.025673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:50.025673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:50.025673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:50.025673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:50.027745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:50.027745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:50.027745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:50.027745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:50.027745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:50.027745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:50.027745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:50.027745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:50.027745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:50.027745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:50.027745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:50.027745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:50.027745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:50.027745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:50.027745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:50.027745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:50.029625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:50.029625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:50.029625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:50.029625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:50.029625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:50.029625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:50.029625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:50.029625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:50.029625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:50.029625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:50.029625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:50.029625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:50.029625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 239/479] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:28:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:50.037236 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d65c4-3d4e-4089-b7a5-0b125c667f28 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:50.154172 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:50.159082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d65c4-3d4e-4089-b7a5-0b125c667f28 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:50.200223 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea7e53-161a-4d06-bf90-65cc8bebb39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:50.200907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea7e53-161a-4d06-bf90-65cc8bebb39e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:50.201196 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea7e53-161a-4d06-bf90-65cc8bebb39e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:50.201479 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea7e53-161a-4d06-bf90-65cc8bebb39e None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:50.202228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea7e53-161a-4d06-bf90-65cc8bebb39e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:50.202547 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea7e53-161a-4d06-bf90-65cc8bebb39e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:50.204028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea7e53-161a-4d06-bf90-65cc8bebb39e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:50.213021 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 241/480] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:28:50 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:51.354851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a79db4-380c-4be9-8e96-c1cfceddd94e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:51.355365 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a79db4-380c-4be9-8e96-c1cfceddd94e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:51.355441 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a79db4-380c-4be9-8e96-c1cfceddd94e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:51.357111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 240/481] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:51.362019 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69fff1-c2c8-4a73-b806-b1eec20960aa None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:51.362446 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69fff1-c2c8-4a73-b806-b1eec20960aa None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:51.362652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69fff1-c2c8-4a73-b806-b1eec20960aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:51.387911 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-5d69fff1-c2c8-4a73-b806-b1eec20960aa None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:51.389097 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5d69fff1-c2c8-4a73-b806-b1eec20960aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:51.496943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 242/482] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:51.544902 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a79db4-380c-4be9-8e96-c1cfceddd94e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:51.656673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a79db4-380c-4be9-8e96-c1cfceddd94e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:51.670184 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cdd13-4e33-44ed-b995-5b9cecc205b6 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:51.670479 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cdd13-4e33-44ed-b995-5b9cecc205b6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:51.670807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cdd13-4e33-44ed-b995-5b9cecc205b6 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:51.672398 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 243/483] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:51.677483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37521c2-27ae-41fe-b00f-e05ddb24d0e2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:51.677778 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37521c2-27ae-41fe-b00f-e05ddb24d0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:51.678057 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37521c2-27ae-41fe-b00f-e05ddb24d0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:51.694377 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6998339-e49f-4236-b675-4a04a972233d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:51.695218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6998339-e49f-4236-b675-4a04a972233d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:51.695507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6998339-e49f-4236-b675-4a04a972233d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:51.695789 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6998339-e49f-4236-b675-4a04a972233d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:51.707280 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6998339-e49f-4236-b675-4a04a972233d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:51.715617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b6998339-e49f-4236-b675-4a04a972233d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:28:51.715617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:51.715617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:51.715617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:51.715617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:51.715617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:51.715617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:51.715617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:51.715617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:51.715617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:51.715617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:51.715617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:51.715617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:51.715617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:51.715617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:51.715617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:51.716585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:51.716585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:51.716585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:51.716585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:51.716585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:51.716585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:51.716585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:51.716585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:51.716585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:51.716585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:51.716585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:51.716585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:51.716585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:51.716585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:51.716585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:51.716585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:51.717379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:51.717379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:51.717379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:51.717379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:51.717379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:51.717379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:51.717379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:51.717379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:51.717379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:51.717379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:51.717379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:28:51.717379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:51.717379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 241/484] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:28:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:51.718509 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e37521c2-27ae-41fe-b00f-e05ddb24d0e2 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:51.719719 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e37521c2-27ae-41fe-b00f-e05ddb24d0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:51.723594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6998339-e49f-4236-b675-4a04a972233d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:51.752768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:51.837214 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6998339-e49f-4236-b675-4a04a972233d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:51.877534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f434eb-bd3c-4ddd-96cc-0a0f30a74030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:51.878989 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f434eb-bd3c-4ddd-96cc-0a0f30a74030 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:51.879663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f434eb-bd3c-4ddd-96cc-0a0f30a74030 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:51.880171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f434eb-bd3c-4ddd-96cc-0a0f30a74030 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:51.881181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f434eb-bd3c-4ddd-96cc-0a0f30a74030 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:51.882156 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f434eb-bd3c-4ddd-96cc-0a0f30a74030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:51.883762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f434eb-bd3c-4ddd-96cc-0a0f30a74030 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:51.893218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 242/485] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:28:51 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:51.898810 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f434eb-bd3c-4ddd-96cc-0a0f30a74030 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:51.934455 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 244/486] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:51.975084 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37521c2-27ae-41fe-b00f-e05ddb24d0e2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:51.986960 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:52.012876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f434eb-bd3c-4ddd-96cc-0a0f30a74030 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:52.021051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:52.052149 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7caf5-4ce2-4d1a-aecd-2163106de891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:52.053307 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7caf5-4ce2-4d1a-aecd-2163106de891 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:52.053771 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7caf5-4ce2-4d1a-aecd-2163106de891 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:52.054345 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7caf5-4ce2-4d1a-aecd-2163106de891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:52.088446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7caf5-4ce2-4d1a-aecd-2163106de891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:52.091450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7caf5-4ce2-4d1a-aecd-2163106de891 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:52.120237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8de7caf5-4ce2-4d1a-aecd-2163106de891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:52.120237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:52.120237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:52.120237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:52.120237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:52.120237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:52.120237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:52.120237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:52.120237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:52.120237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:52.120237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:52.120237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:52.120237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:52.120237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:52.120237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:52.121457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:52.121457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:52.121457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:52.121457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:52.121457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:52.121457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:52.121457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:52.121457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:52.121457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:52.121457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:52.121457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:52.121457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:52.121457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:52.121457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:52.121457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:52.121457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:52.121457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:52.122294 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:52.122294 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:52.122294 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:52.122294 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:52.122294 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 243/487] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:52.126165 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7caf5-4ce2-4d1a-aecd-2163106de891 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:52.149333 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37521c2-27ae-41fe-b00f-e05ddb24d0e2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:52.218427 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41418a9e-580e-4749-a837-ec1fc270ca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:52.219183 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41418a9e-580e-4749-a837-ec1fc270ca39 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:52.219467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41418a9e-580e-4749-a837-ec1fc270ca39 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:52.219746 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41418a9e-580e-4749-a837-ec1fc270ca39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:52.243391 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41418a9e-580e-4749-a837-ec1fc270ca39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:52.251503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-41418a9e-580e-4749-a837-ec1fc270ca39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:28:52.251503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:52.251503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:52.251503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:52.251503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:52.251503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:52.251503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:52.251503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:52.251503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:52.251503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:52.251503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:52.251503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:52.251503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:52.251503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:52.251503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:52.251503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:52.252366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:52.252366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:52.252366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:52.252366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:52.252366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:52.252366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:52.252366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:52.252366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:52.252366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:52.252366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:52.252366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:52.252366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:52.252366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:52.252366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:52.252366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:52.252366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:52.253182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:52.253182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:52.253182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:52.253182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:52.253182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:52.253182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:52.253182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:52.253182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:52.253182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:52.253182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:52.253182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:28:52.253182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:52.273876 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 245/488] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:28:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:52.274916 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41418a9e-580e-4749-a837-ec1fc270ca39 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:52.326318 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7caf5-4ce2-4d1a-aecd-2163106de891 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:52.377211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e851d05-6e23-4bba-afc9-7d9bcc491acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:52.377982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e851d05-6e23-4bba-afc9-7d9bcc491acb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:52.378157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e851d05-6e23-4bba-afc9-7d9bcc491acb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:52.378437 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e851d05-6e23-4bba-afc9-7d9bcc491acb None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:52.379861 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e851d05-6e23-4bba-afc9-7d9bcc491acb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:52.380174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e851d05-6e23-4bba-afc9-7d9bcc491acb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:52.381668 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e851d05-6e23-4bba-afc9-7d9bcc491acb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:52.390952 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:52.394176 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 244/489] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:28:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:52.399790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e851d05-6e23-4bba-afc9-7d9bcc491acb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:52.485385 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:52.501771 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41418a9e-580e-4749-a837-ec1fc270ca39 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:52.502302 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e851d05-6e23-4bba-afc9-7d9bcc491acb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:52.537131 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ac13d-f044-4a8b-8e4e-8f1e547a8e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:52.537368 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3e490-be25-4fbd-80ea-4cff948f50b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:52.537827 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ac13d-f044-4a8b-8e4e-8f1e547a8e20 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:52.537936 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3e490-be25-4fbd-80ea-4cff948f50b8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:52.538132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ac13d-f044-4a8b-8e4e-8f1e547a8e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:52.538231 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3e490-be25-4fbd-80ea-4cff948f50b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:52.538432 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ac13d-f044-4a8b-8e4e-8f1e547a8e20 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:52.538530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3e490-be25-4fbd-80ea-4cff948f50b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:52.539427 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ac13d-f044-4a8b-8e4e-8f1e547a8e20 None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:52.539759 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ac13d-f044-4a8b-8e4e-8f1e547a8e20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:52.541362 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ac13d-f044-4a8b-8e4e-8f1e547a8e20 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:52.546513 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3e490-be25-4fbd-80ea-4cff948f50b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:52.548005 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3e490-be25-4fbd-80ea-4cff948f50b8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:52.550420 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 246/490] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:28:52 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:52.552502 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b677db8-2ca1-497e-8e3d-a344aa6571ee None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:52.552788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b677db8-2ca1-497e-8e3d-a344aa6571ee None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:52.553064 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b677db8-2ca1-497e-8e3d-a344aa6571ee None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:52.558834 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 247/491] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:52 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:52.560312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe0174-715f-4d81-be86-f164e0719af7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:52.560605 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe0174-715f-4d81-be86-f164e0719af7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:52.560887 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe0174-715f-4d81-be86-f164e0719af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:52.570942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-48b3e490-be25-4fbd-80ea-4cff948f50b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:28:52.570942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:52.570942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:52.570942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:52.570942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:52.570942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:52.570942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:52.570942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:52.570942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:52.570942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:52.570942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:52.570942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:52.570942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:28:52.570942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:28:52.570942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:28:52.570942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:28:52.573461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:52.573461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:52.573461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:28:52.573461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:52.573461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:28:52.573461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:52.573461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:52.573461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:52.573461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:52.573461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:52.573461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:52.573461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:52.573461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:52.573461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:52.573461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:52.573461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:52.573461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:52.573461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:52.575764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:52.575764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:52.575764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:28:52.575764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:28:52.575764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:28:52.575764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:28:52.575764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:28:52.575764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:28:52.575764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:28:52.575764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:52.575764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 245/492] 10.222.0.110 () {56 vars in 1098 bytes} [Thu May 26 16:28:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:52.575764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3e490-be25-4fbd-80ea-4cff948f50b8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:52.582615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c0fe0174-715f-4d81-be86-f164e0719af7 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:52.582615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c0fe0174-715f-4d81-be86-f164e0719af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:52.632174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:52.666830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 248/493] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:52.667783 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe0174-715f-4d81-be86-f164e0719af7 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:52.684619 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3e490-be25-4fbd-80ea-4cff948f50b8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:52.722593 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1799e-5aac-4945-9445-5a2993807db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:52.722593 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1799e-5aac-4945-9445-5a2993807db7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:52.723052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1799e-5aac-4945-9445-5a2993807db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:52.726604 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1799e-5aac-4945-9445-5a2993807db7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:52.735000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1799e-5aac-4945-9445-5a2993807db7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:52.736808 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1799e-5aac-4945-9445-5a2993807db7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:52.755926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-76c1799e-5aac-4945-9445-5a2993807db7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:52.755926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:52.755926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:52.755926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:52.755926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:52.755926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:52.755926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:52.755926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:52.755926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:52.755926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:52.755926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:52.755926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:52.755926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:52.755926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:52.755926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:52.756804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:52.756804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:52.756804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:52.756804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:52.756804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:52.756804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:52.756804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:52.756804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:52.756804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:52.756804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:52.756804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:52.756804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:52.756804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:52.756804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:52.756804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:52.756804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:52.756804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:52.757620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:52.757620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:52.757620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:52.757620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:52.759873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 246/494] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:52.765109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1799e-5aac-4945-9445-5a2993807db7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:52.775509 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:52.805085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe0174-715f-4d81-be86-f164e0719af7 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:52.840408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66d979-0368-403f-baff-8186b6af3f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:52.841904 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66d979-0368-403f-baff-8186b6af3f34 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:52.842248 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66d979-0368-403f-baff-8186b6af3f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:52.842528 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66d979-0368-403f-baff-8186b6af3f34 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:52.844521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66d979-0368-403f-baff-8186b6af3f34 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:52.844521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66d979-0368-403f-baff-8186b6af3f34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:52.845182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66d979-0368-403f-baff-8186b6af3f34 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:52.872821 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1799e-5aac-4945-9445-5a2993807db7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:52.874777 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:52.884570 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 249/495] 10.222.0.110 () {56 vars in 1138 bytes} [Thu May 26 16:28:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:52.885917 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a777389-3ddb-4f36-b23c-8b431b572f20 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:52.886205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a777389-3ddb-4f36-b23c-8b431b572f20 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:52.886481 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a777389-3ddb-4f36-b23c-8b431b572f20 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:52.887887 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 250/496] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:52.888415 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a777389-3ddb-4f36-b23c-8b431b572f20 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:52.920612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4192398-4e83-480e-992b-3c3a5ca6f8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:52.921550 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4192398-4e83-480e-992b-3c3a5ca6f8eb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:52.921928 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4192398-4e83-480e-992b-3c3a5ca6f8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:52.922275 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4192398-4e83-480e-992b-3c3a5ca6f8eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:52.934586 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4192398-4e83-480e-992b-3c3a5ca6f8eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:52.943277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d4192398-4e83-480e-992b-3c3a5ca6f8eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:28:52.943277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:52.943277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:52.943277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:52.943277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:52.943277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:52.943277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:52.943277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:52.943277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:52.943277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:52.943277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:52.943277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:52.943277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:52.943277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:52.943277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:52.943277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:52.944255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:52.944255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:52.944255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:52.944255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:52.944255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:52.944255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:52.944255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:52.944255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:52.944255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:52.944255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:52.944255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:52.944255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:52.944255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:52.944255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:52.944255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:52.944255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:52.945068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:52.945068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:52.945068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:52.945068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:52.945068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:52.945068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:52.945068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:52.945068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:52.945068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:52.945068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:52.945068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:28:52.945068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:52.945068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 247/497] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:28:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:52.946410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4192398-4e83-480e-992b-3c3a5ca6f8eb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:53.012755 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a777389-3ddb-4f36-b23c-8b431b572f20 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:53.043642 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:53.049007 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30186b8d-1bb7-4a4d-89f9-9228202c700d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:53.049743 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30186b8d-1bb7-4a4d-89f9-9228202c700d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.050025 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30186b8d-1bb7-4a4d-89f9-9228202c700d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:53.050327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30186b8d-1bb7-4a4d-89f9-9228202c700d None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.051274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30186b8d-1bb7-4a4d-89f9-9228202c700d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:53.051583 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30186b8d-1bb7-4a4d-89f9-9228202c700d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:53.052559 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4192398-4e83-480e-992b-3c3a5ca6f8eb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:53.053017 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30186b8d-1bb7-4a4d-89f9-9228202c700d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:53.069865 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 251/498] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:28:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:53.069865 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cfd43-07d0-4eb8-b71c-5572e9829771 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.069865 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cfd43-07d0-4eb8-b71c-5572e9829771 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:53.069865 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cfd43-07d0-4eb8-b71c-5572e9829771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.090254 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-cb8cfd43-07d0-4eb8-b71c-5572e9829771 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:53.091571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cb8cfd43-07d0-4eb8-b71c-5572e9829771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:53.093000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f3728-7b45-4b91-9b46-f9fbb5da6d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:53.093771 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f3728-7b45-4b91-9b46-f9fbb5da6d22 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.094124 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f3728-7b45-4b91-9b46-f9fbb5da6d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:53.095008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f3728-7b45-4b91-9b46-f9fbb5da6d22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.128319 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:53.159467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 252/499] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:53.160863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cfd43-07d0-4eb8-b71c-5572e9829771 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:53.172218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f3728-7b45-4b91-9b46-f9fbb5da6d22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:53.173693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f3728-7b45-4b91-9b46-f9fbb5da6d22 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:53.261609 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cfd43-07d0-4eb8-b71c-5572e9829771 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:53.272747 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 248/500] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:52 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:53.273517 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f3728-7b45-4b91-9b46-f9fbb5da6d22 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:53.284298 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:53.296050 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7abb1-08dc-469e-b5d5-817aa91d20a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:53.296721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7abb1-08dc-469e-b5d5-817aa91d20a2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.297007 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7abb1-08dc-469e-b5d5-817aa91d20a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:53.297285 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7abb1-08dc-469e-b5d5-817aa91d20a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.298046 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7abb1-08dc-469e-b5d5-817aa91d20a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:53.298353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7abb1-08dc-469e-b5d5-817aa91d20a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:53.299751 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7abb1-08dc-469e-b5d5-817aa91d20a2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:53.308074 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 253/501] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:28:53 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:53.309886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d5d3-1200-42d9-97d9-aaf6e0415eff None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.309886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d5d3-1200-42d9-97d9-aaf6e0415eff None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:53.309886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d5d3-1200-42d9-97d9-aaf6e0415eff None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.315027 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 254/502] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:53 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:53.315848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d5d3-1200-42d9-97d9-aaf6e0415eff None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:53.337170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:53.379988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f3728-7b45-4b91-9b46-f9fbb5da6d22 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:53.414083 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52403b-8bb3-4747-a2dc-eda94bbce1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:53.414912 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52403b-8bb3-4747-a2dc-eda94bbce1fe None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.415197 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52403b-8bb3-4747-a2dc-eda94bbce1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:53.415470 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52403b-8bb3-4747-a2dc-eda94bbce1fe None admin] PATH_INFO: `/v3/users/glance` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.417240 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d5d3-1200-42d9-97d9-aaf6e0415eff None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:53.422421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52403b-8bb3-4747-a2dc-eda94bbce1fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:53.423900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52403b-8bb3-4747-a2dc-eda94bbce1fe None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:53.438450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3d52403b-8bb3-4747-a2dc-eda94bbce1fe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 16:28:53.438450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:53.438450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:53.438450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:53.438450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:53.438450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:53.438450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:53.438450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:53.438450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:53.438450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:53.438450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:53.438450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:53.438450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:28:53.438450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:28:53.438450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:28:53.438450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:28:53.439435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:53.439435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:53.439435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:28:53.439435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:53.439435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:28:53.439435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:53.439435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:53.439435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:53.439435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:53.439435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:53.439435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:53.439435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:53.439435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:53.439435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:53.439435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:53.439435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:53.439435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:53.439435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:53.440382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:53.440382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:53.440382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:28:53.440382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:28:53.440382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:28:53.440382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:28:53.440382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:28:53.440382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:28:53.440382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 16:28:53.440382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:53.440382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 249/503] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:53.440929 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52403b-8bb3-4747-a2dc-eda94bbce1fe None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:53.454823 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26b0b3-50d1-46ef-b8f9-9615fd375d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:53.455990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26b0b3-50d1-46ef-b8f9-9615fd375d85 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.456274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26b0b3-50d1-46ef-b8f9-9615fd375d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:53.456578 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26b0b3-50d1-46ef-b8f9-9615fd375d85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.468251 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26b0b3-50d1-46ef-b8f9-9615fd375d85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:53.476711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-7d26b0b3-50d1-46ef-b8f9-9615fd375d85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:28:53.476711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:53.476711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:53.476711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:53.476711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:53.476711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:53.476711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:53.476711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:53.476711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:53.476711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:53.476711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:53.476711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:53.476711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:53.476711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:53.476711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:53.476711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:53.477628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:53.477628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:53.477628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:53.477628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:53.477628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:53.477628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:53.477628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:53.477628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:53.477628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:53.477628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:53.477628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:53.477628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:53.477628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:53.477628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:53.477628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:53.477628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:53.478441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:53.478441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:53.478441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:53.478441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:53.478441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:53.478441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:53.478441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:53.478441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:53.478441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:53.478441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:53.478441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:28:53.478441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:53.478441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 255/504] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:28:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:53.479145 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26b0b3-50d1-46ef-b8f9-9615fd375d85 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:53.529425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:53.542053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52403b-8bb3-4747-a2dc-eda94bbce1fe None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:53.565358 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:53.577743 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdba01-5304-4e52-86d2-1c2522a14672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:53.578535 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdba01-5304-4e52-86d2-1c2522a14672 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.578904 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdba01-5304-4e52-86d2-1c2522a14672 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:53.579180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdba01-5304-4e52-86d2-1c2522a14672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.584218 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26b0b3-50d1-46ef-b8f9-9615fd375d85 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:53.590679 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdba01-5304-4e52-86d2-1c2522a14672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:53.592329 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdba01-5304-4e52-86d2-1c2522a14672 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:53.609921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a5fdba01-5304-4e52-86d2-1c2522a14672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:53.609921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:53.609921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:53.609921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:53.609921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:53.609921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:53.609921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:53.609921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:53.609921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:53.609921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:53.609921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:53.609921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:53.609921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:53.609921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:53.609921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:53.610978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:53.610978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:53.610978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:53.610978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:53.610978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:53.610978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:53.610978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:53.610978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:53.610978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:53.610978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:53.610978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:53.610978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:53.610978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:53.610978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:53.610978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:53.610978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:53.610978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:53.611881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:53.611881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:53.611881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:53.611881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:53.611881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 250/505] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:53.612571 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c56ad1-987b-4a38-a626-e5c075db1dea None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.612918 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c56ad1-987b-4a38-a626-e5c075db1dea None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:53.613203 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c56ad1-987b-4a38-a626-e5c075db1dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.619853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040cbcc-e1f8-4d52-bc44-495aef6266d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:53.620654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040cbcc-e1f8-4d52-bc44-495aef6266d7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.620937 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040cbcc-e1f8-4d52-bc44-495aef6266d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:53.621215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040cbcc-e1f8-4d52-bc44-495aef6266d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.630037 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-58c56ad1-987b-4a38-a626-e5c075db1dea None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:53.631267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-58c56ad1-987b-4a38-a626-e5c075db1dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:53.632052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040cbcc-e1f8-4d52-bc44-495aef6266d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:53.633485 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040cbcc-e1f8-4d52-bc44-495aef6266d7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:53.650907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-f040cbcc-e1f8-4d52-bc44-495aef6266d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:53.650907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:53.650907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:53.650907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:53.650907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:53.650907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:53.650907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:53.650907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:53.650907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:53.650907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:53.650907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:53.650907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:53.650907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:53.650907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:53.650907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:53.651784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:53.651784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:53.651784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:53.651784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:53.651784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:53.651784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:53.651784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:53.651784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:53.651784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:53.651784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:53.651784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:53.651784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:53.651784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:53.651784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:53.651784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:53.651784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:53.651784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:53.652615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:53.652615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:53.652615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:53.652615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:53.652615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 256/506] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:53.652878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040cbcc-e1f8-4d52-bc44-495aef6266d7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:53.710658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 251/507] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:53.710658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c56ad1-987b-4a38-a626-e5c075db1dea None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:53.751687 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:53.758577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040cbcc-e1f8-4d52-bc44-495aef6266d7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:53.792642 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d90ef5-1f79-4d5f-a760-3b60a2f84179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:53.793233 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d90ef5-1f79-4d5f-a760-3b60a2f84179 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.793515 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d90ef5-1f79-4d5f-a760-3b60a2f84179 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:53.793793 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d90ef5-1f79-4d5f-a760-3b60a2f84179 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.794640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d90ef5-1f79-4d5f-a760-3b60a2f84179 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:53.794954 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d90ef5-1f79-4d5f-a760-3b60a2f84179 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:53.796377 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d90ef5-1f79-4d5f-a760-3b60a2f84179 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:53.808248 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c56ad1-987b-4a38-a626-e5c075db1dea None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:53.810530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:53.815296 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 257/508] 10.222.0.110 () {56 vars in 1142 bytes} [Thu May 26 16:28:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:53.816364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d90ef5-1f79-4d5f-a760-3b60a2f84179 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:53.850044 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2856f9-2715-423c-abc0-254b85370078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:53.850745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2856f9-2715-423c-abc0-254b85370078 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.851035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2856f9-2715-423c-abc0-254b85370078 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:53.851308 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2856f9-2715-423c-abc0-254b85370078 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.852040 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2856f9-2715-423c-abc0-254b85370078 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:53.852346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2856f9-2715-423c-abc0-254b85370078 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:53.853707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2856f9-2715-423c-abc0-254b85370078 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:53.862212 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 252/509] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:28:53 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:53.862836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2856f9-2715-423c-abc0-254b85370078 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:53.916489 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d90ef5-1f79-4d5f-a760-3b60a2f84179 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:53.949806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca7de0-77ce-44b6-8457-e608c616213d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:53.950478 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca7de0-77ce-44b6-8457-e608c616213d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.950789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca7de0-77ce-44b6-8457-e608c616213d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:53.951069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca7de0-77ce-44b6-8457-e608c616213d None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.951794 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca7de0-77ce-44b6-8457-e608c616213d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:53.952100 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca7de0-77ce-44b6-8457-e608c616213d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:53.953467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca7de0-77ce-44b6-8457-e608c616213d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:53.964440 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2856f9-2715-423c-abc0-254b85370078 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:53.965388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 258/510] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:28:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:53.966191 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca7de0-77ce-44b6-8457-e608c616213d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:53.982700 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:53.998439 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc07f5-6739-4851-9621-20de5c67f8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:53.999331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc07f5-6739-4851-9621-20de5c67f8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.999870 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc07f5-6739-4851-9621-20de5c67f8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:54.000147 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc07f5-6739-4851-9621-20de5c67f8f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:54.000869 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc07f5-6739-4851-9621-20de5c67f8f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:54.001181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc07f5-6739-4851-9621-20de5c67f8f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:54.002558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc07f5-6739-4851-9621-20de5c67f8f6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:54.014549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 253/511] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:28:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:54.015366 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc07f5-6739-4851-9621-20de5c67f8f6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:54.043623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:54.069036 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca7de0-77ce-44b6-8457-e608c616213d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:54.101862 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7698f5-38ef-4c84-b78f-28009e40dcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:54.102699 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7698f5-38ef-4c84-b78f-28009e40dcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:54.102975 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7698f5-38ef-4c84-b78f-28009e40dcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:54.103442 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7698f5-38ef-4c84-b78f-28009e40dcf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:54.115180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7698f5-38ef-4c84-b78f-28009e40dcf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:54.116809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7698f5-38ef-4c84-b78f-28009e40dcf4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:54.118945 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc07f5-6739-4851-9621-20de5c67f8f6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:54.135701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-af7698f5-38ef-4c84-b78f-28009e40dcf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:54.135701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:54.135701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:54.135701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:54.135701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:54.135701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:54.135701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:54.135701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:54.135701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:54.135701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:54.135701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:54.135701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:54.135701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:54.135701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:54.135701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:54.136585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:54.136585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:54.136585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:54.136585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:54.136585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:54.136585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:54.136585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:54.136585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:54.136585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:54.136585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:54.136585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:54.136585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:54.136585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:54.136585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:54.136585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:54.136585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:54.136585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:54.137428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:54.137428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:54.137428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:54.137428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:54.137428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 259/512] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:54.137691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7698f5-38ef-4c84-b78f-28009e40dcf4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:54.153039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90534b5-6d4c-4ee0-b923-0b295118c5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:54.153690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90534b5-6d4c-4ee0-b923-0b295118c5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:54.153977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90534b5-6d4c-4ee0-b923-0b295118c5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:54.154254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90534b5-6d4c-4ee0-b923-0b295118c5f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:54.208344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:54.223270 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90534b5-6d4c-4ee0-b923-0b295118c5f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:54.224736 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90534b5-6d4c-4ee0-b923-0b295118c5f1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:54.243630 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7698f5-38ef-4c84-b78f-28009e40dcf4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:54.251433 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:54.278626 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601577c4-a723-4e0e-b3bf-01f2990cece6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:54.279424 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601577c4-a723-4e0e-b3bf-01f2990cece6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:54.279717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601577c4-a723-4e0e-b3bf-01f2990cece6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:54.279995 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601577c4-a723-4e0e-b3bf-01f2990cece6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:54.291141 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601577c4-a723-4e0e-b3bf-01f2990cece6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:54.292586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601577c4-a723-4e0e-b3bf-01f2990cece6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:54.309739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-601577c4-a723-4e0e-b3bf-01f2990cece6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:54.309739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:54.309739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:54.309739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:54.309739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:54.309739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:54.309739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:54.309739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:54.309739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:54.309739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:54.309739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:54.309739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:54.309739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:54.309739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:54.309739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:54.310667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:54.310667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:54.310667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:54.310667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:54.310667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:54.310667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:54.310667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:54.310667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:54.310667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:54.310667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:54.310667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:54.310667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:54.310667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:54.310667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:54.310667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:54.310667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:54.310667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:54.311507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:54.311507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:54.311507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:54.311507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:54.311507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 260/513] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:54.311793 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601577c4-a723-4e0e-b3bf-01f2990cece6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:54.325153 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 254/514] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:54 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:54.325988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90534b5-6d4c-4ee0-b923-0b295118c5f1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:54.421351 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601577c4-a723-4e0e-b3bf-01f2990cece6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:54.426120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90534b5-6d4c-4ee0-b923-0b295118c5f1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:54.437818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:54.452223 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:54.455938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e13f9-f683-49fb-8360-9c74c82468f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:54.456783 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e13f9-f683-49fb-8360-9c74c82468f5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:54.457193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e13f9-f683-49fb-8360-9c74c82468f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:54.457474 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e13f9-f683-49fb-8360-9c74c82468f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:54.460985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798b9b7-cf0c-4d39-b40b-e764cf44c96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:54.461783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798b9b7-cf0c-4d39-b40b-e764cf44c96f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:54.462070 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798b9b7-cf0c-4d39-b40b-e764cf44c96f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:54.462346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798b9b7-cf0c-4d39-b40b-e764cf44c96f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:54.465000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e13f9-f683-49fb-8360-9c74c82468f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:54.466533 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e13f9-f683-49fb-8360-9c74c82468f5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:54.469390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798b9b7-cf0c-4d39-b40b-e764cf44c96f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:54.470860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798b9b7-cf0c-4d39-b40b-e764cf44c96f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:54.482853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-189e13f9-f683-49fb-8360-9c74c82468f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:28:54.482853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:54.482853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:54.482853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:54.482853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:54.482853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:54.482853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:54.482853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:54.482853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:54.482853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:54.482853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:54.482853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:54.482853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:28:54.482853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:28:54.482853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:28:54.483672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:28:54.483672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:54.483672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:54.483672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:54.483672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:54.483672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:54.483672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:54.483672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:54.483672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:54.483672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:54.483672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:54.483672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:54.483672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:54.483672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:54.483672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:54.483672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:54.483672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:54.484525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:28:54.484525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:28:54.484525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:28:54.484525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:28:54.484525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:28:54.484525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:28:54.484525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:28:54.484525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:54.484525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 261/515] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:28:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:54.484992 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e13f9-f683-49fb-8360-9c74c82468f5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:54.485819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f798b9b7-cf0c-4d39-b40b-e764cf44c96f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:28:54.485819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:54.485819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:54.485819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:54.485819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:54.485819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:54.485819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:54.485819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:54.485819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:54.485819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:54.485819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:54.485819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:54.485819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:28:54.485819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:28:54.485819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:28:54.485819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:28:54.486849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:54.486849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:54.486849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:28:54.486849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:54.486849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:28:54.486849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:54.486849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:54.486849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:54.486849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:54.486849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:54.486849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:54.486849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:54.486849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:54.486849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:54.486849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:54.486849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:54.486849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:54.486849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:54.487748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:54.487748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:54.487748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:28:54.487748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:28:54.487748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:28:54.487748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:28:54.487748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:28:54.487748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:28:54.487748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:28:54.487748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:54.487748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 255/516] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:28:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:54.489053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798b9b7-cf0c-4d39-b40b-e764cf44c96f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:54.588515 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798b9b7-cf0c-4d39-b40b-e764cf44c96f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:54.590170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e13f9-f683-49fb-8360-9c74c82468f5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:54.621550 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c63b5-708a-4327-bdda-1243b894c3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:54.622220 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c63b5-708a-4327-bdda-1243b894c3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:54.622504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c63b5-708a-4327-bdda-1243b894c3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:54.622812 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c63b5-708a-4327-bdda-1243b894c3b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:54.623527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c63b5-708a-4327-bdda-1243b894c3b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:54.623617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b78589-1940-445e-90a3-f1902ea6626e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:54.623836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c63b5-708a-4327-bdda-1243b894c3b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:54.624269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b78589-1940-445e-90a3-f1902ea6626e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:54.624810 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b78589-1940-445e-90a3-f1902ea6626e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:54.625087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b78589-1940-445e-90a3-f1902ea6626e None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:54.625439 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c63b5-708a-4327-bdda-1243b894c3b1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:54.625797 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b78589-1940-445e-90a3-f1902ea6626e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:54.626109 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b78589-1940-445e-90a3-f1902ea6626e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:54.627503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b78589-1940-445e-90a3-f1902ea6626e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:54.637599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 256/517] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:28:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:54.638388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c63b5-708a-4327-bdda-1243b894c3b1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:54.643581 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 262/518] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:28:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:54.643581 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b78589-1940-445e-90a3-f1902ea6626e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:54.681558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:54.686718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:54.741317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c63b5-708a-4327-bdda-1243b894c3b1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:54.741532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b78589-1940-445e-90a3-f1902ea6626e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:54.774767 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1265f70-95cc-43a7-ae5a-1367f6575b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:54.775428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1265f70-95cc-43a7-ae5a-1367f6575b51 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:54.775561 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64ae53-ad3a-496a-b6fc-fcfdafcb73ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:54.775718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1265f70-95cc-43a7-ae5a-1367f6575b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:54.775997 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1265f70-95cc-43a7-ae5a-1367f6575b51 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:54.776256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64ae53-ad3a-496a-b6fc-fcfdafcb73ef None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:54.776545 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64ae53-ad3a-496a-b6fc-fcfdafcb73ef None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:54.776778 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1265f70-95cc-43a7-ae5a-1367f6575b51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:54.776885 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64ae53-ad3a-496a-b6fc-fcfdafcb73ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:54.777091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1265f70-95cc-43a7-ae5a-1367f6575b51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:54.778536 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1265f70-95cc-43a7-ae5a-1367f6575b51 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:54.788230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64ae53-ad3a-496a-b6fc-fcfdafcb73ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:54.789786 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64ae53-ad3a-496a-b6fc-fcfdafcb73ef None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:54.796328 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 263/519] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:28:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:54.797121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1265f70-95cc-43a7-ae5a-1367f6575b51 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:54.807617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3a64ae53-ad3a-496a-b6fc-fcfdafcb73ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:54.807617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:54.807617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:54.807617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:54.807617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:54.807617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:54.807617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:54.807617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:54.807617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:54.807617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:54.807617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:54.807617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:54.807617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:54.807617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:54.807617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:54.808644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:54.808644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:54.808644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:54.808644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:54.808644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:54.808644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:54.808644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:54.808644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:54.808644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:54.808644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:54.808644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:54.808644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:54.808644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:54.808644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:54.808644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:54.808644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:54.808644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:54.809662 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:54.809662 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:54.809662 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:54.809662 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:54.809662 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 257/520] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:54.809662 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64ae53-ad3a-496a-b6fc-fcfdafcb73ef None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:54.897040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:54.901240 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1265f70-95cc-43a7-ae5a-1367f6575b51 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:54.912233 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:54.916576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64ae53-ad3a-496a-b6fc-fcfdafcb73ef None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:54.935299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55808414-3a54-41f1-bb1d-5ce36099c30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:54.935964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55808414-3a54-41f1-bb1d-5ce36099c30a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:54.936250 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55808414-3a54-41f1-bb1d-5ce36099c30a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:54.936528 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55808414-3a54-41f1-bb1d-5ce36099c30a None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:54.937366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55808414-3a54-41f1-bb1d-5ce36099c30a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:54.937686 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55808414-3a54-41f1-bb1d-5ce36099c30a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:54.939158 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55808414-3a54-41f1-bb1d-5ce36099c30a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:54.951305 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea656b61-f092-402b-8023-417304bc2fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:54.952100 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea656b61-f092-402b-8023-417304bc2fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:54.952382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea656b61-f092-402b-8023-417304bc2fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:54.952660 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea656b61-f092-402b-8023-417304bc2fe3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:54.956039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 264/521] 10.222.0.110 () {56 vars in 1142 bytes} [Thu May 26 16:28:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:54.957389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55808414-3a54-41f1-bb1d-5ce36099c30a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:54.961866 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea656b61-f092-402b-8023-417304bc2fe3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:54.963358 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea656b61-f092-402b-8023-417304bc2fe3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:54.978344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ea656b61-f092-402b-8023-417304bc2fe3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:28:54.978344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:54.978344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:54.978344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:54.978344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:54.978344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:54.978344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:54.978344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:54.978344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:54.978344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:54.978344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:54.978344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:54.978344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:28:54.978344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:28:54.978344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:28:54.978344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:28:54.979258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:54.979258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:54.979258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:28:54.979258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:54.979258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:28:54.979258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:54.979258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:54.979258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:54.979258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:54.979258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:54.979258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:54.979258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:54.979258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:54.979258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:54.979258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:54.979258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:54.979258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:54.979258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:54.980184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:54.980184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:54.980184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:28:54.980184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:28:54.980184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:28:54.980184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:28:54.980184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:28:54.980184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:28:54.980184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:28:54.980184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:54.980184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 258/522] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:28:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:54.980733 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea656b61-f092-402b-8023-417304bc2fe3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:55.061965 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55808414-3a54-41f1-bb1d-5ce36099c30a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:55.078666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea656b61-f092-402b-8023-417304bc2fe3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:55.094934 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba4475-9684-4731-bc2d-e313a8b5992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:55.095595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba4475-9684-4731-bc2d-e313a8b5992d None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:55.095882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba4475-9684-4731-bc2d-e313a8b5992d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:55.096155 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba4475-9684-4731-bc2d-e313a8b5992d None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:55.096848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba4475-9684-4731-bc2d-e313a8b5992d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:55.098378 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba4475-9684-4731-bc2d-e313a8b5992d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:55.113633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644865e-4036-451b-9c8d-e84909029e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:55.114605 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644865e-4036-451b-9c8d-e84909029e23 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:55.114850 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644865e-4036-451b-9c8d-e84909029e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:55.115115 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644865e-4036-451b-9c8d-e84909029e23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:55.116110 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644865e-4036-451b-9c8d-e84909029e23 None admin] RBAC: Adding query filter params (role.id=a21e569e87fa4cb7bfb252986942b9ab, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=0043a7d5877f41de905afe6bef355867) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:55.116453 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644865e-4036-451b-9c8d-e84909029e23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:55.117906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644865e-4036-451b-9c8d-e84909029e23 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:55.119344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 265/523] 10.222.0.110 () {60 vars in 1137 bytes} [Thu May 26 16:28:54 2022] POST /identity/v3/users => generated 248 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:55.120322 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba4475-9684-4731-bc2d-e313a8b5992d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:55.123818 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 259/524] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:28:54 2022] GET /identity/v3/role_assignments?user.id=0043a7d5877f41de905afe6bef355867&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=a21e569e87fa4cb7bfb252986942b9ab => generated 260 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:55.124917 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644865e-4036-451b-9c8d-e84909029e23 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:55.155971 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:55.165564 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:55.262108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644865e-4036-451b-9c8d-e84909029e23 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:55.303564 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba4475-9684-4731-bc2d-e313a8b5992d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:55.314996 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6907351-cb6e-4feb-a83e-41aa8f370811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:55.315963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6907351-cb6e-4feb-a83e-41aa8f370811 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:55.316988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6907351-cb6e-4feb-a83e-41aa8f370811 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:55.318116 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6907351-cb6e-4feb-a83e-41aa8f370811 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:55.352989 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48a891-cc34-4a14-bede-20cfbb9f15ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:55.353657 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48a891-cc34-4a14-bede-20cfbb9f15ce None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:55.353941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48a891-cc34-4a14-bede-20cfbb9f15ce None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:55.354227 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48a891-cc34-4a14-bede-20cfbb9f15ce None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:55.355027 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48a891-cc34-4a14-bede-20cfbb9f15ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:55.355337 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48a891-cc34-4a14-bede-20cfbb9f15ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:55.356739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48a891-cc34-4a14-bede-20cfbb9f15ce None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:55.374065 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 266/525] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:28:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:55.380024 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48a891-cc34-4a14-bede-20cfbb9f15ce None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:55.413787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6907351-cb6e-4feb-a83e-41aa8f370811 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:55.415689 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6907351-cb6e-4feb-a83e-41aa8f370811 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:55.448270 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:55.460496 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:55.499841 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48a891-cc34-4a14-bede-20cfbb9f15ce None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:55.544009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 260/526] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:55 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:55.545068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6907351-cb6e-4feb-a83e-41aa8f370811 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:55.548812 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adde169-98d0-4134-804b-046403687517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:55.549375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adde169-98d0-4134-804b-046403687517 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:55.549767 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adde169-98d0-4134-804b-046403687517 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:55.550201 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adde169-98d0-4134-804b-046403687517 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:55.551842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adde169-98d0-4134-804b-046403687517 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:55.552262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adde169-98d0-4134-804b-046403687517 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:55.553803 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adde169-98d0-4134-804b-046403687517 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:55.577164 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 267/527] 10.222.0.110 () {56 vars in 1144 bytes} [Thu May 26 16:28:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:55.578248 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adde169-98d0-4134-804b-046403687517 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:55.664635 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6907351-cb6e-4feb-a83e-41aa8f370811 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:55.685898 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adde169-98d0-4134-804b-046403687517 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:55.691051 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:55.702896 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf6460-755a-4b65-bf71-c91e01f654ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:55.703965 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf6460-755a-4b65-bf71-c91e01f654ee None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:55.704534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf6460-755a-4b65-bf71-c91e01f654ee None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:55.704970 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf6460-755a-4b65-bf71-c91e01f654ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:55.715009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf6460-755a-4b65-bf71-c91e01f654ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:55.717163 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf6460-755a-4b65-bf71-c91e01f654ee None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:55.717581 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:55.725355 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c5646-9df6-409f-a379-e2980d9eed9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:55.726308 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c5646-9df6-409f-a379-e2980d9eed9f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:55.726728 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c5646-9df6-409f-a379-e2980d9eed9f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:55.727105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c5646-9df6-409f-a379-e2980d9eed9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:55.735282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-2acf6460-755a-4b65-bf71-c91e01f654ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:28:55.735282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:55.735282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:55.735282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:55.735282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:55.735282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:55.735282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:55.735282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:55.735282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:55.735282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:55.735282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:55.735282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:55.735282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:28:55.735282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:28:55.735282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:28:55.736328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:28:55.736328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:55.736328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:55.736328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:55.736328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:55.736328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:55.736328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:55.736328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:55.736328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:55.736328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:55.736328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:55.736328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:55.736328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:55.736328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:55.736328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:55.736328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:55.736328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:55.737390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:28:55.737390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:28:55.737390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:28:55.737390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:28:55.737390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:28:55.737390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:28:55.737390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:28:55.737390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:55.740971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c5646-9df6-409f-a379-e2980d9eed9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:55.741136 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 261/528] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:28:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:55.742076 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf6460-755a-4b65-bf71-c91e01f654ee None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:55.746678 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c5646-9df6-409f-a379-e2980d9eed9f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:55.772193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-257c5646-9df6-409f-a379-e2980d9eed9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:55.772193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:55.772193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:55.772193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:55.772193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:55.772193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:55.772193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:55.772193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:55.772193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:55.772193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:55.772193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:55.772193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:55.772193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:55.772193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:55.772193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:55.773291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:55.773291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:55.773291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:55.773291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:55.773291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:55.773291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:55.773291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:55.773291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:55.773291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:55.773291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:55.773291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:55.773291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:55.773291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:55.773291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:55.773291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:55.773291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:55.773291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:55.774189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:55.774189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:55.774189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:55.774189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:55.776762 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 268/529] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:55.777794 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c5646-9df6-409f-a379-e2980d9eed9f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:55.874228 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf6460-755a-4b65-bf71-c91e01f654ee None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:55.900468 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c5646-9df6-409f-a379-e2980d9eed9f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:55.920192 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416e987-5a16-4fb7-909c-a6872e1f35a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:55.921080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416e987-5a16-4fb7-909c-a6872e1f35a7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:55.921536 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416e987-5a16-4fb7-909c-a6872e1f35a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:55.921963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416e987-5a16-4fb7-909c-a6872e1f35a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:55.944138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2a072-9737-47d3-9731-3cf7efaf7429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:55.945074 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2a072-9737-47d3-9731-3cf7efaf7429 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:55.945523 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2a072-9737-47d3-9731-3cf7efaf7429 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:55.945943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2a072-9737-47d3-9731-3cf7efaf7429 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:55.946938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2a072-9737-47d3-9731-3cf7efaf7429 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:55.947803 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2a072-9737-47d3-9731-3cf7efaf7429 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:55.949706 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2a072-9737-47d3-9731-3cf7efaf7429 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:55.971446 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 269/530] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:28:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:55.973599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2a072-9737-47d3-9731-3cf7efaf7429 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:55.990978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:56.000080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416e987-5a16-4fb7-909c-a6872e1f35a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:56.001888 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416e987-5a16-4fb7-909c-a6872e1f35a7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:56.033263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:56.105484 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2a072-9737-47d3-9731-3cf7efaf7429 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:56.118643 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 262/531] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:55 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:56.119722 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416e987-5a16-4fb7-909c-a6872e1f35a7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:56.153123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef383f32-781b-4c48-b1af-f694707405c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:56.154193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef383f32-781b-4c48-b1af-f694707405c2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:56.154965 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef383f32-781b-4c48-b1af-f694707405c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:56.155396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef383f32-781b-4c48-b1af-f694707405c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:56.156517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef383f32-781b-4c48-b1af-f694707405c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:56.157135 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef383f32-781b-4c48-b1af-f694707405c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:56.159267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef383f32-781b-4c48-b1af-f694707405c2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:56.177348 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 270/532] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:28:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:56.178393 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef383f32-781b-4c48-b1af-f694707405c2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:56.234995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:56.250639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416e987-5a16-4fb7-909c-a6872e1f35a7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:56.293626 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef383f32-781b-4c48-b1af-f694707405c2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:56.294448 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd826518-9304-4e91-9e24-f468f5245bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:56.295147 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd826518-9304-4e91-9e24-f468f5245bcf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:56.295498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd826518-9304-4e91-9e24-f468f5245bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:56.295787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd826518-9304-4e91-9e24-f468f5245bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:56.296795 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd826518-9304-4e91-9e24-f468f5245bcf None admin] RBAC: Adding query filter params (role.id=a21e569e87fa4cb7bfb252986942b9ab, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=363d16eebb3f40a1be71506961cc3c5e) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:56.297113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd826518-9304-4e91-9e24-f468f5245bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:56.299421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd826518-9304-4e91-9e24-f468f5245bcf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:56.310604 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 263/533] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:28:56 2022] GET /identity/v3/role_assignments?user.id=363d16eebb3f40a1be71506961cc3c5e&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=a21e569e87fa4cb7bfb252986942b9ab => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:56.310604 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd826518-9304-4e91-9e24-f468f5245bcf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:56.314617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:56.352149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9c261-e47f-4e1f-b0b7-289202ee5e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:56.352976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9c261-e47f-4e1f-b0b7-289202ee5e4b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:56.353264 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9c261-e47f-4e1f-b0b7-289202ee5e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:56.353544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9c261-e47f-4e1f-b0b7-289202ee5e4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:56.365698 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9c261-e47f-4e1f-b0b7-289202ee5e4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:56.367232 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9c261-e47f-4e1f-b0b7-289202ee5e4b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:56.387840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-ebb9c261-e47f-4e1f-b0b7-289202ee5e4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:56.387840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:56.387840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:56.387840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:56.387840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:56.387840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:56.387840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:56.387840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:56.387840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:56.387840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:56.387840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:56.387840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:56.387840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:56.387840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:56.387840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:56.388736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:56.388736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:56.388736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:56.388736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:56.388736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:56.388736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:56.388736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:56.388736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:56.388736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:56.388736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:56.388736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:56.388736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:56.388736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:56.388736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:56.388736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:56.388736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:56.388736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:56.389595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:56.389595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:56.389595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:56.389595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:56.393918 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 271/534] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:56.395738 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9c261-e47f-4e1f-b0b7-289202ee5e4b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:56.510237 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9c261-e47f-4e1f-b0b7-289202ee5e4b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:56.548981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec2ad8-2990-4d85-a7a1-bdf074e306d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:56.549660 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec2ad8-2990-4d85-a7a1-bdf074e306d5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:56.549951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec2ad8-2990-4d85-a7a1-bdf074e306d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:56.550321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec2ad8-2990-4d85-a7a1-bdf074e306d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:56.551709 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd826518-9304-4e91-9e24-f468f5245bcf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:56.552208 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec2ad8-2990-4d85-a7a1-bdf074e306d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:56.552208 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec2ad8-2990-4d85-a7a1-bdf074e306d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:56.553539 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec2ad8-2990-4d85-a7a1-bdf074e306d5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:56.570316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 272/535] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:28:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:56.572879 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec2ad8-2990-4d85-a7a1-bdf074e306d5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:56.602944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:56.622699 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc20e7-948a-4b04-957f-17b46b042959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:56.623566 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc20e7-948a-4b04-957f-17b46b042959 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:56.623853 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc20e7-948a-4b04-957f-17b46b042959 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:56.624131 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc20e7-948a-4b04-957f-17b46b042959 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:56.642165 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc20e7-948a-4b04-957f-17b46b042959 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:56.643856 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc20e7-948a-4b04-957f-17b46b042959 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:56.675456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-39cc20e7-948a-4b04-957f-17b46b042959 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:28:56.675456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:56.675456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:56.675456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:56.675456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:56.675456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:56.675456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:56.675456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:56.675456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:56.675456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:56.675456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:56.675456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:56.675456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:28:56.675456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:28:56.675456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:28:56.676386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:28:56.676386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:56.676386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:56.676386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:56.676386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:56.676386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:56.676386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:56.676386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:56.676386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:56.676386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:56.676386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:56.676386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:56.676386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:56.676386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:56.676386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:56.676386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:56.676386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:56.677297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:28:56.677297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:28:56.677297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:28:56.677297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:28:56.677297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:28:56.677297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:28:56.677297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:28:56.677297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:56.679808 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 264/536] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:28:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:56.685521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc20e7-948a-4b04-957f-17b46b042959 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:56.696234 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:56.758125 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec2ad8-2990-4d85-a7a1-bdf074e306d5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:56.831337 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fc76d-c025-494e-8ae7-9c5e655688e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:56.832113 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc76d-c025-494e-8ae7-9c5e655688e0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:56.832398 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc76d-c025-494e-8ae7-9c5e655688e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:56.832672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc76d-c025-494e-8ae7-9c5e655688e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:56.846210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fc76d-c025-494e-8ae7-9c5e655688e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:56.848372 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fc76d-c025-494e-8ae7-9c5e655688e0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:56.853844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc20e7-948a-4b04-957f-17b46b042959 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:56.877541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-1b7fc76d-c025-494e-8ae7-9c5e655688e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:28:56.877541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:56.877541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:56.877541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:56.877541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:56.877541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:56.877541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:56.877541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:56.877541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:56.877541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:56.877541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:56.877541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:56.877541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:28:56.877541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:28:56.877541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:28:56.878450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:28:56.878450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:56.878450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:56.878450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:56.878450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:56.878450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:56.878450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:56.878450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:56.878450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:56.878450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:56.878450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:56.878450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:56.878450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:56.878450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:56.878450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:56.878450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:56.878450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:56.879841 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:28:56.879841 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:28:56.879841 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:28:56.879841 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:28:56.879841 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:28:56.879841 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:28:56.879841 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:28:56.879841 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:56.888350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 273/537] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:28:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:56.893792 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fc76d-c025-494e-8ae7-9c5e655688e0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:56.927256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd9b04-30c8-4d6d-85f7-901b147b5393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:56.927936 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd9b04-30c8-4d6d-85f7-901b147b5393 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:56.928219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd9b04-30c8-4d6d-85f7-901b147b5393 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:56.928491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd9b04-30c8-4d6d-85f7-901b147b5393 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:56.929281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd9b04-30c8-4d6d-85f7-901b147b5393 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:56.929586 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd9b04-30c8-4d6d-85f7-901b147b5393 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:56.931065 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd9b04-30c8-4d6d-85f7-901b147b5393 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:56.969374 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 265/538] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:28:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:56.979585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd9b04-30c8-4d6d-85f7-901b147b5393 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:57.010978 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:57.034767 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fc76d-c025-494e-8ae7-9c5e655688e0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:57.072820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315bbcd-c75d-4549-b4bf-ccbf48aaa46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:57.073673 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315bbcd-c75d-4549-b4bf-ccbf48aaa46e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:57.074061 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315bbcd-c75d-4549-b4bf-ccbf48aaa46e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:57.074440 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315bbcd-c75d-4549-b4bf-ccbf48aaa46e None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:57.075358 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315bbcd-c75d-4549-b4bf-ccbf48aaa46e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:57.075770 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315bbcd-c75d-4549-b4bf-ccbf48aaa46e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:57.077311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315bbcd-c75d-4549-b4bf-ccbf48aaa46e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:57.090518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 274/539] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:28:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:57.099643 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315bbcd-c75d-4549-b4bf-ccbf48aaa46e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:57.123493 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:57.158697 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd9b04-30c8-4d6d-85f7-901b147b5393 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:57.243305 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc553f-5a43-456a-998b-c439202ef5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:57.243987 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc553f-5a43-456a-998b-c439202ef5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:57.244265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc553f-5a43-456a-998b-c439202ef5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:57.244541 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc553f-5a43-456a-998b-c439202ef5d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:57.245373 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc553f-5a43-456a-998b-c439202ef5d5 None admin] RBAC: Adding query filter params (role.id=a21e569e87fa4cb7bfb252986942b9ab, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=7ac42de1401441c0a3d4e7239e9b020e) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:57.245684 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc553f-5a43-456a-998b-c439202ef5d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:57.247198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc553f-5a43-456a-998b-c439202ef5d5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:57.263385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 266/540] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:28:56 2022] GET /identity/v3/role_assignments?user.id=7ac42de1401441c0a3d4e7239e9b020e&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=a21e569e87fa4cb7bfb252986942b9ab => generated 260 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:57.273128 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315bbcd-c75d-4549-b4bf-ccbf48aaa46e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:57.310670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acb797-fc27-4477-b37b-8f6d6ff00599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:57.311612 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acb797-fc27-4477-b37b-8f6d6ff00599 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:57.312051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acb797-fc27-4477-b37b-8f6d6ff00599 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:57.312507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acb797-fc27-4477-b37b-8f6d6ff00599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:57.313538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acb797-fc27-4477-b37b-8f6d6ff00599 None admin] RBAC: Adding query filter params (role.id=a21e569e87fa4cb7bfb252986942b9ab, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=f2411c1c780449e1a24fecb747cc3761) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:57.314020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acb797-fc27-4477-b37b-8f6d6ff00599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:57.315775 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acb797-fc27-4477-b37b-8f6d6ff00599 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:57.325028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:57.327324 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 275/541] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:28:57 2022] GET /identity/v3/role_assignments?user.id=f2411c1c780449e1a24fecb747cc3761&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=a21e569e87fa4cb7bfb252986942b9ab => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:57.628471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2413cf-7be8-4349-b80a-9b9c1b5bf1e7 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:57.628989 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2413cf-7be8-4349-b80a-9b9c1b5bf1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:57.628989 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2413cf-7be8-4349-b80a-9b9c1b5bf1e7 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:57.630764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 267/542] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:57.636395 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52969b0-b9fe-41ef-b0c6-bbac45816574 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:57.636697 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52969b0-b9fe-41ef-b0c6-bbac45816574 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:57.636986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52969b0-b9fe-41ef-b0c6-bbac45816574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:57.640684 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441f894-efb3-4053-9191-347519148f83 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:57.641215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441f894-efb3-4053-9191-347519148f83 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:57.641711 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441f894-efb3-4053-9191-347519148f83 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:57.643633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 268/543] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:28:57.649401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ccc4e-c412-4523-bb61-843527684687 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:57.649942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ccc4e-c412-4523-bb61-843527684687 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:57.650427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ccc4e-c412-4523-bb61-843527684687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:57.655001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f52969b0-b9fe-41ef-b0c6-bbac45816574 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:57.656340 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f52969b0-b9fe-41ef-b0c6-bbac45816574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:57.669017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3f9ccc4e-c412-4523-bb61-843527684687 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:57.670512 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3f9ccc4e-c412-4523-bb61-843527684687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:57.732859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 276/544] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:57.758853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52969b0-b9fe-41ef-b0c6-bbac45816574 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:57.764363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 269/545] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:57.823100 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ccc4e-c412-4523-bb61-843527684687 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:57.932041 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:57.939893 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52969b0-b9fe-41ef-b0c6-bbac45816574 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:57.998350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:58.006593 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d247bb-ba06-4453-9685-bbc396a3b8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:58.008734 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d247bb-ba06-4453-9685-bbc396a3b8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:58.009027 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d247bb-ba06-4453-9685-bbc396a3b8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:58.009305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d247bb-ba06-4453-9685-bbc396a3b8f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:58.016933 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ccc4e-c412-4523-bb61-843527684687 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:58.034983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d247bb-ba06-4453-9685-bbc396a3b8f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:58.043754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-26d247bb-ba06-4453-9685-bbc396a3b8f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:28:58.043754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:58.043754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:58.043754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:58.043754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:58.043754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:58.043754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:58.043754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:58.043754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:58.043754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:58.043754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:58.043754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:58.043754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:58.043754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:58.043754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:58.043754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:58.045457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:58.045457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:58.045457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:58.045457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:58.045457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:58.045457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:58.045457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:58.045457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:58.045457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:58.045457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:58.045457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:58.045457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:58.045457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:58.045457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:58.045457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:58.045457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:58.047111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:58.047111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:58.047111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:58.047111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:58.047111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:58.047111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:58.047111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:58.047111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:58.047111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:58.047111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:58.047111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:28:58.047111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:58.047111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 277/546] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:28:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:58.061677 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d247bb-ba06-4453-9685-bbc396a3b8f2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:58.093416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed301512-3e63-48cb-82ac-1ccc2ad02d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:58.094238 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed301512-3e63-48cb-82ac-1ccc2ad02d56 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:58.094527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed301512-3e63-48cb-82ac-1ccc2ad02d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:58.094832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed301512-3e63-48cb-82ac-1ccc2ad02d56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:58.127190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed301512-3e63-48cb-82ac-1ccc2ad02d56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:58.135191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ed301512-3e63-48cb-82ac-1ccc2ad02d56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:28:58.135191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:58.135191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:58.135191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:58.135191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:58.135191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:58.135191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:58.135191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:58.135191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:58.135191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:58.135191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:58.135191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:58.135191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:58.135191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:58.135191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:58.135191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:58.137221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:58.137221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:58.137221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:58.137221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:58.137221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:58.137221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:58.137221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:58.137221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:58.137221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:58.137221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:58.137221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:58.137221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:58.137221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:58.137221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:58.137221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:58.137221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:58.139196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:58.139196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:58.139196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:58.139196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:58.139196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:58.139196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:58.139196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:58.139196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:58.139196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:58.139196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:58.139196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:28:58.139196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:58.139196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 270/547] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:28:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:58.147452 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed301512-3e63-48cb-82ac-1ccc2ad02d56 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:58.278280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d247bb-ba06-4453-9685-bbc396a3b8f2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:58.280540 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed301512-3e63-48cb-82ac-1ccc2ad02d56 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:58.304474 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:58.336067 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa39bb-74fc-4c62-affa-84058b5087ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:58.336754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa39bb-74fc-4c62-affa-84058b5087ce None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:58.337043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa39bb-74fc-4c62-affa-84058b5087ce None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:58.337325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa39bb-74fc-4c62-affa-84058b5087ce None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:58.338090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa39bb-74fc-4c62-affa-84058b5087ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:58.338406 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa39bb-74fc-4c62-affa-84058b5087ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:58.339836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa39bb-74fc-4c62-affa-84058b5087ce None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:58.354605 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c4288-04c7-4187-8285-995d9cf55231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:58.355303 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c4288-04c7-4187-8285-995d9cf55231 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:58.355592 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c4288-04c7-4187-8285-995d9cf55231 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:58.355873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c4288-04c7-4187-8285-995d9cf55231 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:58.359046 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c4288-04c7-4187-8285-995d9cf55231 None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:58.359046 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c4288-04c7-4187-8285-995d9cf55231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:58.359046 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c4288-04c7-4187-8285-995d9cf55231 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:58.366858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 271/548] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:28:58 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:58.379289 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 278/549] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:28:58 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:58.380704 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa39bb-74fc-4c62-affa-84058b5087ce None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:58.383504 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c4288-04c7-4187-8285-995d9cf55231 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:58.477260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:58.503020 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa39bb-74fc-4c62-affa-84058b5087ce None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:58.548577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f02f3-6083-476e-ac55-f07fcdedc516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:58.549309 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f02f3-6083-476e-ac55-f07fcdedc516 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:58.549599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f02f3-6083-476e-ac55-f07fcdedc516 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:58.550182 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f02f3-6083-476e-ac55-f07fcdedc516 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:58.573904 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f02f3-6083-476e-ac55-f07fcdedc516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:58.575408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f02f3-6083-476e-ac55-f07fcdedc516 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:58.591327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c4288-04c7-4187-8285-995d9cf55231 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:58.615864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8d0f02f3-6083-476e-ac55-f07fcdedc516 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:58.615864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:58.615864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:58.615864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:58.615864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:58.615864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:58.615864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:58.615864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:58.615864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:58.615864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:58.615864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:58.615864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:58.615864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:58.615864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:58.615864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:58.616997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:58.616997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:58.616997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:58.616997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:58.616997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:58.616997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:58.616997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:58.616997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:58.616997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:58.616997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:58.616997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:58.616997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:58.616997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:58.616997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:58.616997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:58.616997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:58.616997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:58.618410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:58.618410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:58.618410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:58.618410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:58.618410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 272/550] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:58.625054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f02f3-6083-476e-ac55-f07fcdedc516 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:58.654022 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa0259-ef08-4cea-8cff-2215d8276ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:58.654879 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa0259-ef08-4cea-8cff-2215d8276ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:58.655169 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa0259-ef08-4cea-8cff-2215d8276ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:58.655451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa0259-ef08-4cea-8cff-2215d8276ed2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:58.674076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa0259-ef08-4cea-8cff-2215d8276ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:58.676143 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa0259-ef08-4cea-8cff-2215d8276ed2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:58.711823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:58.720791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-74aa0259-ef08-4cea-8cff-2215d8276ed2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:58.720791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:58.720791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:58.720791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:58.720791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:58.720791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:58.720791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:58.720791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:58.720791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:58.720791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:58.720791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:58.720791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:58.720791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:58.720791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:58.720791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:58.721693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:58.721693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:58.721693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:58.721693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:58.721693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:58.721693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:58.721693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:58.721693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:58.721693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:58.721693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:58.721693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:58.721693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:58.721693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:58.721693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:58.721693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:58.721693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:58.721693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:58.722776 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:58.722776 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:58.722776 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:58.722776 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:58.732650 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 279/551] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:58.736403 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa0259-ef08-4cea-8cff-2215d8276ed2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:58.849414 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f02f3-6083-476e-ac55-f07fcdedc516 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:58.900710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb38ca-4031-4ffc-a30e-603a2c526842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:58.901384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb38ca-4031-4ffc-a30e-603a2c526842 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:58.901673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb38ca-4031-4ffc-a30e-603a2c526842 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:58.901952 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb38ca-4031-4ffc-a30e-603a2c526842 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:58.902700 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb38ca-4031-4ffc-a30e-603a2c526842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:58.903011 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb38ca-4031-4ffc-a30e-603a2c526842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:58.904393 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb38ca-4031-4ffc-a30e-603a2c526842 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:58.910837 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa0259-ef08-4cea-8cff-2215d8276ed2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:58.913903 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:58.922519 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 273/552] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:28:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:58.923746 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a8fd3-1809-4d1b-9b25-826fb362ed91 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:58.924133 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a8fd3-1809-4d1b-9b25-826fb362ed91 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:58.924318 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a8fd3-1809-4d1b-9b25-826fb362ed91 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:58.929738 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 274/553] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:58.930507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a8fd3-1809-4d1b-9b25-826fb362ed91 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:58.960456 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115ecae-b3bd-46bc-96ef-a80f6560af82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:58.961703 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115ecae-b3bd-46bc-96ef-a80f6560af82 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:58.962593 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115ecae-b3bd-46bc-96ef-a80f6560af82 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:58.963370 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115ecae-b3bd-46bc-96ef-a80f6560af82 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:58.964543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115ecae-b3bd-46bc-96ef-a80f6560af82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:58.965452 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115ecae-b3bd-46bc-96ef-a80f6560af82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:58.967631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115ecae-b3bd-46bc-96ef-a80f6560af82 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:58.990749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 280/554] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:28:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:58.990749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6ec83-19aa-481c-b830-c90facd0edb1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:58.990749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6ec83-19aa-481c-b830-c90facd0edb1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:58.990749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6ec83-19aa-481c-b830-c90facd0edb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:59.005990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-09c6ec83-19aa-481c-b830-c90facd0edb1 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:59.007276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-09c6ec83-19aa-481c-b830-c90facd0edb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:59.043965 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:59.055203 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a8fd3-1809-4d1b-9b25-826fb362ed91 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:59.098716 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 281/555] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:28:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:59.099710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6ec83-19aa-481c-b830-c90facd0edb1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:59.100755 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cced3-d4b6-4409-9e3f-dec25a2f50d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:59.102225 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cced3-d4b6-4409-9e3f-dec25a2f50d3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:59.102759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cced3-d4b6-4409-9e3f-dec25a2f50d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:59.104162 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cced3-d4b6-4409-9e3f-dec25a2f50d3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:59.112731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312cced3-d4b6-4409-9e3f-dec25a2f50d3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:59.115175 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312cced3-d4b6-4409-9e3f-dec25a2f50d3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:59.132464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-312cced3-d4b6-4409-9e3f-dec25a2f50d3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:28:59.132464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:59.132464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:59.132464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:59.132464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:59.132464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:59.132464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:59.132464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:59.132464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:59.132464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:59.132464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:59.132464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:59.132464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:28:59.132464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:28:59.132464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:28:59.132464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:28:59.133426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:59.133426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:59.133426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:28:59.133426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:59.133426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:28:59.133426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:59.133426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:59.133426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:59.133426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:59.133426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:59.133426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:59.133426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:59.133426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:59.133426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:59.133426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:59.133426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:59.133426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:59.133426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:59.134323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:59.134323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:59.134323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:28:59.134323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:28:59.134323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:28:59.134323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:28:59.134323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:28:59.134323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:28:59.134323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:28:59.134323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:59.137036 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 275/556] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:28:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:59.142840 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cced3-d4b6-4409-9e3f-dec25a2f50d3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:59.219773 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:59.229768 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6ec83-19aa-481c-b830-c90facd0edb1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:59.258122 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cced3-d4b6-4409-9e3f-dec25a2f50d3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:59.266206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5795896-2bd8-4020-a2f6-56666a0cc3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:59.267046 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5795896-2bd8-4020-a2f6-56666a0cc3ff None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:59.267337 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5795896-2bd8-4020-a2f6-56666a0cc3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:59.267621 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5795896-2bd8-4020-a2f6-56666a0cc3ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:59.275810 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5795896-2bd8-4020-a2f6-56666a0cc3ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:59.277286 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5795896-2bd8-4020-a2f6-56666a0cc3ff None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:59.293301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-a5795896-2bd8-4020-a2f6-56666a0cc3ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:28:59.293301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:59.293301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:59.293301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:59.293301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:59.293301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:59.293301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:59.293301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:59.293301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:59.293301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:59.293301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:59.293301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:59.293301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:28:59.293301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:28:59.293301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:28:59.293301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:28:59.294375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:59.294375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:59.294375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:28:59.294375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:59.294375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:28:59.294375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:59.294375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:59.294375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:59.294375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:59.294375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:59.294375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:59.294375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:59.294375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:59.294375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:59.294375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:59.294375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:59.294375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:59.294375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:59.295756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:59.295756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:59.295756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:28:59.295756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:28:59.295756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:28:59.295756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:28:59.295756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:28:59.295756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:28:59.295756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:28:59.295756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:59.299195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 282/557] 10.222.0.110 () {56 vars in 1098 bytes} [Thu May 26 16:28:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:59.300052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5795896-2bd8-4020-a2f6-56666a0cc3ff None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:59.303598 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715dcef-ff6d-4f07-aac2-d7de5454b628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:59.304656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715dcef-ff6d-4f07-aac2-d7de5454b628 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:59.305151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715dcef-ff6d-4f07-aac2-d7de5454b628 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:59.305635 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715dcef-ff6d-4f07-aac2-d7de5454b628 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:59.306716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715dcef-ff6d-4f07-aac2-d7de5454b628 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:59.307235 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715dcef-ff6d-4f07-aac2-d7de5454b628 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:59.308898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715dcef-ff6d-4f07-aac2-d7de5454b628 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:59.355219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 276/558] 10.222.0.110 () {56 vars in 1140 bytes} [Thu May 26 16:28:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:59.361851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715dcef-ff6d-4f07-aac2-d7de5454b628 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:59.384938 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:59.415704 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5795896-2bd8-4020-a2f6-56666a0cc3ff None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:59.454349 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dff85-f32f-41be-9cfa-44e9b2e9ae97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:59.455535 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dff85-f32f-41be-9cfa-44e9b2e9ae97 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:59.455735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dff85-f32f-41be-9cfa-44e9b2e9ae97 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:59.455994 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dff85-f32f-41be-9cfa-44e9b2e9ae97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:59.468293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51dff85-f32f-41be-9cfa-44e9b2e9ae97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:59.476966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-d51dff85-f32f-41be-9cfa-44e9b2e9ae97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:28:59.476966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:59.476966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:59.476966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:59.476966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:59.476966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:59.476966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:59.476966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:59.476966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:59.476966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:59.476966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:59.476966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:59.476966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:59.476966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:59.476966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:59.476966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:59.477980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:59.477980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:59.477980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:59.477980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:59.477980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:59.477980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:59.477980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:59.477980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:59.477980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:59.477980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:59.477980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:59.477980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:28:59.477980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:59.477980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:59.477980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:59.477980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:59.479321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:59.479321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:59.479321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:59.479321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:59.479321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:59.479321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:59.479321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:59.479321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:59.479321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:59.479321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:59.479321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:28:59.479321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:28:59.483197 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 283/559] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:28:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:59.484082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dff85-f32f-41be-9cfa-44e9b2e9ae97 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:59.485908 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715dcef-ff6d-4f07-aac2-d7de5454b628 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:59.501119 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:59.526199 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a544c-e9bd-45b3-8d11-65606af45769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:59.527287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a544c-e9bd-45b3-8d11-65606af45769 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:59.527789 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a544c-e9bd-45b3-8d11-65606af45769 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:59.528294 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a544c-e9bd-45b3-8d11-65606af45769 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:59.529460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a544c-e9bd-45b3-8d11-65606af45769 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:59.530003 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a544c-e9bd-45b3-8d11-65606af45769 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:59.531859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a544c-e9bd-45b3-8d11-65606af45769 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:59.555650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 277/560] 10.222.0.110 () {56 vars in 1138 bytes} [Thu May 26 16:28:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:59.557033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a544c-e9bd-45b3-8d11-65606af45769 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:59.606304 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dff85-f32f-41be-9cfa-44e9b2e9ae97 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:59.636823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:59.650729 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdd39b-a5d8-4865-8b5a-e9b4b6cbdcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:59.651900 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdd39b-a5d8-4865-8b5a-e9b4b6cbdcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:59.652512 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdd39b-a5d8-4865-8b5a-e9b4b6cbdcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:59.652982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdd39b-a5d8-4865-8b5a-e9b4b6cbdcf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:59.674165 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a544c-e9bd-45b3-8d11-65606af45769 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:59.712525 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b9bbb-d97c-4f48-a846-03188ebb2c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:59.714672 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b9bbb-d97c-4f48-a846-03188ebb2c89 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:59.715500 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b9bbb-d97c-4f48-a846-03188ebb2c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:59.716199 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b9bbb-d97c-4f48-a846-03188ebb2c89 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:59.717268 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b9bbb-d97c-4f48-a846-03188ebb2c89 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:59.717838 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b9bbb-d97c-4f48-a846-03188ebb2c89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:59.719538 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b9bbb-d97c-4f48-a846-03188ebb2c89 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:59.729034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdd39b-a5d8-4865-8b5a-e9b4b6cbdcf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:59.730587 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdd39b-a5d8-4865-8b5a-e9b4b6cbdcf3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:59.732273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 278/561] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:28:59 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:59.733794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b9bbb-d97c-4f48-a846-03188ebb2c89 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:59.750220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:59.847567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 284/562] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:28:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:59.847567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c176dc4-79d0-4382-a7dc-437277f6890f None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:59.847567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c176dc4-79d0-4382-a7dc-437277f6890f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:59.847915 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b9bbb-d97c-4f48-a846-03188ebb2c89 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:59.848004 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c176dc4-79d0-4382-a7dc-437277f6890f None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:59.848004 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 285/563] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:59.848004 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c176dc4-79d0-4382-a7dc-437277f6890f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:59.876730 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:59.882496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee34bec-5dcc-4185-97c0-b7ba53b3b7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:59.883394 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee34bec-5dcc-4185-97c0-b7ba53b3b7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:59.883716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee34bec-5dcc-4185-97c0-b7ba53b3b7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:59.883949 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee34bec-5dcc-4185-97c0-b7ba53b3b7e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:59.895111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee34bec-5dcc-4185-97c0-b7ba53b3b7e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:59.896555 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee34bec-5dcc-4185-97c0-b7ba53b3b7e2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:59.913549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3ee34bec-5dcc-4185-97c0-b7ba53b3b7e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:59.913549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:59.913549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:59.913549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:59.913549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:59.913549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:59.913549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:59.913549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:59.913549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:59.913549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:59.913549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:59.913549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:59.913549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:59.913549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:59.913549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:59.914637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:59.914637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:59.914637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:59.914637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:59.914637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:59.914637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:59.914637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:59.914637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:59.914637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:28:59.914637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:59.914637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:59.914637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:59.914637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:59.914637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:59.914637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:59.914637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:59.914637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:59.915731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:59.915731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:59.915731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:59.915731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:28:59.915731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 279/564] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:59.916068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ee7bc-bb8c-42ad-9c91-21ddcb8e8def None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:59.916203 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ee7bc-bb8c-42ad-9c91-21ddcb8e8def None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:59.916481 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ee7bc-bb8c-42ad-9c91-21ddcb8e8def None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:59.918604 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 280/565] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:28:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:59.918738 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ee7bc-bb8c-42ad-9c91-21ddcb8e8def None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:59.956429 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c176dc4-79d0-4382-a7dc-437277f6890f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:59.970300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:59.995913 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1534c22-f6d8-4d71-a8bc-06e21b200e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:59.996712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1534c22-f6d8-4d71-a8bc-06e21b200e71 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:59.997002 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1534c22-f6d8-4d71-a8bc-06e21b200e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:59.997284 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1534c22-f6d8-4d71-a8bc-06e21b200e71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.009175 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1534c22-f6d8-4d71-a8bc-06e21b200e71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:00.010638 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1534c22-f6d8-4d71-a8bc-06e21b200e71 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:00.021600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ee7bc-bb8c-42ad-9c91-21ddcb8e8def None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:00.028757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-c1534c22-f6d8-4d71-a8bc-06e21b200e71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:00.028757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:00.028757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:00.028757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:00.028757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:00.028757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:00.028757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:00.028757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:00.028757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:00.028757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:00.028757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:00.028757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:00.028757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:00.028757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:00.028757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:00.029737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:00.029737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:00.029737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:00.029737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:00.029737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:00.029737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:00.029737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:00.029737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:00.029737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:00.029737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:00.029737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:00.029737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:00.029737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:00.029737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:00.029737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:00.029737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:00.029737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:00.030931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:00.030931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:00.030931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:00.030931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:00.030931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 286/566] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:00.031305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cb2af-6d09-4b54-b23d-46632e1e8dcd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:00.031422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cb2af-6d09-4b54-b23d-46632e1e8dcd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:00.031701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cb2af-6d09-4b54-b23d-46632e1e8dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.047923 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2d5cb2af-6d09-4b54-b23d-46632e1e8dcd None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:00.049116 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2d5cb2af-6d09-4b54-b23d-46632e1e8dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:00.061082 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b172691-b28b-4f04-bddc-41c8bbfec8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:00.061930 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b172691-b28b-4f04-bddc-41c8bbfec8dd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:00.062209 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b172691-b28b-4f04-bddc-41c8bbfec8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:00.062482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b172691-b28b-4f04-bddc-41c8bbfec8dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.072362 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b172691-b28b-4f04-bddc-41c8bbfec8dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:00.073804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b172691-b28b-4f04-bddc-41c8bbfec8dd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:00.092262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3b172691-b28b-4f04-bddc-41c8bbfec8dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:00.092262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:00.092262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:00.092262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:00.092262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:00.092262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:00.092262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:00.092262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:00.092262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:00.092262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:00.092262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:00.092262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:00.092262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:00.092262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:00.092262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:00.093288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:00.093288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:00.093288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:00.093288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:00.093288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:00.093288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:00.093288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:00.093288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:00.093288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:00.093288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:00.093288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:00.093288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:00.093288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:00.093288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:00.093288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:00.093288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:00.093288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:00.094160 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:00.094160 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:00.094160 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:00.094160 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:00.094160 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 281/567] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:00.094449 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b172691-b28b-4f04-bddc-41c8bbfec8dd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:00.127875 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 287/568] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:00.129464 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839dd47-03f9-45cb-87b6-9b57da526ee8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:00.129762 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839dd47-03f9-45cb-87b6-9b57da526ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:00.130041 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839dd47-03f9-45cb-87b6-9b57da526ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.143198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:00.146378 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4839dd47-03f9-45cb-87b6-9b57da526ee8 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:00.147614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4839dd47-03f9-45cb-87b6-9b57da526ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:00.212974 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b172691-b28b-4f04-bddc-41c8bbfec8dd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:00.214661 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 288/569] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:00.218771 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839dd47-03f9-45cb-87b6-9b57da526ee8 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:00.242165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:00.248340 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384700d3-8e62-4277-b50a-8b3bfd22eec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:00.249013 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384700d3-8e62-4277-b50a-8b3bfd22eec1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:00.249554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384700d3-8e62-4277-b50a-8b3bfd22eec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:00.249841 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384700d3-8e62-4277-b50a-8b3bfd22eec1 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.250578 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384700d3-8e62-4277-b50a-8b3bfd22eec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:00.250985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384700d3-8e62-4277-b50a-8b3bfd22eec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:00.252360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384700d3-8e62-4277-b50a-8b3bfd22eec1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:00.264094 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 282/570] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:00.264897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384700d3-8e62-4277-b50a-8b3bfd22eec1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:00.319575 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839dd47-03f9-45cb-87b6-9b57da526ee8 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:00.353471 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95d23e-a7cf-4342-b84b-e4a447a92575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:00.354238 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95d23e-a7cf-4342-b84b-e4a447a92575 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:00.354529 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95d23e-a7cf-4342-b84b-e4a447a92575 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:00.354835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95d23e-a7cf-4342-b84b-e4a447a92575 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.355564 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95d23e-a7cf-4342-b84b-e4a447a92575 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:00.355883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95d23e-a7cf-4342-b84b-e4a447a92575 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:00.357270 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95d23e-a7cf-4342-b84b-e4a447a92575 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:00.360884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:00.368032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384700d3-8e62-4277-b50a-8b3bfd22eec1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:00.373645 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 289/571] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:00.374771 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95d23e-a7cf-4342-b84b-e4a447a92575 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:00.407053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deaac7b-d45b-4cd2-85e1-50984bf3dac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:00.407650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deaac7b-d45b-4cd2-85e1-50984bf3dac5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:00.407938 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deaac7b-d45b-4cd2-85e1-50984bf3dac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:00.408219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deaac7b-d45b-4cd2-85e1-50984bf3dac5 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.408941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deaac7b-d45b-4cd2-85e1-50984bf3dac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:00.409252 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deaac7b-d45b-4cd2-85e1-50984bf3dac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:00.411224 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deaac7b-d45b-4cd2-85e1-50984bf3dac5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:00.422858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 283/572] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:00.423635 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deaac7b-d45b-4cd2-85e1-50984bf3dac5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:00.459530 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:00.475940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95d23e-a7cf-4342-b84b-e4a447a92575 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:00.510493 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c14114-978b-4e73-870d-1d7306e28e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:00.511347 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c14114-978b-4e73-870d-1d7306e28e55 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:00.511633 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c14114-978b-4e73-870d-1d7306e28e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:00.511908 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c14114-978b-4e73-870d-1d7306e28e55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.522010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c14114-978b-4e73-870d-1d7306e28e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:00.526890 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deaac7b-d45b-4cd2-85e1-50984bf3dac5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:00.529718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-46c14114-978b-4e73-870d-1d7306e28e55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:00.529718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:00.529718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:00.529718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:00.529718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:00.529718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:00.529718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:00.529718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:00.529718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:00.529718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:00.529718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:00.529718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:00.529718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:00.529718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:00.529718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:00.529718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:00.530821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:00.530821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:00.530821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:00.530821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:00.530821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:00.530821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:00.530821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:00.530821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:00.530821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:00.530821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:00.530821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:00.530821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:00.530821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:00.530821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:00.530821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:00.530821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:00.531741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:00.531741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:00.531741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:00.531741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:00.531741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:00.531741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:00.531741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:00.531741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:00.531741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:00.531741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:00.531741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:00.531741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:00.531741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 290/573] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:29:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:00.531741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c14114-978b-4e73-870d-1d7306e28e55 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:00.563154 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb48afe-9a23-4c37-900f-51cc139ceb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:00.563955 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb48afe-9a23-4c37-900f-51cc139ceb2e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:00.564241 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb48afe-9a23-4c37-900f-51cc139ceb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:00.564514 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb48afe-9a23-4c37-900f-51cc139ceb2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.574437 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb48afe-9a23-4c37-900f-51cc139ceb2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:00.582272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4eb48afe-9a23-4c37-900f-51cc139ceb2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:00.582272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:00.582272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:00.582272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:00.582272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:00.582272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:00.582272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:00.582272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:00.582272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:00.582272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:00.582272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:00.582272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:00.582272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:00.582272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:00.582272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:00.582272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:00.583410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:00.583410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:00.583410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:00.583410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:00.583410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:00.583410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:00.583410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:00.583410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:00.583410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:00.583410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:00.583410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:00.583410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:00.583410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:00.583410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:00.583410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:00.583410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:00.584576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:00.584576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:00.584576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:00.584576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:00.584576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:00.584576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:00.584576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:00.584576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:00.584576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:00.584576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:00.584576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:00.584576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:00.584576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 284/574] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:29:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:00.584576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb48afe-9a23-4c37-900f-51cc139ceb2e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:00.602689 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:00.633968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c14114-978b-4e73-870d-1d7306e28e55 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:00.667057 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b46ad3-68fd-4bbe-8fa9-598e98b60525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:00.667777 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46ad3-68fd-4bbe-8fa9-598e98b60525 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:00.668062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46ad3-68fd-4bbe-8fa9-598e98b60525 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:00.668338 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46ad3-68fd-4bbe-8fa9-598e98b60525 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.675013 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b46ad3-68fd-4bbe-8fa9-598e98b60525 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:00.677079 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b46ad3-68fd-4bbe-8fa9-598e98b60525 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:00.688009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb48afe-9a23-4c37-900f-51cc139ceb2e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:00.691072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-f5b46ad3-68fd-4bbe-8fa9-598e98b60525 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:00.691072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:00.691072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:00.691072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:00.691072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:00.691072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:00.691072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:00.691072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:00.691072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:00.691072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:00.691072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:00.691072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:00.691072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:00.691072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:00.691072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:00.691944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:00.691944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:00.691944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:00.691944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:00.691944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:00.691944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:00.691944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:00.691944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:00.691944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:00.691944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:00.691944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:00.691944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:00.691944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:00.691944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:00.691944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:00.691944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:00.691944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:00.692806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:00.692806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:00.692806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:00.692806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:00.692806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:00.692806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:00.692806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:00.692806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:00.692806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 291/575] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:00.693942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b46ad3-68fd-4bbe-8fa9-598e98b60525 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:00.696487 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:00.724887 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cd4cd-bd08-4426-bb7c-4a2b730fdd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:00.725694 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cd4cd-bd08-4426-bb7c-4a2b730fdd9e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:00.725982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cd4cd-bd08-4426-bb7c-4a2b730fdd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:00.726264 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cd4cd-bd08-4426-bb7c-4a2b730fdd9e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.733798 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cd4cd-bd08-4426-bb7c-4a2b730fdd9e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:00.735362 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cd4cd-bd08-4426-bb7c-4a2b730fdd9e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:00.749966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8e1cd4cd-bd08-4426-bb7c-4a2b730fdd9e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 16:29:00.749966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:00.749966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:00.749966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:00.749966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:00.749966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:00.749966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:00.749966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:00.749966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:00.749966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:00.749966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:00.749966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:00.749966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:00.749966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:00.749966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:00.749966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:00.750967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:00.750967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:00.750967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:00.750967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:00.750967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:00.750967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:00.750967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:00.750967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:00.750967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:00.750967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:00.750967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:00.750967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:00.750967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:00.750967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:00.750967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:00.750967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:00.750967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:00.750967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:00.757446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:00.757446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:00.757446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:00.757446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:00.757446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:00.757446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:00.757446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:00.757446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:00.757446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 16:29:00.757446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:00.757446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 285/576] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:29:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:00.757446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cd4cd-bd08-4426-bb7c-4a2b730fdd9e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:00.793552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b46ad3-68fd-4bbe-8fa9-598e98b60525 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:00.828060 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904473a-c1ee-41fb-8569-24ade9b89829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:00.828853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904473a-c1ee-41fb-8569-24ade9b89829 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:00.829135 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904473a-c1ee-41fb-8569-24ade9b89829 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:00.829411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904473a-c1ee-41fb-8569-24ade9b89829 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.835409 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:00.836770 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904473a-c1ee-41fb-8569-24ade9b89829 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:00.838279 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904473a-c1ee-41fb-8569-24ade9b89829 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:00.852889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-4904473a-c1ee-41fb-8569-24ade9b89829 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:00.852889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:00.852889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:00.852889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:00.852889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:00.852889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:00.852889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:00.852889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:00.852889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:00.852889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:00.852889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:00.852889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:00.852889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:00.852889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:00.852889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:00.853822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:00.853822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:00.853822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:00.853822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:00.853822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:00.853822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:00.853822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:00.853822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:00.853822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:00.853822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:00.853822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:00.853822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:00.853822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:00.853822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:00.853822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:00.853822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:00.853822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:00.854944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:00.854944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:00.854944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:00.854944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:00.854944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:00.854944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:00.854944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:00.854944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:00.854944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 292/577] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:00.854944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904473a-c1ee-41fb-8569-24ade9b89829 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:00.862508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cd4cd-bd08-4426-bb7c-4a2b730fdd9e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:00.897416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0a356-b711-4346-babe-41d8d6ea4890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:00.898091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0a356-b711-4346-babe-41d8d6ea4890 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:00.898384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0a356-b711-4346-babe-41d8d6ea4890 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:00.898698 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0a356-b711-4346-babe-41d8d6ea4890 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.899447 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0a356-b711-4346-babe-41d8d6ea4890 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:00.899760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0a356-b711-4346-babe-41d8d6ea4890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:00.901132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0a356-b711-4346-babe-41d8d6ea4890 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:00.910281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 286/578] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:29:00 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:00.911110 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0a356-b711-4346-babe-41d8d6ea4890 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:00.916866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:00.954495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904473a-c1ee-41fb-8569-24ade9b89829 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:00.988121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43e768-ffb5-4707-8b5c-e05701d8ec9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:00.988790 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43e768-ffb5-4707-8b5c-e05701d8ec9d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:00.989075 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43e768-ffb5-4707-8b5c-e05701d8ec9d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:00.989350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43e768-ffb5-4707-8b5c-e05701d8ec9d None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.990097 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43e768-ffb5-4707-8b5c-e05701d8ec9d None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:00.990412 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43e768-ffb5-4707-8b5c-e05701d8ec9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:00.991805 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43e768-ffb5-4707-8b5c-e05701d8ec9d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:00.999986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 293/579] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:29:00 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:01.000767 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43e768-ffb5-4707-8b5c-e05701d8ec9d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:01.016802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0a356-b711-4346-babe-41d8d6ea4890 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:01.051157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c74b44-a89a-41aa-8109-c27e54390fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.051828 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c74b44-a89a-41aa-8109-c27e54390fbe None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.052120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c74b44-a89a-41aa-8109-c27e54390fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.052398 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c74b44-a89a-41aa-8109-c27e54390fbe None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.053183 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c74b44-a89a-41aa-8109-c27e54390fbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:01.053493 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c74b44-a89a-41aa-8109-c27e54390fbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:01.054951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c74b44-a89a-41aa-8109-c27e54390fbe None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:01.062072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:01.068210 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 287/580] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:01.069002 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c74b44-a89a-41aa-8109-c27e54390fbe None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:01.099050 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43e768-ffb5-4707-8b5c-e05701d8ec9d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:01.124641 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:01.133840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc321269-fb37-495e-9cba-05bcedfa5bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.134508 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc321269-fb37-495e-9cba-05bcedfa5bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.134823 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc321269-fb37-495e-9cba-05bcedfa5bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.135102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc321269-fb37-495e-9cba-05bcedfa5bc2 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.135933 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc321269-fb37-495e-9cba-05bcedfa5bc2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:01.136248 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc321269-fb37-495e-9cba-05bcedfa5bc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:01.137687 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc321269-fb37-495e-9cba-05bcedfa5bc2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:01.154991 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 294/581] 10.222.0.110 () {56 vars in 1142 bytes} [Thu May 26 16:29:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:01.155867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc321269-fb37-495e-9cba-05bcedfa5bc2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:01.174037 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c74b44-a89a-41aa-8109-c27e54390fbe None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:01.210252 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610f162-ec7d-4bc7-93d8-b826afc5cd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.210882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610f162-ec7d-4bc7-93d8-b826afc5cd6c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.211162 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610f162-ec7d-4bc7-93d8-b826afc5cd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.211439 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610f162-ec7d-4bc7-93d8-b826afc5cd6c None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.212214 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610f162-ec7d-4bc7-93d8-b826afc5cd6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:01.212527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610f162-ec7d-4bc7-93d8-b826afc5cd6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:01.213955 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610f162-ec7d-4bc7-93d8-b826afc5cd6c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:01.225685 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 288/582] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:01.226463 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610f162-ec7d-4bc7-93d8-b826afc5cd6c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:01.255281 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc321269-fb37-495e-9cba-05bcedfa5bc2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:01.283753 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:01.289903 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b212d-5d5c-44f1-8f54-b30aa657fad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.290743 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b212d-5d5c-44f1-8f54-b30aa657fad7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.291034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b212d-5d5c-44f1-8f54-b30aa657fad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.291313 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b212d-5d5c-44f1-8f54-b30aa657fad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.301555 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b212d-5d5c-44f1-8f54-b30aa657fad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:01.303057 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b212d-5d5c-44f1-8f54-b30aa657fad7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:01.321299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-685b212d-5d5c-44f1-8f54-b30aa657fad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:01.321299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:01.321299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:01.321299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:01.321299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:01.321299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:01.321299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:01.321299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:01.321299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:01.321299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:01.321299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:01.321299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:01.321299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:01.321299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:01.321299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:01.322178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:01.322178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:01.322178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:01.322178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:01.322178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:01.322178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:01.322178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:01.322178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:01.322178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:01.322178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:01.322178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:01.322178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:01.322178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:01.322178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:01.322178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:01.322178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:01.322178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:01.323311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:01.323311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:01.323311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:01.323311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:01.323311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 295/583] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:01.323311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b212d-5d5c-44f1-8f54-b30aa657fad7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:01.327587 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610f162-ec7d-4bc7-93d8-b826afc5cd6c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:01.361460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d015f-09bc-4a8a-922d-08f18c9538c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.362257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d015f-09bc-4a8a-922d-08f18c9538c3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.362547 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d015f-09bc-4a8a-922d-08f18c9538c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.362980 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d015f-09bc-4a8a-922d-08f18c9538c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.363161 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:01.373972 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d015f-09bc-4a8a-922d-08f18c9538c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:01.375709 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d015f-09bc-4a8a-922d-08f18c9538c3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:01.393279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f07d015f-09bc-4a8a-922d-08f18c9538c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:01.393279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:01.393279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:01.393279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:01.393279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:01.393279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:01.393279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:01.393279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:01.393279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:01.393279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:01.393279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:01.393279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:01.393279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:01.393279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:01.393279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:01.394267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:01.394267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:01.394267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:01.394267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:01.394267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:01.394267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:01.394267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:01.394267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:01.394267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:01.394267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:01.394267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:01.394267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:01.394267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:01.394267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:01.394267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:01.394267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:01.394267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:01.395186 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:01.395186 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:01.395186 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:01.395186 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:01.397075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 289/584] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:01.397690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d015f-09bc-4a8a-922d-08f18c9538c3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:01.435339 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b212d-5d5c-44f1-8f54-b30aa657fad7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:01.469775 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966f37b-7dcc-4ffd-8504-ca914109d27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.470610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966f37b-7dcc-4ffd-8504-ca914109d27f None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.470902 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966f37b-7dcc-4ffd-8504-ca914109d27f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.471180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966f37b-7dcc-4ffd-8504-ca914109d27f None admin] PATH_INFO: `/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/0043a7d5877f41de905afe6bef355867/roles/a21e569e87fa4cb7bfb252986942b9ab` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.485107 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966f37b-7dcc-4ffd-8504-ca914109d27f None admin] RBAC: Authorizing `identity:create_grant(project_id=d33e1f400b3e46379d2a0abd05921181, user_id=0043a7d5877f41de905afe6bef355867, role_id=a21e569e87fa4cb7bfb252986942b9ab)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:01.486558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966f37b-7dcc-4ffd-8504-ca914109d27f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:01.496693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d015f-09bc-4a8a-922d-08f18c9538c3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:01.499963 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 296/585] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:29:01 2022] PUT /identity/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/0043a7d5877f41de905afe6bef355867/roles/a21e569e87fa4cb7bfb252986942b9ab => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:29:01.500774 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966f37b-7dcc-4ffd-8504-ca914109d27f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:01.508420 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:01.537538 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f1dfc-cc0a-41d3-99ce-605f243dd326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.538369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f1dfc-cc0a-41d3-99ce-605f243dd326 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.538980 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f1dfc-cc0a-41d3-99ce-605f243dd326 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.539399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f1dfc-cc0a-41d3-99ce-605f243dd326 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.554149 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f1dfc-cc0a-41d3-99ce-605f243dd326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:01.556038 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f1dfc-cc0a-41d3-99ce-605f243dd326 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:01.581981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-126f1dfc-cc0a-41d3-99ce-605f243dd326 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:01.581981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:01.581981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:01.581981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:01.581981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:01.581981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:01.581981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:01.581981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:01.581981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:01.581981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:01.581981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:01.581981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:01.581981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:01.581981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:01.581981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:01.583313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:01.583313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:01.583313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:01.583313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:01.583313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:01.583313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:01.583313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:01.583313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:01.583313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:01.583313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:01.583313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:01.583313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:01.583313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:01.583313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:01.583313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:01.583313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:01.583313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:01.585004 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:01.585004 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:01.585004 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:01.585004 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:01.585004 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 290/586] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:01.585577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f1dfc-cc0a-41d3-99ce-605f243dd326 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:01.632668 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:01.650186 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966f37b-7dcc-4ffd-8504-ca914109d27f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:01.687982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429ff75-b611-4a61-a928-18006aa4e9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.688655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429ff75-b611-4a61-a928-18006aa4e9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.688941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429ff75-b611-4a61-a928-18006aa4e9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.689215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429ff75-b611-4a61-a928-18006aa4e9b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.690069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429ff75-b611-4a61-a928-18006aa4e9b7 None admin] RBAC: Adding query filter params (role.id=a21e569e87fa4cb7bfb252986942b9ab, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=aa4502c57e324c31a8bce12770a92371) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:01.690488 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429ff75-b611-4a61-a928-18006aa4e9b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:01.692630 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429ff75-b611-4a61-a928-18006aa4e9b7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:01.699152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 297/587] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:29:01 2022] GET /identity/v3/role_assignments?user.id=aa4502c57e324c31a8bce12770a92371&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=a21e569e87fa4cb7bfb252986942b9ab => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:01.700394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429ff75-b611-4a61-a928-18006aa4e9b7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:01.736722 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f1dfc-cc0a-41d3-99ce-605f243dd326 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:01.780253 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465bed2-b8ff-4a1a-8c1e-763e9e11d413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.781450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465bed2-b8ff-4a1a-8c1e-763e9e11d413 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.781966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465bed2-b8ff-4a1a-8c1e-763e9e11d413 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.782451 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465bed2-b8ff-4a1a-8c1e-763e9e11d413 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.783582 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465bed2-b8ff-4a1a-8c1e-763e9e11d413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:01.784119 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465bed2-b8ff-4a1a-8c1e-763e9e11d413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:01.786466 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465bed2-b8ff-4a1a-8c1e-763e9e11d413 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:01.800664 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 291/588] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:01.801935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465bed2-b8ff-4a1a-8c1e-763e9e11d413 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:01.829930 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:01.836691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429ff75-b611-4a61-a928-18006aa4e9b7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:01.877230 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b2aea-6e30-45a8-b5bb-8a8e0688e74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.877914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b2aea-6e30-45a8-b5bb-8a8e0688e74a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.878239 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b2aea-6e30-45a8-b5bb-8a8e0688e74a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.878590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b2aea-6e30-45a8-b5bb-8a8e0688e74a None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.879349 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b2aea-6e30-45a8-b5bb-8a8e0688e74a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:01.879657 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b2aea-6e30-45a8-b5bb-8a8e0688e74a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:01.881062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b2aea-6e30-45a8-b5bb-8a8e0688e74a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:01.897886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 298/589] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:01.897886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b2aea-6e30-45a8-b5bb-8a8e0688e74a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:01.912504 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:01.928591 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465bed2-b8ff-4a1a-8c1e-763e9e11d413 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:01.964342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19085e-ad8d-466c-8da4-755c329272dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.965128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19085e-ad8d-466c-8da4-755c329272dd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.965422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19085e-ad8d-466c-8da4-755c329272dd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.965700 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19085e-ad8d-466c-8da4-755c329272dd None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.966480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19085e-ad8d-466c-8da4-755c329272dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:01.966835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19085e-ad8d-466c-8da4-755c329272dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:01.968378 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19085e-ad8d-466c-8da4-755c329272dd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:01.986138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 292/590] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:01.986138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19085e-ad8d-466c-8da4-755c329272dd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:02.025178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b2aea-6e30-45a8-b5bb-8a8e0688e74a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:02.065584 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8eb9e-bfa6-4054-9e02-1abcf40e28f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:02.067537 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8eb9e-bfa6-4054-9e02-1abcf40e28f9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:02.068240 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8eb9e-bfa6-4054-9e02-1abcf40e28f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:02.068712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8eb9e-bfa6-4054-9e02-1abcf40e28f9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:02.080275 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8eb9e-bfa6-4054-9e02-1abcf40e28f9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:02.082885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8eb9e-bfa6-4054-9e02-1abcf40e28f9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:02.095864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:02.104422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-85a8eb9e-bfa6-4054-9e02-1abcf40e28f9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:29:02.104422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:02.104422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:02.104422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:02.104422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:02.104422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:02.104422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:02.104422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:02.104422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:02.104422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:02.104422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:02.104422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:02.104422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:02.104422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:02.104422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:02.104422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:02.105366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:02.105366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:02.105366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:02.105366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:02.105366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:02.105366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:02.105366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:02.105366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:02.105366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:02.105366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:02.105366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:02.105366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:02.105366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:02.105366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:02.105366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:02.105366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:02.105366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:02.105366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:02.106268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:02.106268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:02.106268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:02.106268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:02.106268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:02.106268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:02.106268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:02.106268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:02.106268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:29:02.106268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:02.113929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 299/591] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:29:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:02.113929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8eb9e-bfa6-4054-9e02-1abcf40e28f9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:02.134980 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19085e-ad8d-466c-8da4-755c329272dd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:02.177699 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65905ed0-699e-4979-b170-90d7dbc55d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:02.178629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65905ed0-699e-4979-b170-90d7dbc55d22 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:02.178909 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65905ed0-699e-4979-b170-90d7dbc55d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:02.179186 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65905ed0-699e-4979-b170-90d7dbc55d22 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:02.187170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65905ed0-699e-4979-b170-90d7dbc55d22 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:02.188245 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65905ed0-699e-4979-b170-90d7dbc55d22 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:02.204053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-65905ed0-699e-4979-b170-90d7dbc55d22 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:29:02.204053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:02.204053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:02.204053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:02.204053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:02.204053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:02.204053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:02.204053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:02.204053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:02.204053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:02.204053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:02.204053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:02.204053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:02.204053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:02.204053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:02.204053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:02.205032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:02.205032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:02.205032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:02.205032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:02.205032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:02.205032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:02.205032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:02.205032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:02.205032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:02.205032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:02.205032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:02.205032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:02.205032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:02.205032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:02.205032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:02.205032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:02.205032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:02.205032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:02.205990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:02.205990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:02.205990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:02.205990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:02.205990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:02.205990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:02.205990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:02.205990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:02.205990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:29:02.205990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:02.205990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 293/592] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:29:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:02.207181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65905ed0-699e-4979-b170-90d7dbc55d22 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:02.210035 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:02.252539 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8eb9e-bfa6-4054-9e02-1abcf40e28f9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:02.300745 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1946ee6-8271-4b56-885c-e751ea8569f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:02.302154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1946ee6-8271-4b56-885c-e751ea8569f3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:02.302838 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1946ee6-8271-4b56-885c-e751ea8569f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:02.303137 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1946ee6-8271-4b56-885c-e751ea8569f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:02.314130 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1946ee6-8271-4b56-885c-e751ea8569f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:02.316838 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1946ee6-8271-4b56-885c-e751ea8569f3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:02.321809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65905ed0-699e-4979-b170-90d7dbc55d22 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:02.340276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-f1946ee6-8271-4b56-885c-e751ea8569f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:02.340276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:02.340276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:02.340276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:02.340276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:02.340276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:02.340276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:02.340276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:02.340276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:02.340276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:02.340276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:02.340276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:02.340276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:02.340276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:02.340276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:02.341206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:02.341206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:02.341206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:02.341206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:02.341206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:02.341206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:02.341206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:02.341206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:02.341206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:02.341206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:02.341206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:02.341206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:02.341206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:02.341206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:02.341206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:02.341206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:02.341206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:02.342076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:02.342076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:02.342076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:02.342076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:02.342076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:02.342076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:02.342076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:02.342076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:02.342076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 300/593] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:02.342557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1946ee6-8271-4b56-885c-e751ea8569f3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:02.370910 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2c444-39fa-443b-bc5c-ed71e47eea30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:02.371618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2c444-39fa-443b-bc5c-ed71e47eea30 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:02.371953 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2c444-39fa-443b-bc5c-ed71e47eea30 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:02.372237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2c444-39fa-443b-bc5c-ed71e47eea30 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:02.373078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2c444-39fa-443b-bc5c-ed71e47eea30 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:02.373435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2c444-39fa-443b-bc5c-ed71e47eea30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:02.375331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2c444-39fa-443b-bc5c-ed71e47eea30 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:02.391879 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:02.401350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 294/594] 10.222.0.110 () {56 vars in 1142 bytes} [Thu May 26 16:29:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:02.401350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2c444-39fa-443b-bc5c-ed71e47eea30 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:02.466228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1946ee6-8271-4b56-885c-e751ea8569f3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:02.497975 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:02.505069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92f65d-8b7d-48b9-9f6d-fdcff5b4848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:02.506059 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92f65d-8b7d-48b9-9f6d-fdcff5b4848b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:02.506553 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92f65d-8b7d-48b9-9f6d-fdcff5b4848b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:02.507132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92f65d-8b7d-48b9-9f6d-fdcff5b4848b None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:02.508279 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92f65d-8b7d-48b9-9f6d-fdcff5b4848b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:02.508796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92f65d-8b7d-48b9-9f6d-fdcff5b4848b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:02.510472 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2c444-39fa-443b-bc5c-ed71e47eea30 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:02.510704 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92f65d-8b7d-48b9-9f6d-fdcff5b4848b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:02.530408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 301/595] 10.222.0.110 () {56 vars in 1144 bytes} [Thu May 26 16:29:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:02.531587 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92f65d-8b7d-48b9-9f6d-fdcff5b4848b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:02.548396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861e9df-3e7e-44ba-b5b8-9ac77127f2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:02.549623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861e9df-3e7e-44ba-b5b8-9ac77127f2ac None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:02.550856 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861e9df-3e7e-44ba-b5b8-9ac77127f2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:02.551092 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861e9df-3e7e-44ba-b5b8-9ac77127f2ac None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:02.551940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861e9df-3e7e-44ba-b5b8-9ac77127f2ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:02.552252 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861e9df-3e7e-44ba-b5b8-9ac77127f2ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:02.554115 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861e9df-3e7e-44ba-b5b8-9ac77127f2ac None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:02.567707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 295/596] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:02.568662 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861e9df-3e7e-44ba-b5b8-9ac77127f2ac None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:02.633797 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:02.653521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92f65d-8b7d-48b9-9f6d-fdcff5b4848b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:02.684162 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861e9df-3e7e-44ba-b5b8-9ac77127f2ac None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:02.703353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e085fe-0a2e-4808-9f96-bb6d62c1eaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:02.704502 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e085fe-0a2e-4808-9f96-bb6d62c1eaff None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:02.705014 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e085fe-0a2e-4808-9f96-bb6d62c1eaff None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:02.705513 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e085fe-0a2e-4808-9f96-bb6d62c1eaff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:02.721003 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecd535-62cc-4c46-8e01-75a17afd8933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:02.721511 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e085fe-0a2e-4808-9f96-bb6d62c1eaff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:02.721958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecd535-62cc-4c46-8e01-75a17afd8933 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:02.722248 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecd535-62cc-4c46-8e01-75a17afd8933 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:02.722527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecd535-62cc-4c46-8e01-75a17afd8933 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:02.723947 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e085fe-0a2e-4808-9f96-bb6d62c1eaff None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:02.742955 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecd535-62cc-4c46-8e01-75a17afd8933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:02.744598 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecd535-62cc-4c46-8e01-75a17afd8933 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:02.748689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-f2e085fe-0a2e-4808-9f96-bb6d62c1eaff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:02.748689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:02.748689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:02.748689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:02.748689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:02.748689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:02.748689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:02.748689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:02.748689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:02.748689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:02.748689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:02.748689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:02.748689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:02.748689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:02.748689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:02.750033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:02.750033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:02.750033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:02.750033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:02.750033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:02.750033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:02.750033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:02.750033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:02.750033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:02.750033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:02.750033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:02.750033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:02.750033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:02.750033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:02.750033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:02.750033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:02.750033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:02.750990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:02.750990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:02.750990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:02.750990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:02.755308 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 302/597] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:02.756271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e085fe-0a2e-4808-9f96-bb6d62c1eaff None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:02.770601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-84ecd535-62cc-4c46-8e01-75a17afd8933 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:02.770601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:02.770601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:02.770601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:02.770601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:02.770601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:02.770601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:02.770601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:02.770601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:02.770601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:02.770601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:02.770601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:02.770601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:02.770601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:02.770601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:02.772427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:02.772427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:02.772427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:02.772427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:02.772427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:02.772427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:02.772427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:02.772427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:02.772427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:02.772427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:02.772427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:02.772427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:02.772427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:02.772427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:02.772427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:02.772427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:02.772427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:02.774427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:02.774427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:02.774427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:02.774427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:02.774427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 296/598] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:02.775222 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecd535-62cc-4c46-8e01-75a17afd8933 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:02.809647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:02.886387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e085fe-0a2e-4808-9f96-bb6d62c1eaff None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:02.914591 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecd535-62cc-4c46-8e01-75a17afd8933 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:02.927208 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44bbb6-9c0b-40f9-b7ac-641a2dcbe219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:02.928209 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44bbb6-9c0b-40f9-b7ac-641a2dcbe219 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:02.928504 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44bbb6-9c0b-40f9-b7ac-641a2dcbe219 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:02.928779 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44bbb6-9c0b-40f9-b7ac-641a2dcbe219 None admin] PATH_INFO: `/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/363d16eebb3f40a1be71506961cc3c5e/roles/a21e569e87fa4cb7bfb252986942b9ab` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:02.930325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:02.947816 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44bbb6-9c0b-40f9-b7ac-641a2dcbe219 None admin] RBAC: Authorizing `identity:create_grant(project_id=d33e1f400b3e46379d2a0abd05921181, user_id=363d16eebb3f40a1be71506961cc3c5e, role_id=a21e569e87fa4cb7bfb252986942b9ab)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:02.949504 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44bbb6-9c0b-40f9-b7ac-641a2dcbe219 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:02.956781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db5ccc-fe29-4367-8e3e-070b7f2134ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:02.957501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db5ccc-fe29-4367-8e3e-070b7f2134ce None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:02.957817 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db5ccc-fe29-4367-8e3e-070b7f2134ce None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:02.958098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db5ccc-fe29-4367-8e3e-070b7f2134ce None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:02.958850 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db5ccc-fe29-4367-8e3e-070b7f2134ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:02.959198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db5ccc-fe29-4367-8e3e-070b7f2134ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:02.961039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db5ccc-fe29-4367-8e3e-070b7f2134ce None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:02.965825 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 303/599] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:29:02 2022] PUT /identity/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/363d16eebb3f40a1be71506961cc3c5e/roles/a21e569e87fa4cb7bfb252986942b9ab => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:29:02.967056 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44bbb6-9c0b-40f9-b7ac-641a2dcbe219 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:02.975355 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 297/600] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:02.983694 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db5ccc-fe29-4367-8e3e-070b7f2134ce None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:03.083434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:03.088265 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44bbb6-9c0b-40f9-b7ac-641a2dcbe219 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:03.129273 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7023c-f97e-4008-a000-c28a3ea51dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:03.130321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7023c-f97e-4008-a000-c28a3ea51dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:03.130820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7023c-f97e-4008-a000-c28a3ea51dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:03.131284 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7023c-f97e-4008-a000-c28a3ea51dc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:03.132231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7023c-f97e-4008-a000-c28a3ea51dc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:03.132733 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7023c-f97e-4008-a000-c28a3ea51dc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:03.134560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7023c-f97e-4008-a000-c28a3ea51dc0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:03.148554 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 304/601] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:03.153502 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7023c-f97e-4008-a000-c28a3ea51dc0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:03.217164 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db5ccc-fe29-4367-8e3e-070b7f2134ce None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:03.259242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1439964-cb55-43f6-804e-af4b1a66ade7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:03.260381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1439964-cb55-43f6-804e-af4b1a66ade7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:03.260854 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1439964-cb55-43f6-804e-af4b1a66ade7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:03.261314 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1439964-cb55-43f6-804e-af4b1a66ade7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:03.269671 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1439964-cb55-43f6-804e-af4b1a66ade7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:03.271389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1439964-cb55-43f6-804e-af4b1a66ade7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:03.283305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7023c-f97e-4008-a000-c28a3ea51dc0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:03.286256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c1439964-cb55-43f6-804e-af4b1a66ade7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:03.286256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:03.286256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:03.286256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:03.286256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:03.286256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:03.286256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:03.286256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:03.286256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:03.286256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:03.286256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:03.286256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:03.286256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:03.286256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:03.286256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:03.287139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:03.287139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:03.287139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:03.287139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:03.287139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:03.287139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:03.287139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:03.287139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:03.287139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:03.287139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:03.287139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:03.287139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:03.287139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:03.287139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:03.287139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:03.287139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:03.287139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:03.288052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:03.288052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:03.288052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:03.288052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:03.288052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:03.288052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:03.288052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:03.288052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:03.291700 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 298/602] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:03.304393 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1439964-cb55-43f6-804e-af4b1a66ade7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:03.337589 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f665e7-963a-4c06-a3cb-ab61022524d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:03.338685 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f665e7-963a-4c06-a3cb-ab61022524d0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:03.339126 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f665e7-963a-4c06-a3cb-ab61022524d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:03.339551 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f665e7-963a-4c06-a3cb-ab61022524d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:03.347711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f665e7-963a-4c06-a3cb-ab61022524d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:03.349357 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f665e7-963a-4c06-a3cb-ab61022524d0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:03.364723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-89f665e7-963a-4c06-a3cb-ab61022524d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:03.364723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:03.364723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:03.364723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:03.364723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:03.364723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:03.364723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:03.364723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:03.364723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:03.364723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:03.364723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:03.364723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:03.364723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:03.364723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:03.364723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:03.365655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:03.365655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:03.365655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:03.365655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:03.365655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:03.365655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:03.365655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:03.365655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:03.365655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:03.365655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:03.365655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:03.365655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:03.365655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:03.365655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:03.365655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:03.365655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:03.365655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:03.366535 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:03.366535 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:03.366535 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:03.366535 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:03.366535 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:03.366535 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:03.366535 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:03.366535 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:03.367652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:03.368465 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 305/603] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:03.375601 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f665e7-963a-4c06-a3cb-ab61022524d0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:03.390027 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:03.487810 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f665e7-963a-4c06-a3cb-ab61022524d0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:03.516291 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1439964-cb55-43f6-804e-af4b1a66ade7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:03.544847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c4f67-27e4-47e9-ab0c-23d859fbe00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:03.545875 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c4f67-27e4-47e9-ab0c-23d859fbe00f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:03.547388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c4f67-27e4-47e9-ab0c-23d859fbe00f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:03.549034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c4f67-27e4-47e9-ab0c-23d859fbe00f None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:03.550154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c4f67-27e4-47e9-ab0c-23d859fbe00f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:03.552010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c4f67-27e4-47e9-ab0c-23d859fbe00f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:03.553675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c4f67-27e4-47e9-ab0c-23d859fbe00f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:03.578307 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 306/604] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:03.587733 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0c8ab-5781-4953-9975-1cc64db008df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:03.588748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0c8ab-5781-4953-9975-1cc64db008df None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:03.589241 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0c8ab-5781-4953-9975-1cc64db008df None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:03.589753 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0c8ab-5781-4953-9975-1cc64db008df None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:03.590769 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0c8ab-5781-4953-9975-1cc64db008df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:03.591307 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0c8ab-5781-4953-9975-1cc64db008df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:03.592951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0c8ab-5781-4953-9975-1cc64db008df None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:03.596480 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c4f67-27e4-47e9-ab0c-23d859fbe00f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:03.627163 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 299/605] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:03.633628 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0c8ab-5781-4953-9975-1cc64db008df None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:03.737223 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:03.797591 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c4f67-27e4-47e9-ab0c-23d859fbe00f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:03.819051 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:03.837593 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0c8ab-5781-4953-9975-1cc64db008df None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:03.867608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bffd3c-1735-45c3-a950-41a48a3110bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:03.869777 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bffd3c-1735-45c3-a950-41a48a3110bd None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:03.870510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bffd3c-1735-45c3-a950-41a48a3110bd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:03.872506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bffd3c-1735-45c3-a950-41a48a3110bd None admin] PATH_INFO: `/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/f2411c1c780449e1a24fecb747cc3761/roles/a21e569e87fa4cb7bfb252986942b9ab` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:03.891413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bffd3c-1735-45c3-a950-41a48a3110bd None admin] RBAC: Authorizing `identity:create_grant(project_id=d33e1f400b3e46379d2a0abd05921181, user_id=f2411c1c780449e1a24fecb747cc3761, role_id=a21e569e87fa4cb7bfb252986942b9ab)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:03.893077 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bffd3c-1735-45c3-a950-41a48a3110bd None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:03.899309 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946fcba-600d-42bd-b53f-825949025505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:03.900876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946fcba-600d-42bd-b53f-825949025505 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:03.901474 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946fcba-600d-42bd-b53f-825949025505 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:03.901960 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946fcba-600d-42bd-b53f-825949025505 None admin] PATH_INFO: `/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/7ac42de1401441c0a3d4e7239e9b020e/roles/a21e569e87fa4cb7bfb252986942b9ab` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:03.910392 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 307/606] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:29:03 2022] PUT /identity/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/f2411c1c780449e1a24fecb747cc3761/roles/a21e569e87fa4cb7bfb252986942b9ab => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:29:03.916743 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2cd65-a00a-4e5b-aefa-2d09c8f2f97f None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:03.916743 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2cd65-a00a-4e5b-aefa-2d09c8f2f97f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:03.916743 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2cd65-a00a-4e5b-aefa-2d09c8f2f97f None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:03.918040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 308/607] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:03.920057 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f441145-78ac-4131-889a-83af9f961ecf None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:03.920358 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f441145-78ac-4131-889a-83af9f961ecf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:03.920638 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f441145-78ac-4131-889a-83af9f961ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:03.929921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946fcba-600d-42bd-b53f-825949025505 None admin] RBAC: Authorizing `identity:create_grant(project_id=d33e1f400b3e46379d2a0abd05921181, user_id=7ac42de1401441c0a3d4e7239e9b020e, role_id=a21e569e87fa4cb7bfb252986942b9ab)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:03.931772 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946fcba-600d-42bd-b53f-825949025505 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:03.940451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1f441145-78ac-4131-889a-83af9f961ecf None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:03.942335 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1f441145-78ac-4131-889a-83af9f961ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:03.957554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 300/608] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:29:03 2022] PUT /identity/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/7ac42de1401441c0a3d4e7239e9b020e/roles/a21e569e87fa4cb7bfb252986942b9ab => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:29:04.037666 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 309/609] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:29:04.055979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946fcba-600d-42bd-b53f-825949025505 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:04.075893 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70fd25-0f1b-444e-abf3-a34a05551559 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.076207 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70fd25-0f1b-444e-abf3-a34a05551559 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.076462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70fd25-0f1b-444e-abf3-a34a05551559 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.077982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 310/610] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:29:04.085177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397cbd1-7058-4fc0-8f92-4991b1407ddd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.085789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397cbd1-7058-4fc0-8f92-4991b1407ddd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.085789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397cbd1-7058-4fc0-8f92-4991b1407ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.104713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2397cbd1-7058-4fc0-8f92-4991b1407ddd None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:04.106062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2397cbd1-7058-4fc0-8f92-4991b1407ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:04.165592 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:04.195816 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 311/611] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:04.218760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397cbd1-7058-4fc0-8f92-4991b1407ddd None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:04.223819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946fcba-600d-42bd-b53f-825949025505 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:04.271895 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fe9db-8232-4e65-b1ac-78133ab08f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:04.272721 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fe9db-8232-4e65-b1ac-78133ab08f37 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.273007 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fe9db-8232-4e65-b1ac-78133ab08f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.273284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fe9db-8232-4e65-b1ac-78133ab08f37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.285008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fe9db-8232-4e65-b1ac-78133ab08f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:04.294508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5e1fe9db-8232-4e65-b1ac-78133ab08f37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:04.294508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:04.294508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:04.294508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:04.294508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:04.294508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:04.294508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:04.294508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:04.294508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:04.294508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:04.294508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:04.294508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:04.294508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:04.294508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:04.294508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:04.294508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:04.295504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:04.295504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:04.295504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:04.295504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:04.295504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:04.295504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:04.295504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:04.295504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:04.295504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:04.295504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:04.295504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:04.295504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:04.295504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:04.295504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:04.295504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:04.295504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:04.296360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:04.296360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:04.296360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:04.296360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:04.296360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:04.296360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:04.296360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:04.296360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:04.296360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:04.296360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:04.296360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:04.296360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:04.297502 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 301/612] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:29:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:04.309322 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fe9db-8232-4e65-b1ac-78133ab08f37 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:04.312572 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:04.352657 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397cbd1-7058-4fc0-8f92-4991b1407ddd None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:04.414281 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d82a47-c61d-4d94-af01-36f1c96ffee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:04.415124 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d82a47-c61d-4d94-af01-36f1c96ffee9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.415407 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d82a47-c61d-4d94-af01-36f1c96ffee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.415743 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d82a47-c61d-4d94-af01-36f1c96ffee9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.437594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fe9db-8232-4e65-b1ac-78133ab08f37 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:04.439625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d82a47-c61d-4d94-af01-36f1c96ffee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:04.449089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-18d82a47-c61d-4d94-af01-36f1c96ffee9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:04.449089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:04.449089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:04.449089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:04.449089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:04.449089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:04.449089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:04.449089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:04.449089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:04.449089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:04.449089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:04.449089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:04.449089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:04.449089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:04.449089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:04.449089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:04.450053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:04.450053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:04.450053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:04.450053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:04.450053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:04.450053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:04.450053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:04.450053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:04.450053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:04.450053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:04.450053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:04.450053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:04.450053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:04.450053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:04.450053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:04.450053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:04.450930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:04.450930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:04.450930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:04.450930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:04.450930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:04.450930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:04.450930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:04.450930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:04.450930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:04.450930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:04.450930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:04.450930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:04.450930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 312/613] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:29:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:04.457021 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d82a47-c61d-4d94-af01-36f1c96ffee9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:04.504833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:04.532417 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bbbb9-45d1-461d-ae68-093eabbe5ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:04.533093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bbbb9-45d1-461d-ae68-093eabbe5ada None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.533380 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bbbb9-45d1-461d-ae68-093eabbe5ada None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.533657 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bbbb9-45d1-461d-ae68-093eabbe5ada None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.534638 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592bbbb9-45d1-461d-ae68-093eabbe5ada None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:04.534950 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592bbbb9-45d1-461d-ae68-093eabbe5ada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:04.536320 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592bbbb9-45d1-461d-ae68-093eabbe5ada None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:04.562098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 302/614] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:29:04 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:04.576030 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bbbb9-45d1-461d-ae68-093eabbe5ada None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:04.618548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d82a47-c61d-4d94-af01-36f1c96ffee9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:04.671496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:04.680102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52226592-5f6d-44fc-8258-980dd3bb0b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:04.680777 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52226592-5f6d-44fc-8258-980dd3bb0b6d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.681163 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52226592-5f6d-44fc-8258-980dd3bb0b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.681448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52226592-5f6d-44fc-8258-980dd3bb0b6d None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.682195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52226592-5f6d-44fc-8258-980dd3bb0b6d None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:04.682506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52226592-5f6d-44fc-8258-980dd3bb0b6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:04.683916 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52226592-5f6d-44fc-8258-980dd3bb0b6d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:04.706762 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 313/615] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:29:04 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:04.712220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52226592-5f6d-44fc-8258-980dd3bb0b6d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:04.757686 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bbbb9-45d1-461d-ae68-093eabbe5ada None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:04.840466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52226592-5f6d-44fc-8258-980dd3bb0b6d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:04.842348 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:04.868417 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f9398-8d72-4b43-ad58-31f0c5a07f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:04.869131 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f9398-8d72-4b43-ad58-31f0c5a07f4e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.869301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f9398-8d72-4b43-ad58-31f0c5a07f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.869566 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f9398-8d72-4b43-ad58-31f0c5a07f4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.882312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf4a9e-4f18-4adb-ac92-73bfeffdd3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:04.883469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf4a9e-4f18-4adb-ac92-73bfeffdd3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.883986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf4a9e-4f18-4adb-ac92-73bfeffdd3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.885003 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf4a9e-4f18-4adb-ac92-73bfeffdd3b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.898101 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf4a9e-4f18-4adb-ac92-73bfeffdd3b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:04.899429 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f9398-8d72-4b43-ad58-31f0c5a07f4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:04.900264 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf4a9e-4f18-4adb-ac92-73bfeffdd3b4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:04.900900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f9398-8d72-4b43-ad58-31f0c5a07f4e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:04.919982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-08cf4a9e-4f18-4adb-ac92-73bfeffdd3b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:04.919982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:04.919982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:04.919982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:04.919982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:04.919982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:04.919982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:04.919982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:04.919982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:04.919982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:04.919982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:04.919982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:04.919982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:04.919982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:04.919982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:04.920899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:04.920899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:04.920899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:04.920899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:04.920899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:04.920899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:04.920899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:04.920899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:04.920899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:04.920899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:04.920899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:04.920899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:04.920899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:04.920899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:04.920899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:04.920899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:04.920899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:04.921827 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:04.921827 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:04.921827 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:04.921827 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:04.924557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 314/616] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:04.932704 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf4a9e-4f18-4adb-ac92-73bfeffdd3b4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:04.941413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d12f9398-8d72-4b43-ad58-31f0c5a07f4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:04.941413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:04.941413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:04.941413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:04.941413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:04.941413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:04.941413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:04.941413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:04.941413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:04.941413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:04.941413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:04.941413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:04.941413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:04.941413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:04.941413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:04.942281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:04.942281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:04.942281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:04.942281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:04.942281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:04.942281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:04.942281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:04.942281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:04.942281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:04.942281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:04.942281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:04.942281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:04.942281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:04.942281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:04.942281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:04.942281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:04.942281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:04.943212 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:04.943212 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:04.943212 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:04.943212 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:04.946135 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 303/617] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:04.947593 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f9398-8d72-4b43-ad58-31f0c5a07f4e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:05.104001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f9398-8d72-4b43-ad58-31f0c5a07f4e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:05.119395 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf4a9e-4f18-4adb-ac92-73bfeffdd3b4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:05.130985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:05.143317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ee582-6b50-4246-bad1-d884d18b5621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:05.144379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ee582-6b50-4246-bad1-d884d18b5621 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:05.144892 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ee582-6b50-4246-bad1-d884d18b5621 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:05.145386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ee582-6b50-4246-bad1-d884d18b5621 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:05.146315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ee582-6b50-4246-bad1-d884d18b5621 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:05.146874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ee582-6b50-4246-bad1-d884d18b5621 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:05.148446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ee582-6b50-4246-bad1-d884d18b5621 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:05.162303 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 304/618] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:05.174681 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ee582-6b50-4246-bad1-d884d18b5621 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:05.183866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad8b9c-49cd-41be-a1f8-acb1956d5de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:05.184755 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad8b9c-49cd-41be-a1f8-acb1956d5de7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:05.185186 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad8b9c-49cd-41be-a1f8-acb1956d5de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:05.185763 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad8b9c-49cd-41be-a1f8-acb1956d5de7 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:05.186757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad8b9c-49cd-41be-a1f8-acb1956d5de7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:05.187268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad8b9c-49cd-41be-a1f8-acb1956d5de7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:05.192184 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad8b9c-49cd-41be-a1f8-acb1956d5de7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:05.224482 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 315/619] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:05.240128 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad8b9c-49cd-41be-a1f8-acb1956d5de7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:05.261995 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:05.373626 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad8b9c-49cd-41be-a1f8-acb1956d5de7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:05.415902 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ee582-6b50-4246-bad1-d884d18b5621 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:05.420934 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9efa1-4ea7-4cbe-a916-16c3f5fb7621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:05.421938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9efa1-4ea7-4cbe-a916-16c3f5fb7621 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:05.422350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9efa1-4ea7-4cbe-a916-16c3f5fb7621 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:05.422819 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9efa1-4ea7-4cbe-a916-16c3f5fb7621 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:05.438658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9efa1-4ea7-4cbe-a916-16c3f5fb7621 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:05.440628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9efa1-4ea7-4cbe-a916-16c3f5fb7621 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:05.459560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-8fb9efa1-4ea7-4cbe-a916-16c3f5fb7621 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:05.459560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:05.459560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:05.459560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:05.459560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:05.459560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:05.459560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:05.459560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:05.459560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:05.459560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:05.459560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:05.459560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:05.459560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:05.459560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:05.459560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:05.459560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:05.460531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:05.460531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:05.460531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:05.460531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:05.460531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:05.460531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:05.460531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:05.460531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:05.460531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:05.460531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:05.460531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:05.460531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:05.460531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:05.460531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:05.460531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:05.460531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:05.460531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:05.460531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:05.461469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:05.461469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:05.461469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:05.461469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:05.461469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:05.461469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:05.461469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:05.461469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:05.461469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:05.461469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:05.468475 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 316/620] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:29:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:05.470211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71db45-5ae3-4e53-9d3b-7714f4c6fa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:05.471306 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71db45-5ae3-4e53-9d3b-7714f4c6fa2d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:05.472608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9efa1-4ea7-4cbe-a916-16c3f5fb7621 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:05.473936 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71db45-5ae3-4e53-9d3b-7714f4c6fa2d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:05.476211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71db45-5ae3-4e53-9d3b-7714f4c6fa2d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:05.495754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71db45-5ae3-4e53-9d3b-7714f4c6fa2d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:05.497622 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71db45-5ae3-4e53-9d3b-7714f4c6fa2d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:05.536063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8a71db45-5ae3-4e53-9d3b-7714f4c6fa2d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:05.536063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:05.536063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:05.536063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:05.536063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:05.536063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:05.536063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:05.536063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:05.536063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:05.536063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:05.536063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:05.536063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:05.536063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:05.536063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:05.536063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:05.536063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:05.537091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:05.537091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:05.537091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:05.537091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:05.537091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:05.537091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:05.537091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:05.537091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:05.537091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:05.537091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:05.537091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:05.537091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:05.537091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:05.537091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:05.537091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:05.537091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:05.537091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:05.537091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:05.538017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:05.538017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:05.538017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:05.538017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:05.538017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:05.538017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:05.538017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:05.538017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:05.538017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:05.538017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:05.542198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 305/621] 10.222.0.110 () {56 vars in 1098 bytes} [Thu May 26 16:29:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:05.547981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71db45-5ae3-4e53-9d3b-7714f4c6fa2d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:05.602525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:05.632088 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9efa1-4ea7-4cbe-a916-16c3f5fb7621 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:05.669068 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f2fd1-18fe-481e-832d-24d2b140c47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:05.670129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f2fd1-18fe-481e-832d-24d2b140c47c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:05.670659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f2fd1-18fe-481e-832d-24d2b140c47c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:05.671149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f2fd1-18fe-481e-832d-24d2b140c47c None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:05.672193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f2fd1-18fe-481e-832d-24d2b140c47c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:05.672706 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f2fd1-18fe-481e-832d-24d2b140c47c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:05.674321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f2fd1-18fe-481e-832d-24d2b140c47c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:05.698212 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 317/622] 10.222.0.110 () {56 vars in 1140 bytes} [Thu May 26 16:29:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:05.703268 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:05.705492 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f2fd1-18fe-481e-832d-24d2b140c47c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:05.843128 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f2fd1-18fe-481e-832d-24d2b140c47c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:05.849495 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71db45-5ae3-4e53-9d3b-7714f4c6fa2d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:05.900650 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:05.911381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c558d-b459-408a-9042-4490f7d94d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:05.913093 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c558d-b459-408a-9042-4490f7d94d39 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:05.913744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c558d-b459-408a-9042-4490f7d94d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:05.915626 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c558d-b459-408a-9042-4490f7d94d39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:05.920188 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c7156-d08c-4175-86b3-823f305fcb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:05.922421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c7156-d08c-4175-86b3-823f305fcb88 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:05.923530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c7156-d08c-4175-86b3-823f305fcb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:05.927783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c7156-d08c-4175-86b3-823f305fcb88 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:05.928863 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c7156-d08c-4175-86b3-823f305fcb88 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:05.929374 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c7156-d08c-4175-86b3-823f305fcb88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:05.931255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c7156-d08c-4175-86b3-823f305fcb88 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:05.937778 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c558d-b459-408a-9042-4490f7d94d39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:05.939721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c558d-b459-408a-9042-4490f7d94d39 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:05.970432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 306/623] 10.222.0.110 () {56 vars in 1138 bytes} [Thu May 26 16:29:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:05.973151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099d20c-2079-4ee6-9e87-3c036c040888 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:05.975545 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099d20c-2079-4ee6-9e87-3c036c040888 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:05.976054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099d20c-2079-4ee6-9e87-3c036c040888 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:05.978890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-750c558d-b459-408a-9042-4490f7d94d39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:05.978890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:05.978890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:05.978890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:05.978890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:05.978890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:05.978890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:05.978890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:05.978890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:05.978890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:05.978890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:05.978890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:05.978890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:05.978890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:05.978890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:05.979758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:05.979758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:05.979758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:05.979758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:05.979758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:05.979758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:05.979758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:05.979758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:05.979758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:05.979758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:05.979758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:05.979758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:05.979758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:05.979758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:05.979758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:05.979758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:05.979758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:05.980635 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:05.980635 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:05.980635 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:05.980635 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:05.980855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 307/624] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:05 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:05.980855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099d20c-2079-4ee6-9e87-3c036c040888 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:05.987975 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 318/625] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:05.989644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d8493-290a-4165-8f0e-c2e974d00126 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:05.990156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d8493-290a-4165-8f0e-c2e974d00126 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:05.990750 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d8493-290a-4165-8f0e-c2e974d00126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:06.010323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-238d8493-290a-4165-8f0e-c2e974d00126 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:06.012085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-238d8493-290a-4165-8f0e-c2e974d00126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:06.083817 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:06.089501 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 319/626] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:06.090909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d8493-290a-4165-8f0e-c2e974d00126 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:06.091709 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099d20c-2079-4ee6-9e87-3c036c040888 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:06.130277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2100e-d3ec-46e2-97e9-f5c4d0d441a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:06.131161 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2100e-d3ec-46e2-97e9-f5c4d0d441a9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:06.131547 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2100e-d3ec-46e2-97e9-f5c4d0d441a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:06.131924 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2100e-d3ec-46e2-97e9-f5c4d0d441a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:06.204142 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d8493-290a-4165-8f0e-c2e974d00126 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:06.206222 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2100e-d3ec-46e2-97e9-f5c4d0d441a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:06.207909 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2100e-d3ec-46e2-97e9-f5c4d0d441a9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:06.220515 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:06.243065 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953e6b1-838f-423c-8fa4-96f21ec5a7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:06.243685 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953e6b1-838f-423c-8fa4-96f21ec5a7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:06.243968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953e6b1-838f-423c-8fa4-96f21ec5a7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:06.244347 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953e6b1-838f-423c-8fa4-96f21ec5a7d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:06.245102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953e6b1-838f-423c-8fa4-96f21ec5a7d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:06.245407 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953e6b1-838f-423c-8fa4-96f21ec5a7d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:06.247083 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953e6b1-838f-423c-8fa4-96f21ec5a7d5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:06.260506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 320/627] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:06.265497 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953e6b1-838f-423c-8fa4-96f21ec5a7d5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:06.314674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:06.324563 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 308/628] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:29:05 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:06.330178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2100e-d3ec-46e2-97e9-f5c4d0d441a9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:06.389456 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953e6b1-838f-423c-8fa4-96f21ec5a7d5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:06.425996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9400-060d-4290-987c-16df1d8ec663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:06.426629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9400-060d-4290-987c-16df1d8ec663 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:06.426924 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9400-060d-4290-987c-16df1d8ec663 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:06.427204 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9400-060d-4290-987c-16df1d8ec663 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:06.441274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca9400-060d-4290-987c-16df1d8ec663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:06.442137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2100e-d3ec-46e2-97e9-f5c4d0d441a9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:06.449559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-30ca9400-060d-4290-987c-16df1d8ec663 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:06.449559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:06.449559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:06.449559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:06.449559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:06.449559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:06.449559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:06.449559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:06.449559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:06.449559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:06.449559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:06.449559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:06.449559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:06.449559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:06.449559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:06.449559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:06.450640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:06.450640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:06.450640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:06.450640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:06.450640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:06.450640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:06.450640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:06.450640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:06.450640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:06.450640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:06.450640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:06.450640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:06.450640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:06.450640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:06.450640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:06.450640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:06.451486 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:06.451486 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:06.451486 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:06.451486 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:06.451486 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:06.451486 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:06.451486 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:06.451486 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:06.451486 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:06.451486 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:06.451486 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:06.451486 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:06.452124 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 321/629] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:29:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:06.452920 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9400-060d-4290-987c-16df1d8ec663 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:06.486192 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47378912-1cc0-4931-af1f-776cc04ec14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:06.487489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47378912-1cc0-4931-af1f-776cc04ec14d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:06.488059 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47378912-1cc0-4931-af1f-776cc04ec14d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:06.488531 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47378912-1cc0-4931-af1f-776cc04ec14d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:06.492413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:06.497481 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47378912-1cc0-4931-af1f-776cc04ec14d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:06.500324 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47378912-1cc0-4931-af1f-776cc04ec14d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:06.516383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-47378912-1cc0-4931-af1f-776cc04ec14d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:06.516383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:06.516383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:06.516383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:06.516383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:06.516383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:06.516383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:06.516383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:06.516383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:06.516383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:06.516383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:06.516383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:06.516383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:06.516383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:06.516383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:06.517296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:06.517296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:06.517296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:06.517296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:06.517296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:06.517296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:06.517296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:06.517296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:06.517296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:06.517296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:06.517296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:06.517296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:06.517296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:06.517296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:06.517296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:06.517296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:06.517296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:06.518275 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:06.518275 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:06.518275 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:06.518275 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:06.518275 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:06.518275 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:06.518275 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:06.518275 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:06.521131 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 309/630] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:06.522180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47378912-1cc0-4931-af1f-776cc04ec14d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:06.573268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9400-060d-4290-987c-16df1d8ec663 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:06.590839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:06.612546 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def71cf-43bf-4a69-bddd-f65c84c823ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:06.613347 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def71cf-43bf-4a69-bddd-f65c84c823ec None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:06.613635 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def71cf-43bf-4a69-bddd-f65c84c823ec None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:06.613969 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def71cf-43bf-4a69-bddd-f65c84c823ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:06.625848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def71cf-43bf-4a69-bddd-f65c84c823ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:06.627329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def71cf-43bf-4a69-bddd-f65c84c823ec None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:06.641748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47378912-1cc0-4931-af1f-776cc04ec14d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:06.646607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-4def71cf-43bf-4a69-bddd-f65c84c823ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:06.646607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:06.646607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:06.646607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:06.646607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:06.646607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:06.646607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:06.646607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:06.646607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:06.646607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:06.646607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:06.646607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:06.646607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:06.646607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:06.646607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:06.647483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:06.647483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:06.647483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:06.647483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:06.647483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:06.647483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:06.647483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:06.647483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:06.647483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:06.647483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:06.647483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:06.647483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:06.647483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:06.647483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:06.647483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:06.647483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:06.647483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:06.648341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:06.648341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:06.648341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:06.648341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:06.648341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 322/631] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:06.649095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def71cf-43bf-4a69-bddd-f65c84c823ec None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:06.685922 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19767914-f661-4131-bb35-c94047dd2c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:06.687006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19767914-f661-4131-bb35-c94047dd2c74 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:06.687521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19767914-f661-4131-bb35-c94047dd2c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:06.687999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19767914-f661-4131-bb35-c94047dd2c74 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:06.689376 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19767914-f661-4131-bb35-c94047dd2c74 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:06.689896 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19767914-f661-4131-bb35-c94047dd2c74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:06.691879 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19767914-f661-4131-bb35-c94047dd2c74 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:06.703406 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 310/632] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:29:06 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:06.705731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323a1a3-f277-4396-a29d-4e4fb72e11c9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:06.706346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323a1a3-f277-4396-a29d-4e4fb72e11c9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:06.706836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323a1a3-f277-4396-a29d-4e4fb72e11c9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:06.708925 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 311/633] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:06 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:06.709823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323a1a3-f277-4396-a29d-4e4fb72e11c9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:06.737249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:06.755470 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def71cf-43bf-4a69-bddd-f65c84c823ec None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:06.788259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1afa3-3887-49a7-a5d5-8da60c1d2054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:06.788922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1afa3-3887-49a7-a5d5-8da60c1d2054 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:06.789212 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1afa3-3887-49a7-a5d5-8da60c1d2054 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:06.789492 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1afa3-3887-49a7-a5d5-8da60c1d2054 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:06.790278 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1afa3-3887-49a7-a5d5-8da60c1d2054 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:06.790623 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1afa3-3887-49a7-a5d5-8da60c1d2054 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:06.792057 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1afa3-3887-49a7-a5d5-8da60c1d2054 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:06.804411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 323/634] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:06.805201 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1afa3-3887-49a7-a5d5-8da60c1d2054 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:06.816866 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323a1a3-f277-4396-a29d-4e4fb72e11c9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:06.832749 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:06.850484 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbd712-8b60-43ae-ab21-af3d2d6f55cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:06.851197 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbd712-8b60-43ae-ab21-af3d2d6f55cb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:06.851486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbd712-8b60-43ae-ab21-af3d2d6f55cb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:06.851764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbd712-8b60-43ae-ab21-af3d2d6f55cb None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:06.852479 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbd712-8b60-43ae-ab21-af3d2d6f55cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:06.852783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbd712-8b60-43ae-ab21-af3d2d6f55cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:06.854123 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbd712-8b60-43ae-ab21-af3d2d6f55cb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:06.865588 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 312/635] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:06.866873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f6ac3-6540-4cc0-9e7d-b8aa934349de None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:06.867158 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f6ac3-6540-4cc0-9e7d-b8aa934349de None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:06.867430 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f6ac3-6540-4cc0-9e7d-b8aa934349de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:06.883936 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a75f6ac3-6540-4cc0-9e7d-b8aa934349de None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:06.885133 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a75f6ac3-6540-4cc0-9e7d-b8aa934349de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:06.909449 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1afa3-3887-49a7-a5d5-8da60c1d2054 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:06.945198 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ce5c1-446c-4051-a34c-1bd10d8c4e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:06.945982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ce5c1-446c-4051-a34c-1bd10d8c4e2b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:06.946267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ce5c1-446c-4051-a34c-1bd10d8c4e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:06.946546 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ce5c1-446c-4051-a34c-1bd10d8c4e2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:06.949864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 313/636] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:06.951315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8540c8d-8b49-4032-a1e8-ae4165bc1f3b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:06.951605 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8540c8d-8b49-4032-a1e8-ae4165bc1f3b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:06.951880 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8540c8d-8b49-4032-a1e8-ae4165bc1f3b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:06.953392 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 314/637] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:06.954067 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8540c8d-8b49-4032-a1e8-ae4165bc1f3b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:06.961999 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ce5c1-446c-4051-a34c-1bd10d8c4e2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:06.963483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ce5c1-446c-4051-a34c-1bd10d8c4e2b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:06.971182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:06.983394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-606ce5c1-446c-4051-a34c-1bd10d8c4e2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:06.983394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:06.983394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:06.983394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:06.983394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:06.983394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:06.983394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:06.983394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:06.983394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:06.983394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:06.983394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:06.983394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:06.983394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:06.983394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:06.983394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:06.984364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:06.984364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:06.984364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:06.984364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:06.984364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:06.984364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:06.984364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:06.984364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:06.984364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:06.984364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:06.984364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:06.984364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:06.984364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:06.984364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:06.984364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:06.984364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:06.984364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:06.985240 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:06.985240 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:06.985240 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:06.985240 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:06.985240 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 324/638] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:06.985517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ce5c1-446c-4051-a34c-1bd10d8c4e2b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:07.062350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8540c8d-8b49-4032-a1e8-ae4165bc1f3b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:07.070184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:07.083710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ce5c1-446c-4051-a34c-1bd10d8c4e2b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:07.096361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0607e-6e18-49f9-8b95-2e5244b4ff32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:07.097267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0607e-6e18-49f9-8b95-2e5244b4ff32 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.097548 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0607e-6e18-49f9-8b95-2e5244b4ff32 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.097822 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0607e-6e18-49f9-8b95-2e5244b4ff32 None admin] PATH_INFO: `/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/aa4502c57e324c31a8bce12770a92371/roles/a21e569e87fa4cb7bfb252986942b9ab` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.111708 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0607e-6e18-49f9-8b95-2e5244b4ff32 None admin] RBAC: Authorizing `identity:create_grant(project_id=d33e1f400b3e46379d2a0abd05921181, user_id=aa4502c57e324c31a8bce12770a92371, role_id=a21e569e87fa4cb7bfb252986942b9ab)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:07.113652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0607e-6e18-49f9-8b95-2e5244b4ff32 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:07.118994 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50514031-6c2c-4c8e-b681-476a62e95a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:07.119924 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50514031-6c2c-4c8e-b681-476a62e95a89 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.120245 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50514031-6c2c-4c8e-b681-476a62e95a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.120530 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50514031-6c2c-4c8e-b681-476a62e95a89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.126505 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 315/639] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:29:06 2022] PUT /identity/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/aa4502c57e324c31a8bce12770a92371/roles/a21e569e87fa4cb7bfb252986942b9ab => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:29:07.127778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14dff4b-67ba-46e6-8db4-4c9114190d20 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.128090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14dff4b-67ba-46e6-8db4-4c9114190d20 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.128194 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50514031-6c2c-4c8e-b681-476a62e95a89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:07.128367 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14dff4b-67ba-46e6-8db4-4c9114190d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.129668 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50514031-6c2c-4c8e-b681-476a62e95a89 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:07.145255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-50514031-6c2c-4c8e-b681-476a62e95a89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:07.145255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:07.145255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:07.145255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:07.145255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:07.145255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:07.145255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:07.145255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:07.145255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:07.145255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:07.145255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:07.145255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:07.145255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:07.145255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:07.145255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:07.146249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:07.146249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:07.146249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:07.146249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:07.146249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:07.146249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:07.146249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:07.146249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:07.146249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:07.146249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:07.146249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:07.146249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:07.146249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:07.146249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:07.146249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:07.146249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:07.146249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:07.152388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:07.152388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:07.152388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:07.152388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:07.152388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:07.152388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:07.152388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:07.152388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:07.152915 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b14dff4b-67ba-46e6-8db4-4c9114190d20 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:07.153006 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 325/640] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:07.153087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b14dff4b-67ba-46e6-8db4-4c9114190d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:07.153169 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50514031-6c2c-4c8e-b681-476a62e95a89 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:07.215462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:07.242592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 316/641] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:07.242592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14dff4b-67ba-46e6-8db4-4c9114190d20 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:07.274360 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50514031-6c2c-4c8e-b681-476a62e95a89 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:07.317304 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369713ea-32e4-44e9-b814-7a7374f58077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:07.318038 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369713ea-32e4-44e9-b814-7a7374f58077 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.318324 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369713ea-32e4-44e9-b814-7a7374f58077 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.318621 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369713ea-32e4-44e9-b814-7a7374f58077 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.329525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369713ea-32e4-44e9-b814-7a7374f58077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:07.337520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-369713ea-32e4-44e9-b814-7a7374f58077 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:07.337520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:07.337520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:07.337520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:07.337520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:07.337520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:07.337520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:07.337520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:07.337520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:07.337520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:07.337520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:07.337520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:07.337520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:07.337520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:07.337520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:07.337520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:07.338517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:07.338517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:07.338517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:07.338517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:07.338517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:07.338517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:07.338517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:07.338517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:07.338517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:07.338517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:07.338517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:07.338517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:07.338517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:07.338517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:07.338517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:07.338517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:07.339534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:07.339534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:07.339534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:07.339534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:07.339534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:07.339534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:07.339534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:07.339534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:07.339534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:07.339534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:07.339534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:07.339534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:07.339534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 326/642] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:29:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:07.339534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369713ea-32e4-44e9-b814-7a7374f58077 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:07.345108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:07.369602 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14dff4b-67ba-46e6-8db4-4c9114190d20 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:07.411398 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cd823-257a-4294-b8ac-78110e95ddf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:07.412072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cd823-257a-4294-b8ac-78110e95ddf7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.412358 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cd823-257a-4294-b8ac-78110e95ddf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.412632 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cd823-257a-4294-b8ac-78110e95ddf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.413356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cd823-257a-4294-b8ac-78110e95ddf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:07.413674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cd823-257a-4294-b8ac-78110e95ddf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:07.415213 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cd823-257a-4294-b8ac-78110e95ddf7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:07.426871 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 317/643] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:07.427686 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cd823-257a-4294-b8ac-78110e95ddf7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:07.456419 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369713ea-32e4-44e9-b814-7a7374f58077 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:07.474459 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:07.491994 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f635e72-e374-4006-bfc7-c593e29f5c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:07.492647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f635e72-e374-4006-bfc7-c593e29f5c4d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.492931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f635e72-e374-4006-bfc7-c593e29f5c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.493207 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f635e72-e374-4006-bfc7-c593e29f5c4d None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.493976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f635e72-e374-4006-bfc7-c593e29f5c4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:07.494285 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f635e72-e374-4006-bfc7-c593e29f5c4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:07.495731 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f635e72-e374-4006-bfc7-c593e29f5c4d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:07.509811 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 327/644] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:07.510407 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f635e72-e374-4006-bfc7-c593e29f5c4d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:07.544691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cd823-257a-4294-b8ac-78110e95ddf7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:07.585200 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3810b9-3bfc-4777-b293-2a0e876dc047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:07.585925 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3810b9-3bfc-4777-b293-2a0e876dc047 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.586217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3810b9-3bfc-4777-b293-2a0e876dc047 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.586497 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3810b9-3bfc-4777-b293-2a0e876dc047 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.601570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3810b9-3bfc-4777-b293-2a0e876dc047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:07.609467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-2c3810b9-3bfc-4777-b293-2a0e876dc047 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:07.609467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:07.609467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:07.609467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:07.609467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:07.609467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:07.609467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:07.609467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:07.609467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:07.609467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:07.609467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:07.609467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:07.609467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:07.609467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:07.609467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:07.609467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:07.610369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:07.610369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:07.610369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:07.610369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:07.610369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:07.610369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:07.610369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:07.610369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:07.610369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:07.610369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:07.610369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:07.610369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:07.610369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:07.610369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:07.610369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:07.610369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:07.611363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:07.611363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:07.611363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:07.611363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:07.611363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:07.611363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:07.611363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:07.611363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:07.611363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:07.611363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:07.611363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:07.611363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:07.611363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 318/645] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:29:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:07.611363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3810b9-3bfc-4777-b293-2a0e876dc047 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:07.622640 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:07.623326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f635e72-e374-4006-bfc7-c593e29f5c4d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:07.659238 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca4ef5-4221-4b71-9abd-7c4bc40cab08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:07.659912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca4ef5-4221-4b71-9abd-7c4bc40cab08 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.660208 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca4ef5-4221-4b71-9abd-7c4bc40cab08 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.660477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca4ef5-4221-4b71-9abd-7c4bc40cab08 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.661224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca4ef5-4221-4b71-9abd-7c4bc40cab08 None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:07.661538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca4ef5-4221-4b71-9abd-7c4bc40cab08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:07.662925 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca4ef5-4221-4b71-9abd-7c4bc40cab08 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:07.671724 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 328/646] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:29:07 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:07.672528 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca4ef5-4221-4b71-9abd-7c4bc40cab08 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:07.723929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:07.726226 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3810b9-3bfc-4777-b293-2a0e876dc047 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:07.763019 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be7477-a466-499d-b429-4290595494a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:07.763829 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be7477-a466-499d-b429-4290595494a5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.764115 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be7477-a466-499d-b429-4290595494a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.764480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be7477-a466-499d-b429-4290595494a5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.772711 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be7477-a466-499d-b429-4290595494a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:07.774166 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be7477-a466-499d-b429-4290595494a5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:07.786666 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca4ef5-4221-4b71-9abd-7c4bc40cab08 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:07.788693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d9be7477-a466-499d-b429-4290595494a5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 16:29:07.788693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:07.788693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:07.788693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:07.788693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:07.788693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:07.788693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:07.788693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:07.788693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:07.788693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:07.788693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:07.788693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:07.788693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:07.788693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:07.788693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:07.788693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:07.789581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:07.789581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:07.789581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:07.789581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:07.789581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:07.789581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:07.789581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:07.789581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:07.789581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:07.789581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:07.789581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:07.789581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:07.789581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:07.789581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:07.789581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:07.789581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:07.789581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:07.789581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:07.790521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:07.790521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:07.790521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:07.790521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:07.790521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:07.790521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:07.790521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:07.790521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:07.790521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 16:29:07.790521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:07.790521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 319/647] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:29:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:07.791678 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be7477-a466-499d-b429-4290595494a5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:07.827366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38fc47-54e2-4acc-bc01-0efc8215a70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:07.828028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38fc47-54e2-4acc-bc01-0efc8215a70c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.828317 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38fc47-54e2-4acc-bc01-0efc8215a70c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.828599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38fc47-54e2-4acc-bc01-0efc8215a70c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.829457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38fc47-54e2-4acc-bc01-0efc8215a70c None admin] RBAC: Adding query filter params (role.id=a21e569e87fa4cb7bfb252986942b9ab, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=0043a7d5877f41de905afe6bef355867) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:07.829774 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38fc47-54e2-4acc-bc01-0efc8215a70c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:07.831773 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38fc47-54e2-4acc-bc01-0efc8215a70c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:07.846694 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 329/648] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:29:07 2022] GET /identity/v3/role_assignments?user.id=0043a7d5877f41de905afe6bef355867&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=a21e569e87fa4cb7bfb252986942b9ab => generated 610 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:07.846694 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38fc47-54e2-4acc-bc01-0efc8215a70c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:07.872211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:07.915768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be7477-a466-499d-b429-4290595494a5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:07.965770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ab36c-08e5-4913-97ba-b02f050f54c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:07.966583 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ab36c-08e5-4913-97ba-b02f050f54c3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.966948 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ab36c-08e5-4913-97ba-b02f050f54c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.967298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ab36c-08e5-4913-97ba-b02f050f54c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.967717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38fc47-54e2-4acc-bc01-0efc8215a70c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:07.968188 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ab36c-08e5-4913-97ba-b02f050f54c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:07.968519 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ab36c-08e5-4913-97ba-b02f050f54c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:07.970267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ab36c-08e5-4913-97ba-b02f050f54c3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:07.972408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:07.984832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 320/649] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:29:07 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:07.985888 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ab36c-08e5-4913-97ba-b02f050f54c3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:08.021895 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876453d-7b23-40ed-8ebe-51029b96a671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:08.023158 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876453d-7b23-40ed-8ebe-51029b96a671 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.023633 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876453d-7b23-40ed-8ebe-51029b96a671 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.024095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876453d-7b23-40ed-8ebe-51029b96a671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.036958 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876453d-7b23-40ed-8ebe-51029b96a671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:08.038779 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876453d-7b23-40ed-8ebe-51029b96a671 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:08.058615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-9876453d-7b23-40ed-8ebe-51029b96a671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:08.058615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:08.058615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:08.058615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:08.058615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:08.058615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:08.058615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:08.058615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:08.058615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:08.058615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:08.058615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:08.058615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:08.058615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:08.058615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:08.058615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:08.059761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:08.059761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:08.059761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:08.059761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:08.059761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:08.059761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:08.059761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:08.059761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:08.059761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:08.059761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:08.059761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:08.059761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:08.059761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:08.059761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:08.059761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:08.059761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:08.059761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:08.060859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:08.060859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:08.060859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:08.060859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:08.065192 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 330/650] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:08.066772 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876453d-7b23-40ed-8ebe-51029b96a671 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:08.127494 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ab36c-08e5-4913-97ba-b02f050f54c3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:08.156535 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:08.167914 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c39ee4-99b6-4111-9be7-c6114112c867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:08.169069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c39ee4-99b6-4111-9be7-c6114112c867 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.169464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c39ee4-99b6-4111-9be7-c6114112c867 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.170141 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c39ee4-99b6-4111-9be7-c6114112c867 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.171423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c39ee4-99b6-4111-9be7-c6114112c867 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:08.171864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c39ee4-99b6-4111-9be7-c6114112c867 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:08.174044 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c39ee4-99b6-4111-9be7-c6114112c867 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:08.195014 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876453d-7b23-40ed-8ebe-51029b96a671 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:08.199764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 321/651] 10.222.0.110 () {56 vars in 1142 bytes} [Thu May 26 16:29:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:08.199764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c39ee4-99b6-4111-9be7-c6114112c867 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:08.244906 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8696e6a-8583-4087-9a64-9e3f7d5ce32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:08.245740 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8696e6a-8583-4087-9a64-9e3f7d5ce32c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.246030 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8696e6a-8583-4087-9a64-9e3f7d5ce32c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.246309 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8696e6a-8583-4087-9a64-9e3f7d5ce32c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.258644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8696e6a-8583-4087-9a64-9e3f7d5ce32c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:08.260208 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8696e6a-8583-4087-9a64-9e3f7d5ce32c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:08.279842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-a8696e6a-8583-4087-9a64-9e3f7d5ce32c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:08.279842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:08.279842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:08.279842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:08.279842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:08.279842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:08.279842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:08.279842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:08.279842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:08.279842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:08.279842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:08.279842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:08.279842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:08.279842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:08.279842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:08.280807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:08.280807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:08.280807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:08.280807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:08.280807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:08.280807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:08.280807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:08.280807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:08.280807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:08.280807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:08.280807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:08.280807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:08.280807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:08.280807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:08.280807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:08.280807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:08.280807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:08.282140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:08.282140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:08.282140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:08.282140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:08.282140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 331/652] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:08.282546 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8696e6a-8583-4087-9a64-9e3f7d5ce32c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:08.300882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:08.320785 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c39ee4-99b6-4111-9be7-c6114112c867 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:08.379743 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016cfdf-a5c5-49a1-93f3-3dd264870264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:08.380959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016cfdf-a5c5-49a1-93f3-3dd264870264 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.381454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016cfdf-a5c5-49a1-93f3-3dd264870264 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.382031 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016cfdf-a5c5-49a1-93f3-3dd264870264 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.383290 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016cfdf-a5c5-49a1-93f3-3dd264870264 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:08.384437 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016cfdf-a5c5-49a1-93f3-3dd264870264 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:08.386299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016cfdf-a5c5-49a1-93f3-3dd264870264 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:08.404544 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 322/653] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:08.405838 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016cfdf-a5c5-49a1-93f3-3dd264870264 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:08.427940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8696e6a-8583-4087-9a64-9e3f7d5ce32c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:08.465078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb302b9-5ed4-40f1-9cd3-3987332ef8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:08.465774 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb302b9-5ed4-40f1-9cd3-3987332ef8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.466360 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb302b9-5ed4-40f1-9cd3-3987332ef8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.466360 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb302b9-5ed4-40f1-9cd3-3987332ef8d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.473325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:08.542031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb302b9-5ed4-40f1-9cd3-3987332ef8d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:08.543588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb302b9-5ed4-40f1-9cd3-3987332ef8d4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:08.549068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016cfdf-a5c5-49a1-93f3-3dd264870264 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:08.556046 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:08.586875 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1509974-6536-40d1-9f56-ed2b94c09bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:08.587549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1509974-6536-40d1-9f56-ed2b94c09bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.587831 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1509974-6536-40d1-9f56-ed2b94c09bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.588106 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1509974-6536-40d1-9f56-ed2b94c09bc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.588827 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1509974-6536-40d1-9f56-ed2b94c09bc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:08.589191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1509974-6536-40d1-9f56-ed2b94c09bc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:08.590604 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1509974-6536-40d1-9f56-ed2b94c09bc4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:08.603059 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 323/654] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:08.603941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1509974-6536-40d1-9f56-ed2b94c09bc4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:08.673910 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 332/655] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:29:08 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:08.675393 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb302b9-5ed4-40f1-9cd3-3987332ef8d4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:08.705314 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1509974-6536-40d1-9f56-ed2b94c09bc4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:08.713169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:08.742562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925d506-ae73-4ceb-ad47-9e18632f02d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:08.743492 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925d506-ae73-4ceb-ad47-9e18632f02d7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.743784 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925d506-ae73-4ceb-ad47-9e18632f02d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.744060 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925d506-ae73-4ceb-ad47-9e18632f02d7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.752447 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925d506-ae73-4ceb-ad47-9e18632f02d7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:08.754558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925d506-ae73-4ceb-ad47-9e18632f02d7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:08.770600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b925d506-ae73-4ceb-ad47-9e18632f02d7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:29:08.770600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:08.770600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:08.770600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:08.770600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:08.770600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:08.770600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:08.770600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:08.770600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:08.770600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:08.770600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:08.770600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:08.770600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:08.770600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:08.770600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:08.770600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:08.771599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:08.771599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:08.771599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:08.771599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:08.771599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:08.771599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:08.771599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:08.771599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:08.771599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:08.771599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:08.771599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:08.771599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:08.771599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:08.771599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:08.771599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:08.771599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:08.771599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:08.771599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:08.772979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:08.772979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:08.772979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:08.772979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:08.772979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:08.772979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:08.772979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:08.772979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:08.772979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:29:08.772979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:08.772979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 324/656] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:29:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:08.772979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925d506-ae73-4ceb-ad47-9e18632f02d7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:08.792179 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb302b9-5ed4-40f1-9cd3-3987332ef8d4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:08.802945 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:08.831024 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51bf7e-84fa-4da9-ae74-e1a0b65a12a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:08.832094 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51bf7e-84fa-4da9-ae74-e1a0b65a12a9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.832484 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51bf7e-84fa-4da9-ae74-e1a0b65a12a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.832862 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51bf7e-84fa-4da9-ae74-e1a0b65a12a9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.840796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51bf7e-84fa-4da9-ae74-e1a0b65a12a9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:08.842371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51bf7e-84fa-4da9-ae74-e1a0b65a12a9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:08.859154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-5e51bf7e-84fa-4da9-ae74-e1a0b65a12a9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:29:08.859154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:08.859154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:08.859154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:08.859154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:08.859154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:08.859154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:08.859154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:08.859154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:08.859154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:08.859154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:08.859154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:08.859154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:08.859154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:08.859154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:08.859154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:08.860300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:08.860300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:08.860300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:08.860300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:08.860300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:08.860300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:08.860300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:08.860300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:08.860300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:08.860300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:08.860300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:08.860300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:08.860300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:08.860300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:08.860300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:08.860300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:08.860300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:08.860300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:08.861438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:08.861438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:08.861438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:08.861438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:08.861438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:08.861438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:08.861438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:08.861438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:08.861438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:29:08.861438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:08.863410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 333/657] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:29:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:08.864297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51bf7e-84fa-4da9-ae74-e1a0b65a12a9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:08.895564 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925d506-ae73-4ceb-ad47-9e18632f02d7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:08.933206 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550573e9-8543-438a-9ada-a8d5391ea5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:08.934251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550573e9-8543-438a-9ada-a8d5391ea5ed None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.934720 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550573e9-8543-438a-9ada-a8d5391ea5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.935134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550573e9-8543-438a-9ada-a8d5391ea5ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.946834 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550573e9-8543-438a-9ada-a8d5391ea5ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:08.950352 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550573e9-8543-438a-9ada-a8d5391ea5ed None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:08.970760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-550573e9-8543-438a-9ada-a8d5391ea5ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:08.970760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:08.970760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:08.970760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:08.970760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:08.970760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:08.970760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:08.970760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:08.970760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:08.970760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:08.970760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:08.970760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:08.970760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:08.970760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:08.970760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:08.972650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:08.972650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:08.972650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:08.972650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:08.972650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:08.972650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:08.972650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:08.972650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:08.972650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:08.972650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:08.972650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:08.972650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:08.972650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:08.972650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:08.972650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:08.972650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:08.972650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:08.973549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:08.973549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:08.973549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:08.973549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:08.978332 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 325/658] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:08.979194 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550573e9-8543-438a-9ada-a8d5391ea5ed None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:08.986338 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51bf7e-84fa-4da9-ae74-e1a0b65a12a9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:08.999586 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:09.028466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac8576-657e-4710-9b35-5ea23ee7a5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:09.030743 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8576-657e-4710-9b35-5ea23ee7a5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.031361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8576-657e-4710-9b35-5ea23ee7a5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.031845 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8576-657e-4710-9b35-5ea23ee7a5f8 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.032957 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac8576-657e-4710-9b35-5ea23ee7a5f8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:09.033475 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac8576-657e-4710-9b35-5ea23ee7a5f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:09.035369 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac8576-657e-4710-9b35-5ea23ee7a5f8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:09.055840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 334/659] 10.222.0.110 () {56 vars in 1144 bytes} [Thu May 26 16:29:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:09.057209 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac8576-657e-4710-9b35-5ea23ee7a5f8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:09.087234 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550573e9-8543-438a-9ada-a8d5391ea5ed None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:09.088220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:09.123931 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8505bea-8938-429f-8401-3a7a8c096b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:09.124609 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8505bea-8938-429f-8401-3a7a8c096b02 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.124893 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8505bea-8938-429f-8401-3a7a8c096b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.125172 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8505bea-8938-429f-8401-3a7a8c096b02 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.126151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8505bea-8938-429f-8401-3a7a8c096b02 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:09.126461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8505bea-8938-429f-8401-3a7a8c096b02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:09.128144 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8505bea-8938-429f-8401-3a7a8c096b02 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:09.146174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 326/660] 10.222.0.110 () {56 vars in 1142 bytes} [Thu May 26 16:29:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:09.147064 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8505bea-8938-429f-8401-3a7a8c096b02 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:09.180294 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac8576-657e-4710-9b35-5ea23ee7a5f8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:09.220375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d44fbf-2a6c-4514-8b9b-bee7fd2db417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:09.221411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d44fbf-2a6c-4514-8b9b-bee7fd2db417 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.221908 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d44fbf-2a6c-4514-8b9b-bee7fd2db417 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.222404 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d44fbf-2a6c-4514-8b9b-bee7fd2db417 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.223537 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d44fbf-2a6c-4514-8b9b-bee7fd2db417 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:09.224153 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d44fbf-2a6c-4514-8b9b-bee7fd2db417 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:09.225887 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d44fbf-2a6c-4514-8b9b-bee7fd2db417 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:09.231168 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:09.242345 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 335/661] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:09.243724 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d44fbf-2a6c-4514-8b9b-bee7fd2db417 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:09.261440 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8505bea-8938-429f-8401-3a7a8c096b02 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:09.296160 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3072e0b-3135-4f5d-ae99-4f00d9c0b7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:09.296812 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3072e0b-3135-4f5d-ae99-4f00d9c0b7bf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.297157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3072e0b-3135-4f5d-ae99-4f00d9c0b7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.297365 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3072e0b-3135-4f5d-ae99-4f00d9c0b7bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.344265 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:09.364070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d44fbf-2a6c-4514-8b9b-bee7fd2db417 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:09.370372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3072e0b-3135-4f5d-ae99-4f00d9c0b7bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:09.370372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3072e0b-3135-4f5d-ae99-4f00d9c0b7bf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:09.402802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d59e88-ea3f-4991-8af4-5155050f7968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:09.403462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d59e88-ea3f-4991-8af4-5155050f7968 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.403751 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d59e88-ea3f-4991-8af4-5155050f7968 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.404033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d59e88-ea3f-4991-8af4-5155050f7968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.456248 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:09.478212 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d59e88-ea3f-4991-8af4-5155050f7968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:09.479868 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d59e88-ea3f-4991-8af4-5155050f7968 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:09.481722 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 327/662] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:29:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:09.482553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3072e0b-3135-4f5d-ae99-4f00d9c0b7bf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:09.580383 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:09.595158 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3072e0b-3135-4f5d-ae99-4f00d9c0b7bf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:09.599558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 336/663] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:29:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:09.600749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376e956-2418-4ae0-b6f5-8d56eaad3bdb None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.601039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376e956-2418-4ae0-b6f5-8d56eaad3bdb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.601312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376e956-2418-4ae0-b6f5-8d56eaad3bdb None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.602758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 337/664] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:09.603253 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376e956-2418-4ae0-b6f5-8d56eaad3bdb None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:09.635037 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89234e3-e204-430c-8fcb-52977d81ed1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:09.635836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89234e3-e204-430c-8fcb-52977d81ed1d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.636118 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89234e3-e204-430c-8fcb-52977d81ed1d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.636389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89234e3-e204-430c-8fcb-52977d81ed1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.643421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89234e3-e204-430c-8fcb-52977d81ed1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:09.644832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89234e3-e204-430c-8fcb-52977d81ed1d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:09.658675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d89234e3-e204-430c-8fcb-52977d81ed1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:09.658675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:09.658675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:09.658675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:09.658675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:09.658675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:09.658675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:09.658675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:09.658675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:09.658675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:09.658675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:09.658675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:09.658675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:09.658675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:09.658675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:09.660134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:09.660134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:09.660134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:09.660134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:09.660134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:09.660134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:09.660134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:09.660134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:09.660134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:09.660134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:09.660134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:09.660134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:09.660134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:09.660134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:09.660134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:09.660134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:09.660134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:09.661042 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:09.661042 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:09.661042 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:09.661042 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:09.661042 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:09.661042 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:09.661042 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:09.661042 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:09.665056 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 328/665] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:09.665889 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89234e3-e204-430c-8fcb-52977d81ed1d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:09.707048 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:09.717333 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376e956-2418-4ae0-b6f5-8d56eaad3bdb None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:09.753507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e0d32-cc70-4982-9c42-67ee5b906b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:09.754337 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e0d32-cc70-4982-9c42-67ee5b906b03 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.754659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e0d32-cc70-4982-9c42-67ee5b906b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.754936 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e0d32-cc70-4982-9c42-67ee5b906b03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.765066 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e0d32-cc70-4982-9c42-67ee5b906b03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:09.766546 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e0d32-cc70-4982-9c42-67ee5b906b03 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:09.778826 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89234e3-e204-430c-8fcb-52977d81ed1d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:09.785127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-4c9e0d32-cc70-4982-9c42-67ee5b906b03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:09.785127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:09.785127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:09.785127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:09.785127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:09.785127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:09.785127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:09.785127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:09.785127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:09.785127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:09.785127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:09.785127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:09.785127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:09.785127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:09.785127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:09.786020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:09.786020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:09.786020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:09.786020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:09.786020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:09.786020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:09.786020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:09.786020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:09.786020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:09.786020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:09.786020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:09.786020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:09.786020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:09.786020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:09.786020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:09.786020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:09.786020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:09.787318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:09.787318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:09.787318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:09.787318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:09.787318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 338/666] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:09.787960 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d642b-9a06-436d-a53f-6c0c88c93e92 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.788252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d642b-9a06-436d-a53f-6c0c88c93e92 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.788550 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d642b-9a06-436d-a53f-6c0c88c93e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.806063 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b09d642b-9a06-436d-a53f-6c0c88c93e92 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:09.807290 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b09d642b-9a06-436d-a53f-6c0c88c93e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:09.818984 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4896d1-b0e8-46e2-bb88-152bda8be8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:09.820046 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4896d1-b0e8-46e2-bb88-152bda8be8af None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.820506 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4896d1-b0e8-46e2-bb88-152bda8be8af None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.821012 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4896d1-b0e8-46e2-bb88-152bda8be8af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.833002 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4896d1-b0e8-46e2-bb88-152bda8be8af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:09.834664 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4896d1-b0e8-46e2-bb88-152bda8be8af None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:09.839564 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:09.852891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4a4896d1-b0e8-46e2-bb88-152bda8be8af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:09.852891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:09.852891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:09.852891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:09.852891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:09.852891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:09.852891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:09.852891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:09.852891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:09.852891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:09.852891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:09.852891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:09.852891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:09.852891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:09.852891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:09.853809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:09.853809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:09.853809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:09.853809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:09.853809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:09.853809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:09.853809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:09.853809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:09.853809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:09.853809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:09.853809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:09.853809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:09.853809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:09.853809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:09.853809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:09.853809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:09.853809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:09.854750 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:09.854750 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:09.854750 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:09.854750 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:09.858786 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 329/667] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:09.859671 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4896d1-b0e8-46e2-bb88-152bda8be8af None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:09.882293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 339/668] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:09.883196 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d642b-9a06-436d-a53f-6c0c88c93e92 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:09.961858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:09.978276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4896d1-b0e8-46e2-bb88-152bda8be8af None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:10.003591 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d642b-9a06-436d-a53f-6c0c88c93e92 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:10.015728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76713422-ef4d-445e-a206-73b23b55b21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:10.016398 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76713422-ef4d-445e-a206-73b23b55b21c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.016683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76713422-ef4d-445e-a206-73b23b55b21c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.016957 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76713422-ef4d-445e-a206-73b23b55b21c None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.017729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76713422-ef4d-445e-a206-73b23b55b21c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:10.018035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76713422-ef4d-445e-a206-73b23b55b21c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:10.020017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76713422-ef4d-445e-a206-73b23b55b21c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:10.037537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 330/669] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:10.037537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76713422-ef4d-445e-a206-73b23b55b21c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:10.046115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278fd4a-102e-41fe-a222-a4bcf1130324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:10.046930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278fd4a-102e-41fe-a222-a4bcf1130324 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.047287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278fd4a-102e-41fe-a222-a4bcf1130324 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.047632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278fd4a-102e-41fe-a222-a4bcf1130324 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.048426 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278fd4a-102e-41fe-a222-a4bcf1130324 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:10.048793 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278fd4a-102e-41fe-a222-a4bcf1130324 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:10.050280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278fd4a-102e-41fe-a222-a4bcf1130324 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:10.065823 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 340/670] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:10.065823 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278fd4a-102e-41fe-a222-a4bcf1130324 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:10.095698 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:10.150563 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76713422-ef4d-445e-a206-73b23b55b21c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:10.177269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278fd4a-102e-41fe-a222-a4bcf1130324 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:10.190553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb1763-0ffb-4d1b-b5ef-acdd410eb1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:10.191649 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb1763-0ffb-4d1b-b5ef-acdd410eb1ba None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.192452 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb1763-0ffb-4d1b-b5ef-acdd410eb1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.193164 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb1763-0ffb-4d1b-b5ef-acdd410eb1ba None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.194056 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb1763-0ffb-4d1b-b5ef-acdd410eb1ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:10.194652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb1763-0ffb-4d1b-b5ef-acdd410eb1ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:10.196483 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb1763-0ffb-4d1b-b5ef-acdd410eb1ba None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:10.213396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0a7a0-335f-4cad-bce8-3fd792296885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:10.213396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0a7a0-335f-4cad-bce8-3fd792296885 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.213396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0a7a0-335f-4cad-bce8-3fd792296885 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.213396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0a7a0-335f-4cad-bce8-3fd792296885 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.215963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 331/671] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:10.216992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb1763-0ffb-4d1b-b5ef-acdd410eb1ba None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:10.224764 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0a7a0-335f-4cad-bce8-3fd792296885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:10.229313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:10.232814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-ebc0a7a0-335f-4cad-bce8-3fd792296885 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:10.232814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:10.232814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:10.232814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:10.232814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:10.232814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:10.232814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:10.232814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:10.232814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:10.232814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:10.232814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:10.232814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:10.232814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:10.232814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:10.232814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:10.232814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:10.233739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:10.233739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:10.233739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:10.233739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:10.233739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:10.233739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:10.233739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:10.233739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:10.233739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:10.233739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:10.233739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:10.233739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:10.233739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:10.233739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:10.233739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:10.233739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:10.234632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:10.234632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:10.234632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:10.234632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:10.234632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:10.234632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:10.234632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:10.234632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:10.234632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:10.234632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:10.234632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:10.234632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:10.234632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 341/672] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:29:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:10.235425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0a7a0-335f-4cad-bce8-3fd792296885 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:10.327615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:10.336043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb1763-0ffb-4d1b-b5ef-acdd410eb1ba None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:10.340206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0a7a0-335f-4cad-bce8-3fd792296885 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:10.372340 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a56f0-2684-4c3b-ac52-7a535ca0fa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:10.373251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a56f0-2684-4c3b-ac52-7a535ca0fa12 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.373538 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a56f0-2684-4c3b-ac52-7a535ca0fa12 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.374063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a56f0-2684-4c3b-ac52-7a535ca0fa12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.374922 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a56f0-2684-4c3b-ac52-7a535ca0fa12 None admin] RBAC: Adding query filter params (role.id=a21e569e87fa4cb7bfb252986942b9ab, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=363d16eebb3f40a1be71506961cc3c5e) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:10.375238 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a56f0-2684-4c3b-ac52-7a535ca0fa12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:10.376657 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a56f0-2684-4c3b-ac52-7a535ca0fa12 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:10.380698 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e8eef-f647-424a-8d93-ade9931f5f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:10.381496 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e8eef-f647-424a-8d93-ade9931f5f50 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.381783 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e8eef-f647-424a-8d93-ade9931f5f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.382062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e8eef-f647-424a-8d93-ade9931f5f50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.382689 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 332/673] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:29:10 2022] GET /identity/v3/role_assignments?user.id=363d16eebb3f40a1be71506961cc3c5e&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=a21e569e87fa4cb7bfb252986942b9ab => generated 610 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:10.383303 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a56f0-2684-4c3b-ac52-7a535ca0fa12 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:10.397232 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e8eef-f647-424a-8d93-ade9931f5f50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:10.398782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e8eef-f647-424a-8d93-ade9931f5f50 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:10.415252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-3b7e8eef-f647-424a-8d93-ade9931f5f50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:10.415252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:10.415252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:10.415252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:10.415252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:10.415252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:10.415252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:10.415252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:10.415252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:10.415252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:10.415252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:10.415252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:10.415252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:10.415252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:10.415252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:10.416247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:10.416247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:10.416247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:10.416247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:10.416247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:10.416247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:10.416247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:10.416247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:10.416247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:10.416247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:10.416247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:10.416247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:10.416247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:10.416247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:10.416247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:10.416247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:10.416247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:10.417123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:10.417123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:10.417123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:10.417123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:10.417123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:10.417123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:10.417123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:10.417123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:10.417123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 342/674] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:10.418034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e8eef-f647-424a-8d93-ade9931f5f50 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:10.479631 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:10.516926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a56f0-2684-4c3b-ac52-7a535ca0fa12 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:10.531981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e8eef-f647-424a-8d93-ade9931f5f50 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:10.557324 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cd660-9057-481e-b4c8-19386d0fbfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:10.558653 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cd660-9057-481e-b4c8-19386d0fbfc4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.559451 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cd660-9057-481e-b4c8-19386d0fbfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.560094 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cd660-9057-481e-b4c8-19386d0fbfc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.568984 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cd660-9057-481e-b4c8-19386d0fbfc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:10.570702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cd660-9057-481e-b4c8-19386d0fbfc4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:10.571146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539465c2-8ea2-4d49-b01a-3abc8b41ed22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:10.571991 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539465c2-8ea2-4d49-b01a-3abc8b41ed22 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.572440 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539465c2-8ea2-4d49-b01a-3abc8b41ed22 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.572912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539465c2-8ea2-4d49-b01a-3abc8b41ed22 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.573836 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539465c2-8ea2-4d49-b01a-3abc8b41ed22 None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:10.574296 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539465c2-8ea2-4d49-b01a-3abc8b41ed22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:10.576749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539465c2-8ea2-4d49-b01a-3abc8b41ed22 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:10.586499 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 343/675] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:29:10 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:10.586839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e15cd660-9057-481e-b4c8-19386d0fbfc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:10.586839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:10.586839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:10.586839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:10.586839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:10.586839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:10.586839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:10.586839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:10.586839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:10.586839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:10.586839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:10.586839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:10.586839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:10.586839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:10.586839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:10.587710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:10.587710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:10.587710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:10.587710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:10.587710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:10.587710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:10.587710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:10.587710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:10.587710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:10.587710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:10.587710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:10.587710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:10.587710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:10.587710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:10.587710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:10.587710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:10.587710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:10.588612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:10.588612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:10.588612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:10.588612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:10.588612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:10.588612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:10.588612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:10.588612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:10.589045 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d7640-350e-4ba8-ad6d-149736770e43 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.589045 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d7640-350e-4ba8-ad6d-149736770e43 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.589045 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d7640-350e-4ba8-ad6d-149736770e43 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.590290 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 344/676] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:10.593773 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d7640-350e-4ba8-ad6d-149736770e43 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:10.593907 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 333/677] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:10.593907 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cd660-9057-481e-b4c8-19386d0fbfc4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:10.604604 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:10.703077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cd660-9057-481e-b4c8-19386d0fbfc4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:10.710134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d7640-350e-4ba8-ad6d-149736770e43 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:10.734794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:10.741543 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972449e-0039-429e-a51e-34f88d80c691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:10.742346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972449e-0039-429e-a51e-34f88d80c691 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.742656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972449e-0039-429e-a51e-34f88d80c691 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.742932 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972449e-0039-429e-a51e-34f88d80c691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.747159 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b16bd2-e646-4f04-85f0-13d6cb5478de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:10.747881 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b16bd2-e646-4f04-85f0-13d6cb5478de None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.748172 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b16bd2-e646-4f04-85f0-13d6cb5478de None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.748454 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b16bd2-e646-4f04-85f0-13d6cb5478de None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.749544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b16bd2-e646-4f04-85f0-13d6cb5478de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:10.750142 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b16bd2-e646-4f04-85f0-13d6cb5478de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:10.751530 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b16bd2-e646-4f04-85f0-13d6cb5478de None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:10.754241 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972449e-0039-429e-a51e-34f88d80c691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:10.755436 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972449e-0039-429e-a51e-34f88d80c691 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:10.769490 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 345/678] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:10.769490 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b16bd2-e646-4f04-85f0-13d6cb5478de None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:10.778491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e972449e-0039-429e-a51e-34f88d80c691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:10.778491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:10.778491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:10.778491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:10.778491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:10.778491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:10.778491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:10.778491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:10.778491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:10.778491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:10.778491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:10.778491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:10.778491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:10.778491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:10.778491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:10.779435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:10.779435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:10.779435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:10.779435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:10.779435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:10.779435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:10.779435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:10.779435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:10.779435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:10.779435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:10.779435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:10.779435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:10.779435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:10.779435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:10.779435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:10.779435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:10.779435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:10.780306 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:10.780306 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:10.780306 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:10.780306 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:10.783029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 334/679] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:10.784566 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98be6c-f333-481e-872c-f655db0a8c76 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.784859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98be6c-f333-481e-872c-f655db0a8c76 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.785137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98be6c-f333-481e-872c-f655db0a8c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.805320 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-de98be6c-f333-481e-872c-f655db0a8c76 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:10.807334 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-de98be6c-f333-481e-872c-f655db0a8c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:10.844792 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:10.879590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b16bd2-e646-4f04-85f0-13d6cb5478de None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:10.881350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 335/680] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:10.882342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98be6c-f333-481e-872c-f655db0a8c76 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:10.921792 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84240a50-c21a-4154-bab4-6a86f57ab47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:10.922456 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84240a50-c21a-4154-bab4-6a86f57ab47b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.923315 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84240a50-c21a-4154-bab4-6a86f57ab47b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.923602 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84240a50-c21a-4154-bab4-6a86f57ab47b None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.924430 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84240a50-c21a-4154-bab4-6a86f57ab47b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:10.924746 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84240a50-c21a-4154-bab4-6a86f57ab47b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:10.926672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84240a50-c21a-4154-bab4-6a86f57ab47b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:10.944266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 346/681] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:10.944266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84240a50-c21a-4154-bab4-6a86f57ab47b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:10.995206 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98be6c-f333-481e-872c-f655db0a8c76 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:11.010935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:11.035422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442a88b-8b04-4142-936b-c8234f494b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:11.036087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442a88b-8b04-4142-936b-c8234f494b93 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.036373 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442a88b-8b04-4142-936b-c8234f494b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.036650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442a88b-8b04-4142-936b-c8234f494b93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.037596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442a88b-8b04-4142-936b-c8234f494b93 None admin] RBAC: Adding query filter params (role.id=a21e569e87fa4cb7bfb252986942b9ab, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=f2411c1c780449e1a24fecb747cc3761) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:11.038026 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442a88b-8b04-4142-936b-c8234f494b93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:11.039476 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442a88b-8b04-4142-936b-c8234f494b93 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:11.046277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84240a50-c21a-4154-bab4-6a86f57ab47b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:11.052119 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 336/682] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:29:10 2022] GET /identity/v3/role_assignments?user.id=f2411c1c780449e1a24fecb747cc3761&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=a21e569e87fa4cb7bfb252986942b9ab => generated 610 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:11.052119 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442a88b-8b04-4142-936b-c8234f494b93 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:11.089942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdcecf-ee74-452b-a415-ad1b16bc607a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:11.090673 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdcecf-ee74-452b-a415-ad1b16bc607a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.090967 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdcecf-ee74-452b-a415-ad1b16bc607a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.092242 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdcecf-ee74-452b-a415-ad1b16bc607a None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.093048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdcecf-ee74-452b-a415-ad1b16bc607a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:11.093369 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdcecf-ee74-452b-a415-ad1b16bc607a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:11.094886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdcecf-ee74-452b-a415-ad1b16bc607a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:11.098906 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:11.117786 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 347/683] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:11.117786 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdcecf-ee74-452b-a415-ad1b16bc607a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:11.199631 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442a88b-8b04-4142-936b-c8234f494b93 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:11.238628 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb46729-b1d7-4834-b18a-f4b7257cf4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:11.239744 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb46729-b1d7-4834-b18a-f4b7257cf4ae None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.240177 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb46729-b1d7-4834-b18a-f4b7257cf4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.240432 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdcecf-ee74-452b-a415-ad1b16bc607a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:11.240810 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb46729-b1d7-4834-b18a-f4b7257cf4ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.255886 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb46729-b1d7-4834-b18a-f4b7257cf4ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:11.263039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-7cb46729-b1d7-4834-b18a-f4b7257cf4ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:11.263039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:11.263039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:11.263039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:11.263039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:11.263039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:11.263039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:11.263039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:11.263039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:11.263039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:11.263039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:11.263039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:11.263039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:11.263039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:11.263039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:11.263039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:11.263954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:11.263954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:11.263954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:11.263954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:11.263954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:11.263954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:11.263954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:11.263954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:11.263954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:11.263954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:11.263954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:11.263954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:11.263954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:11.263954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:11.263954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:11.263954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:11.264770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:11.264770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:11.264770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:11.264770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:11.264770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:11.264770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:11.264770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:11.264770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:11.264770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:11.264770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:11.264770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:11.264770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:11.264770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 337/684] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:29:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:11.265466 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb46729-b1d7-4834-b18a-f4b7257cf4ae None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:11.293107 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b461417-3c80-4b19-9b23-6c6f781bee50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:11.294188 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b461417-3c80-4b19-9b23-6c6f781bee50 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.294500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b461417-3c80-4b19-9b23-6c6f781bee50 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.294796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b461417-3c80-4b19-9b23-6c6f781bee50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.295629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b461417-3c80-4b19-9b23-6c6f781bee50 None admin] RBAC: Adding query filter params (role.id=a21e569e87fa4cb7bfb252986942b9ab, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=7ac42de1401441c0a3d4e7239e9b020e) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:11.296051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b461417-3c80-4b19-9b23-6c6f781bee50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:11.297525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b461417-3c80-4b19-9b23-6c6f781bee50 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:11.306922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 348/685] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:29:11 2022] GET /identity/v3/role_assignments?user.id=7ac42de1401441c0a3d4e7239e9b020e&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=a21e569e87fa4cb7bfb252986942b9ab => generated 610 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:11.307737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b461417-3c80-4b19-9b23-6c6f781bee50 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:11.314790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:11.395003 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:11.397502 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb46729-b1d7-4834-b18a-f4b7257cf4ae None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:11.436914 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3a070-1677-45c3-9422-888487351d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:11.437890 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3a070-1677-45c3-9422-888487351d63 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.438274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3a070-1677-45c3-9422-888487351d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.438698 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3a070-1677-45c3-9422-888487351d63 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.453817 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3a070-1677-45c3-9422-888487351d63 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:11.458321 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3a070-1677-45c3-9422-888487351d63 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:11.471481 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b461417-3c80-4b19-9b23-6c6f781bee50 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:11.493770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-33a3a070-1677-45c3-9422-888487351d63 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:11.493770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:11.493770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:11.493770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:11.493770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:11.493770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:11.493770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:11.493770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:11.493770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:11.493770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:11.493770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:11.493770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:11.493770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:11.493770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:11.493770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:11.493770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:11.494845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:11.494845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:11.494845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:11.494845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:11.494845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:11.494845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:11.494845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:11.494845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:11.494845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:11.494845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:11.494845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:11.494845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:11.494845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:11.494845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:11.494845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:11.494845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:11.494845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:11.494845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:11.495781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:11.495781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:11.495781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:11.495781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:11.495781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:11.495781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:11.495781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:11.495781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:11.495781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:11.495781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:11.496841 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 338/686] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:29:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:11.503928 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3a070-1677-45c3-9422-888487351d63 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:11.550039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9131b6-024c-4b9c-ad07-afb7ccad68c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:11.551719 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9131b6-024c-4b9c-ad07-afb7ccad68c4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.551719 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9131b6-024c-4b9c-ad07-afb7ccad68c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.551719 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9131b6-024c-4b9c-ad07-afb7ccad68c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.552189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9131b6-024c-4b9c-ad07-afb7ccad68c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:11.552715 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9131b6-024c-4b9c-ad07-afb7ccad68c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:11.554114 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9131b6-024c-4b9c-ad07-afb7ccad68c4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:11.568021 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 349/687] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:29:11 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:11.574350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9131b6-024c-4b9c-ad07-afb7ccad68c4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:11.663107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:11.667741 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3a070-1677-45c3-9422-888487351d63 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:11.708306 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b460f56-a81c-427f-bb44-877353313a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:11.708942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b460f56-a81c-427f-bb44-877353313a9f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.709231 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b460f56-a81c-427f-bb44-877353313a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.709503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b460f56-a81c-427f-bb44-877353313a9f None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.710346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b460f56-a81c-427f-bb44-877353313a9f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:11.710687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b460f56-a81c-427f-bb44-877353313a9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:11.712144 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b460f56-a81c-427f-bb44-877353313a9f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:11.719174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9131b6-024c-4b9c-ad07-afb7ccad68c4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:11.732175 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 339/688] 10.222.0.110 () {56 vars in 1140 bytes} [Thu May 26 16:29:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:11.737474 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b460f56-a81c-427f-bb44-877353313a9f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:11.740063 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:11.763811 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df63295-2ef4-441c-a46d-207d8bdac174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:11.765139 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df63295-2ef4-441c-a46d-207d8bdac174 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.765582 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df63295-2ef4-441c-a46d-207d8bdac174 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.766168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df63295-2ef4-441c-a46d-207d8bdac174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.782090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df63295-2ef4-441c-a46d-207d8bdac174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:11.785434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df63295-2ef4-441c-a46d-207d8bdac174 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:11.808274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-5df63295-2ef4-441c-a46d-207d8bdac174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:11.808274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:11.808274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:11.808274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:11.808274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:11.808274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:11.808274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:11.808274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:11.808274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:11.808274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:11.808274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:11.808274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:11.808274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:11.808274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:11.808274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:11.809406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:11.809406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:11.809406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:11.809406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:11.809406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:11.809406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:11.809406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:11.809406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:11.809406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:11.809406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:11.809406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:11.809406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:11.809406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:11.809406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:11.809406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:11.809406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:11.809406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:11.810496 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:11.810496 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:11.810496 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:11.810496 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:11.812943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 350/689] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:11.818523 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df63295-2ef4-441c-a46d-207d8bdac174 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:11.878544 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b460f56-a81c-427f-bb44-877353313a9f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:11.943671 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e2f7e-15cb-4b09-95ec-1d76dffa43d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:11.944255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e2f7e-15cb-4b09-95ec-1d76dffa43d3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.944531 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e2f7e-15cb-4b09-95ec-1d76dffa43d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.944807 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e2f7e-15cb-4b09-95ec-1d76dffa43d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.979930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df63295-2ef4-441c-a46d-207d8bdac174 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:12.016354 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7bd21-8235-4d58-968d-cfb703416d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:12.017395 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7bd21-8235-4d58-968d-cfb703416d22 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:12.017908 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7bd21-8235-4d58-968d-cfb703416d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:12.018504 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7bd21-8235-4d58-968d-cfb703416d22 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:12.019476 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7bd21-8235-4d58-968d-cfb703416d22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:12.020101 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7bd21-8235-4d58-968d-cfb703416d22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:12.021684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7bd21-8235-4d58-968d-cfb703416d22 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:12.023627 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:12.037453 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 351/690] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:12.047755 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7bd21-8235-4d58-968d-cfb703416d22 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:12.075168 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e2f7e-15cb-4b09-95ec-1d76dffa43d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:12.076594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e2f7e-15cb-4b09-95ec-1d76dffa43d3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:12.092558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:12.170251 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7bd21-8235-4d58-968d-cfb703416d22 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:12.208199 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b105efd-878c-498d-b218-cdd0bb5bddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:12.209346 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b105efd-878c-498d-b218-cdd0bb5bddae None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:12.209839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b105efd-878c-498d-b218-cdd0bb5bddae None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:12.210331 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b105efd-878c-498d-b218-cdd0bb5bddae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:12.218532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b105efd-878c-498d-b218-cdd0bb5bddae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:12.220415 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b105efd-878c-498d-b218-cdd0bb5bddae None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:12.236262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-8b105efd-878c-498d-b218-cdd0bb5bddae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:12.236262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:12.236262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:12.236262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:12.236262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:12.236262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:12.236262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:12.236262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:12.236262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:12.236262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:12.236262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:12.236262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:12.236262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:12.236262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:12.236262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:12.236262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:12.237869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:12.237869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:12.237869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:12.237869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:12.237869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:12.237869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:12.237869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:12.237869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:12.237869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:12.237869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:12.237869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:12.237869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:12.237869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:12.237869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:12.237869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:12.237869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:12.237869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:12.237869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:12.238864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:12.238864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:12.238864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:12.238864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:12.238864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:12.238864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:12.238864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:12.238864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:12.238864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:12.238864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:12.241561 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 352/691] 10.222.0.110 () {56 vars in 1098 bytes} [Thu May 26 16:29:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:12.246691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b105efd-878c-498d-b218-cdd0bb5bddae None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:12.297675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 340/692] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:29:11 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:12.303367 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e2f7e-15cb-4b09-95ec-1d76dffa43d3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:12.345112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:12.358457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b105efd-878c-498d-b218-cdd0bb5bddae None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:12.422819 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c838aa2-f30f-4b61-b9c7-58d2aebb1b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:12.424415 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c838aa2-f30f-4b61-b9c7-58d2aebb1b2b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:12.425372 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c838aa2-f30f-4b61-b9c7-58d2aebb1b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:12.425854 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c838aa2-f30f-4b61-b9c7-58d2aebb1b2b None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:12.427171 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c838aa2-f30f-4b61-b9c7-58d2aebb1b2b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:12.428315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:12.429245 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c838aa2-f30f-4b61-b9c7-58d2aebb1b2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:12.431628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c838aa2-f30f-4b61-b9c7-58d2aebb1b2b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:12.470714 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 353/693] 10.222.0.110 () {56 vars in 1138 bytes} [Thu May 26 16:29:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:12.474769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c838aa2-f30f-4b61-b9c7-58d2aebb1b2b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:12.521796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e2f7e-15cb-4b09-95ec-1d76dffa43d3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:12.590902 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae73cda-39bd-41b5-af82-fcdc5ade1692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:12.592109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae73cda-39bd-41b5-af82-fcdc5ade1692 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:12.593713 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae73cda-39bd-41b5-af82-fcdc5ade1692 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:12.594869 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae73cda-39bd-41b5-af82-fcdc5ade1692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:12.612969 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae73cda-39bd-41b5-af82-fcdc5ade1692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:12.615608 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae73cda-39bd-41b5-af82-fcdc5ade1692 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:12.645765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-0ae73cda-39bd-41b5-af82-fcdc5ade1692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:12.645765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:12.645765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:12.645765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:12.645765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:12.645765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:12.645765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:12.645765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:12.645765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:12.645765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:12.645765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:12.645765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:12.645765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:12.645765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:12.645765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:12.646941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:12.646941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:12.646941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:12.646941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:12.646941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:12.646941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:12.646941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:12.646941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:12.646941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:12.646941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:12.646941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:12.646941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:12.646941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:12.646941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:12.646941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:12.646941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:12.646941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:12.648024 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:12.648024 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:12.648024 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:12.648024 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:12.659592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 341/694] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:12.670481 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae73cda-39bd-41b5-af82-fcdc5ade1692 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:12.676115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c838aa2-f30f-4b61-b9c7-58d2aebb1b2b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:12.755858 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc60ef-3624-4595-8bfc-7817221bd27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:12.756577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc60ef-3624-4595-8bfc-7817221bd27c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:12.756938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc60ef-3624-4595-8bfc-7817221bd27c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:12.757195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc60ef-3624-4595-8bfc-7817221bd27c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:12.782666 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:12.789768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae73cda-39bd-41b5-af82-fcdc5ade1692 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:12.910233 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc60ef-3624-4595-8bfc-7817221bd27c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:12.911751 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc60ef-3624-4595-8bfc-7817221bd27c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:12.922027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:12.954937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17e9e1-3238-4a47-beeb-b641f86b2058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:12.956266 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17e9e1-3238-4a47-beeb-b641f86b2058 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:12.956617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17e9e1-3238-4a47-beeb-b641f86b2058 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:12.956982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17e9e1-3238-4a47-beeb-b641f86b2058 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:12.957873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17e9e1-3238-4a47-beeb-b641f86b2058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:12.958263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17e9e1-3238-4a47-beeb-b641f86b2058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:12.959883 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17e9e1-3238-4a47-beeb-b641f86b2058 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:12.978613 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 342/695] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:12.978613 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80b8ab-6907-4456-881b-2654d29ee2c8 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:12.978613 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80b8ab-6907-4456-881b-2654d29ee2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:12.978613 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80b8ab-6907-4456-881b-2654d29ee2c8 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:12.978613 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 343/696] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:12.980709 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80b8ab-6907-4456-881b-2654d29ee2c8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:13.042448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 354/697] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:29:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:13.042448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec324e-9b31-44f5-bc51-efba93015984 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.042448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec324e-9b31-44f5-bc51-efba93015984 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.042448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec324e-9b31-44f5-bc51-efba93015984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.060757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-63ec324e-9b31-44f5-bc51-efba93015984 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:13.062655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-63ec324e-9b31-44f5-bc51-efba93015984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:13.107776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80b8ab-6907-4456-881b-2654d29ee2c8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:13.126087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:13.166612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4e63c-f0e3-49dc-b392-3a9a29482ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:13.166612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4e63c-f0e3-49dc-b392-3a9a29482ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.166612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4e63c-f0e3-49dc-b392-3a9a29482ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.166612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4e63c-f0e3-49dc-b392-3a9a29482ed2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.167508 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 355/698] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:13.168609 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec324e-9b31-44f5-bc51-efba93015984 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:13.170550 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4e63c-f0e3-49dc-b392-3a9a29482ed2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:13.172270 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4e63c-f0e3-49dc-b392-3a9a29482ed2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:13.190620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-66c4e63c-f0e3-49dc-b392-3a9a29482ed2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:13.190620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:13.190620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:13.190620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:13.190620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:13.190620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:13.190620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:13.190620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:13.190620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:13.190620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:13.190620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:13.190620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:13.190620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:13.190620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:13.190620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:13.191554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:13.191554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:13.191554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:13.191554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:13.191554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:13.191554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:13.191554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:13.191554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:13.191554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:13.191554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:13.191554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:13.191554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:13.191554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:13.191554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:13.191554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:13.191554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:13.191554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:13.192487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:13.192487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:13.192487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:13.192487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:13.192487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:13.192487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:13.192487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:13.192487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:13.192487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 344/699] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:13.198294 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4e63c-f0e3-49dc-b392-3a9a29482ed2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:13.235932 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:13.294871 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec324e-9b31-44f5-bc51-efba93015984 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:13.318670 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4e63c-f0e3-49dc-b392-3a9a29482ed2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:13.333141 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f86d7-1520-4d58-9c2a-40fc86c03a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:13.334466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f86d7-1520-4d58-9c2a-40fc86c03a5f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.335023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f86d7-1520-4d58-9c2a-40fc86c03a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.335512 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f86d7-1520-4d58-9c2a-40fc86c03a5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.347231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f86d7-1520-4d58-9c2a-40fc86c03a5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:13.349253 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f86d7-1520-4d58-9c2a-40fc86c03a5f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:13.358906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b00fe2-47d5-40b7-a169-88929c5a641e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:13.358906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b00fe2-47d5-40b7-a169-88929c5a641e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.358906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b00fe2-47d5-40b7-a169-88929c5a641e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.358906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b00fe2-47d5-40b7-a169-88929c5a641e None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.359230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b00fe2-47d5-40b7-a169-88929c5a641e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:13.359230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b00fe2-47d5-40b7-a169-88929c5a641e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:13.360255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b00fe2-47d5-40b7-a169-88929c5a641e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:13.378241 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 345/700] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:13.379184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b00fe2-47d5-40b7-a169-88929c5a641e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:13.380054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-df9f86d7-1520-4d58-9c2a-40fc86c03a5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:13.380054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:13.380054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:13.380054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:13.380054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:13.380054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:13.380054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:13.380054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:13.380054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:13.380054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:13.380054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:13.380054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:13.380054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:13.380054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:13.380054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:13.380976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:13.380976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:13.380976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:13.380976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:13.380976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:13.380976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:13.380976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:13.380976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:13.380976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:13.380976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:13.380976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:13.380976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:13.380976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:13.380976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:13.380976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:13.380976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:13.380976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:13.382339 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:13.382339 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:13.382339 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:13.382339 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:13.389081 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 356/701] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:13.390354 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f86d7-1520-4d58-9c2a-40fc86c03a5f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:13.424025 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:13.481510 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:13.495155 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b00fe2-47d5-40b7-a169-88929c5a641e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:13.508380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f86d7-1520-4d58-9c2a-40fc86c03a5f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:13.533218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b57ad-c949-4e3c-b95d-c79723b80bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:13.534077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b57ad-c949-4e3c-b95d-c79723b80bba None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.534359 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b57ad-c949-4e3c-b95d-c79723b80bba None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.534658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b57ad-c949-4e3c-b95d-c79723b80bba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.546304 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b57ad-c949-4e3c-b95d-c79723b80bba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:13.547734 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b57ad-c949-4e3c-b95d-c79723b80bba None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:13.548878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb9b1c-b0a7-4097-a265-88b4160a1732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:13.550453 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb9b1c-b0a7-4097-a265-88b4160a1732 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.551049 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb9b1c-b0a7-4097-a265-88b4160a1732 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.551625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb9b1c-b0a7-4097-a265-88b4160a1732 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.552661 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb9b1c-b0a7-4097-a265-88b4160a1732 None admin] RBAC: Adding query filter params (role.id=a21e569e87fa4cb7bfb252986942b9ab, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=aa4502c57e324c31a8bce12770a92371) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:13.553173 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb9b1c-b0a7-4097-a265-88b4160a1732 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:13.554882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb9b1c-b0a7-4097-a265-88b4160a1732 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:13.562103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 357/702] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:29:13 2022] GET /identity/v3/role_assignments?user.id=aa4502c57e324c31a8bce12770a92371&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=a21e569e87fa4cb7bfb252986942b9ab => generated 610 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:13.563214 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb9b1c-b0a7-4097-a265-88b4160a1732 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:13.571687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-307b57ad-c949-4e3c-b95d-c79723b80bba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:13.571687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:13.571687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:13.571687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:13.571687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:13.571687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:13.571687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:13.571687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:13.571687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:13.571687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:13.571687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:13.571687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:13.571687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:13.571687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:13.571687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:13.572606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:13.572606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:13.572606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:13.572606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:13.572606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:13.572606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:13.572606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:13.572606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:13.572606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:13.572606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:13.572606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:13.572606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:13.572606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:13.572606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:13.572606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:13.572606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:13.572606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:13.573473 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:13.573473 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:13.573473 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:13.573473 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:13.579143 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 346/703] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:13.597623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b57ad-c949-4e3c-b95d-c79723b80bba None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:13.679719 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:13.692003 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb9b1c-b0a7-4097-a265-88b4160a1732 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:13.732364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6489f5-02aa-4d55-9e81-8b0341080fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:13.733054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6489f5-02aa-4d55-9e81-8b0341080fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.733347 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6489f5-02aa-4d55-9e81-8b0341080fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.733625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6489f5-02aa-4d55-9e81-8b0341080fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.734373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6489f5-02aa-4d55-9e81-8b0341080fa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:13.734724 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6489f5-02aa-4d55-9e81-8b0341080fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:13.736145 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6489f5-02aa-4d55-9e81-8b0341080fa0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:13.747172 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b57ad-c949-4e3c-b95d-c79723b80bba None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:13.754610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 358/704] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:13.754610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2454-19b9-494a-8dc7-56d407301b7f None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.754610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2454-19b9-494a-8dc7-56d407301b7f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.754610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2454-19b9-494a-8dc7-56d407301b7f None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.758420 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 359/705] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:13 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:13.760323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b67207-0428-4e42-a0ac-f20f018f9937 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.760783 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b67207-0428-4e42-a0ac-f20f018f9937 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.761164 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b67207-0428-4e42-a0ac-f20f018f9937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.779721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-76b67207-0428-4e42-a0ac-f20f018f9937 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:13.780974 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-76b67207-0428-4e42-a0ac-f20f018f9937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:13.801160 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c179f-f74d-4321-97ef-c7ab07be6785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:13.801765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c179f-f74d-4321-97ef-c7ab07be6785 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.802045 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c179f-f74d-4321-97ef-c7ab07be6785 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.802314 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c179f-f74d-4321-97ef-c7ab07be6785 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.803063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c179f-f74d-4321-97ef-c7ab07be6785 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:13.803370 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c179f-f74d-4321-97ef-c7ab07be6785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:13.804726 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c179f-f74d-4321-97ef-c7ab07be6785 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:13.816639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:13.822318 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 347/706] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:13.823184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c179f-f74d-4321-97ef-c7ab07be6785 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:13.878675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 360/707] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:29:13.880075 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b67207-0428-4e42-a0ac-f20f018f9937 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:13.965088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c179f-f74d-4321-97ef-c7ab07be6785 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:14.000122 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:14.006200 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f1589-5dce-4154-b3db-6a0f0a5cbbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:14.007057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f1589-5dce-4154-b3db-6a0f0a5cbbfb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.007341 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f1589-5dce-4154-b3db-6a0f0a5cbbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.007619 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f1589-5dce-4154-b3db-6a0f0a5cbbfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.015642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f1589-5dce-4154-b3db-6a0f0a5cbbfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:14.017094 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f1589-5dce-4154-b3db-6a0f0a5cbbfb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:14.021907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b67207-0428-4e42-a0ac-f20f018f9937 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:14.032274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-9f0f1589-5dce-4154-b3db-6a0f0a5cbbfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:14.032274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:14.032274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:14.032274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:14.032274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:14.032274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:14.032274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:14.032274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:14.032274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:14.032274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:14.032274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:14.032274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:14.032274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:14.032274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:14.032274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:14.033287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:14.033287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:14.033287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:14.033287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:14.033287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:14.033287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:14.033287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:14.033287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:14.033287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:14.033287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:14.033287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:14.033287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:14.033287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:14.033287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:14.033287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:14.033287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:14.033287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:14.034754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:14.034754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:14.034754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:14.034754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:14.034754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:14.034754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:14.034754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:14.034754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:14.034754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 348/708] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:14.035832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f1589-5dce-4154-b3db-6a0f0a5cbbfb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:14.064178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d3934-3a6a-41b7-9b9a-4aad37e97751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:14.065315 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d3934-3a6a-41b7-9b9a-4aad37e97751 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.065602 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d3934-3a6a-41b7-9b9a-4aad37e97751 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.065883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d3934-3a6a-41b7-9b9a-4aad37e97751 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.066612 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d3934-3a6a-41b7-9b9a-4aad37e97751 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:14.068058 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d3934-3a6a-41b7-9b9a-4aad37e97751 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:14.098822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 361/709] 10.222.0.110 () {60 vars in 1137 bytes} [Thu May 26 16:29:13 2022] POST /identity/v3/users => generated 255 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:29:14.099852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d3934-3a6a-41b7-9b9a-4aad37e97751 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:14.107028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:14.159592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f1589-5dce-4154-b3db-6a0f0a5cbbfb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:14.199482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceb2c0-7163-49cc-836e-31863ad280c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:14.199908 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb2c0-7163-49cc-836e-31863ad280c1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.200193 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb2c0-7163-49cc-836e-31863ad280c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.200468 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb2c0-7163-49cc-836e-31863ad280c1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.201133 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceb2c0-7163-49cc-836e-31863ad280c1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:14.202526 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceb2c0-7163-49cc-836e-31863ad280c1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:14.217328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-9bceb2c0-7163-49cc-836e-31863ad280c1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:29:14.217328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:14.217328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:14.217328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:14.217328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:14.217328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:14.217328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:14.217328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:14.217328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:29:14.217328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:14.217328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:14.217328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:14.217328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:14.217328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:14.217328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:14.217328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:14.217328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:14.218458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:14.218458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:14.218458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:14.218458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:14.218458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:14.218458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:14.218458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:14.218458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:14.218458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:14.218458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:14.218458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:14.218458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:14.218458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:14.218458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:14.218458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:14.218458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:14.219328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:14.219328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:14.219328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:14.219328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:14.219328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:14.219328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:14.219328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:14.219328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:14.219328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:14.219328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:14.219328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:14.219328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:14.219328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:29:14.219328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:14.219328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 349/710] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:14 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:14.220625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71e7d5-714c-4845-99c2-635e3180ff8e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.220723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71e7d5-714c-4845-99c2-635e3180ff8e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.221859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71e7d5-714c-4845-99c2-635e3180ff8e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.223113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 350/711] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:14.225089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71e7d5-714c-4845-99c2-635e3180ff8e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:14.239603 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d3934-3a6a-41b7-9b9a-4aad37e97751 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:14.280922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09ad56-b494-4f6d-9404-c13e2ff12aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:14.281600 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09ad56-b494-4f6d-9404-c13e2ff12aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.281931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09ad56-b494-4f6d-9404-c13e2ff12aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.282210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09ad56-b494-4f6d-9404-c13e2ff12aa4 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.283695 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09ad56-b494-4f6d-9404-c13e2ff12aa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:14.284022 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09ad56-b494-4f6d-9404-c13e2ff12aa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:14.286083 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09ad56-b494-4f6d-9404-c13e2ff12aa4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:14.296949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:14.309088 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 362/712] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:14.309088 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf8733-3146-4499-9288-74c10913dea4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.309340 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf8733-3146-4499-9288-74c10913dea4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.309824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf8733-3146-4499-9288-74c10913dea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.332688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-73bf8733-3146-4499-9288-74c10913dea4 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:14.333856 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-73bf8733-3146-4499-9288-74c10913dea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:14.373130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71e7d5-714c-4845-99c2-635e3180ff8e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:14.403192 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:14.419423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce7eab-f6ee-4672-a430-907aad8791c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:14.419873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce7eab-f6ee-4672-a430-907aad8791c4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.420243 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce7eab-f6ee-4672-a430-907aad8791c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.420564 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce7eab-f6ee-4672-a430-907aad8791c4 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.421283 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce7eab-f6ee-4672-a430-907aad8791c4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:14.421593 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce7eab-f6ee-4672-a430-907aad8791c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:14.422994 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce7eab-f6ee-4672-a430-907aad8791c4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:14.428689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 363/713] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:14.429377 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf8733-3146-4499-9288-74c10913dea4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:14.433989 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 351/714] 10.222.0.110 () {56 vars in 1117 bytes} [Thu May 26 16:29:14 2022] GET /identity/v3/services?name=network => generated 125 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:14.435461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce7eab-f6ee-4672-a430-907aad8791c4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:14.537837 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf8733-3146-4499-9288-74c10913dea4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:14.551102 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce7eab-f6ee-4672-a430-907aad8791c4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:14.566318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:14.575940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12987f1-1edd-438d-9ab0-89bf92bc028b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:14.576615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12987f1-1edd-438d-9ab0-89bf92bc028b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.576900 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12987f1-1edd-438d-9ab0-89bf92bc028b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.577177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12987f1-1edd-438d-9ab0-89bf92bc028b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.578280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12987f1-1edd-438d-9ab0-89bf92bc028b None admin] RBAC: Adding query filter params (role.id=1393d128d39b4649b6cd71b6609846cb, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=0043a7d5877f41de905afe6bef355867) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:14.578700 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12987f1-1edd-438d-9ab0-89bf92bc028b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:14.581661 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12987f1-1edd-438d-9ab0-89bf92bc028b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:14.594678 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 364/715] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:29:14 2022] GET /identity/v3/role_assignments?user.id=0043a7d5877f41de905afe6bef355867&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=1393d128d39b4649b6cd71b6609846cb => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:14.594678 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12987f1-1edd-438d-9ab0-89bf92bc028b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:14.603362 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f5d45-14ab-42f0-9bd0-19ae47a3bace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:14.604431 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f5d45-14ab-42f0-9bd0-19ae47a3bace None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.604942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f5d45-14ab-42f0-9bd0-19ae47a3bace None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.605409 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f5d45-14ab-42f0-9bd0-19ae47a3bace None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.606324 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f5d45-14ab-42f0-9bd0-19ae47a3bace None admin] RBAC: Adding query filter params (type=network) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:14.606877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f5d45-14ab-42f0-9bd0-19ae47a3bace None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:14.608437 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f5d45-14ab-42f0-9bd0-19ae47a3bace None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:14.625236 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 352/716] 10.222.0.110 () {56 vars in 1117 bytes} [Thu May 26 16:29:14 2022] GET /identity/v3/services?type=network => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:14.712152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12987f1-1edd-438d-9ab0-89bf92bc028b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:14.754310 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98066f5-8c48-4bfa-988f-d8491a327fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:14.755306 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98066f5-8c48-4bfa-988f-d8491a327fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.755591 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98066f5-8c48-4bfa-988f-d8491a327fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.755869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98066f5-8c48-4bfa-988f-d8491a327fe7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.756542 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98066f5-8c48-4bfa-988f-d8491a327fe7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:14.758083 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98066f5-8c48-4bfa-988f-d8491a327fe7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:14.774082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-e98066f5-8c48-4bfa-988f-d8491a327fe7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:29:14.774082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:14.774082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:14.774082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:14.774082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:14.774082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:14.774082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:14.774082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:14.774082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:29:14.774082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:14.774082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:14.774082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:14.774082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:14.774082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:14.774082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:14.774082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:14.775117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:14.775117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:14.775117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:14.775117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:14.775117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:14.775117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:14.775117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:14.775117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:14.775117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:14.775117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:14.775117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:14.775117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:14.775117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:14.775117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:14.775117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:14.775117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:14.775998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:14.775998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:14.775998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:14.775998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:14.775998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:14.775998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:14.775998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:14.775998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:14.775998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:14.775998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:14.775998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:14.775998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:14.775998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:14.775998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:29:14.775998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:14.775998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 365/717] 10.222.0.110 () {56 vars in 1134 bytes} [Thu May 26 16:29:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:14.781958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f5d45-14ab-42f0-9bd0-19ae47a3bace None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:14.867935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:14.921426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f5d45-14ab-42f0-9bd0-19ae47a3bace None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:14.958159 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328fda8-d312-4b87-b6e4-994a0c379215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:14.958870 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328fda8-d312-4b87-b6e4-994a0c379215 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.959153 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328fda8-d312-4b87-b6e4-994a0c379215 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.959426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328fda8-d312-4b87-b6e4-994a0c379215 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.960128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328fda8-d312-4b87-b6e4-994a0c379215 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:14.960434 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328fda8-d312-4b87-b6e4-994a0c379215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:14.961791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328fda8-d312-4b87-b6e4-994a0c379215 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:14.967024 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 353/718] 10.222.0.110 () {56 vars in 1129 bytes} [Thu May 26 16:29:14 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:14.975932 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98066f5-8c48-4bfa-988f-d8491a327fe7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:15.163063 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:15.215174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98066f5-8c48-4bfa-988f-d8491a327fe7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:15.257992 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed12ea2-158c-4d0f-a8e0-b6c931ac7601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:15.258684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed12ea2-158c-4d0f-a8e0-b6c931ac7601 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:15.258971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed12ea2-158c-4d0f-a8e0-b6c931ac7601 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:15.259246 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed12ea2-158c-4d0f-a8e0-b6c931ac7601 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:15.259954 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed12ea2-158c-4d0f-a8e0-b6c931ac7601 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:15.260260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed12ea2-158c-4d0f-a8e0-b6c931ac7601 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:15.261618 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed12ea2-158c-4d0f-a8e0-b6c931ac7601 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:15.268428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 366/719] 10.222.0.110 () {56 vars in 1129 bytes} [Thu May 26 16:29:14 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:16.568249 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44078ddf-b9fe-492d-b8b6-07fb9ddcba3c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:16.568769 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44078ddf-b9fe-492d-b8b6-07fb9ddcba3c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:16.569040 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44078ddf-b9fe-492d-b8b6-07fb9ddcba3c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:16.570597 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 354/720] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:16.576341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd24bd-257b-40e7-a6be-ed6da38b26e9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:16.576744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd24bd-257b-40e7-a6be-ed6da38b26e9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:16.576951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd24bd-257b-40e7-a6be-ed6da38b26e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:16.602919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-dedd24bd-257b-40e7-a6be-ed6da38b26e9 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:16.604100 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dedd24bd-257b-40e7-a6be-ed6da38b26e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:16.692270 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 367/721] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:29:16.727975 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44078ddf-b9fe-492d-b8b6-07fb9ddcba3c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:16.876415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44078ddf-b9fe-492d-b8b6-07fb9ddcba3c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:16.895758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:16.915044 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ad7f0-957b-4b8d-8d5c-c5a97f68ee68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:16.915851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ad7f0-957b-4b8d-8d5c-c5a97f68ee68 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:16.916134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ad7f0-957b-4b8d-8d5c-c5a97f68ee68 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:16.916408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ad7f0-957b-4b8d-8d5c-c5a97f68ee68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:16.927725 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ad7f0-957b-4b8d-8d5c-c5a97f68ee68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:16.935935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a62ad7f0-957b-4b8d-8d5c-c5a97f68ee68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:16.935935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:16.935935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:16.935935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:16.935935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:16.935935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:16.935935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:16.935935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:16.935935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:16.935935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:16.935935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:16.935935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:16.935935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:16.935935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:16.935935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:16.935935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:16.936862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:16.936862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:16.936862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:16.936862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:16.936862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:16.936862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:16.936862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:16.936862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:16.936862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:16.936862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:16.936862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:16.936862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:16.936862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:16.936862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:16.936862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:16.936862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:16.937707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:16.937707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:16.937707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:16.937707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:16.937707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:16.937707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:16.937707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:16.937707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:16.937707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:16.937707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:16.937707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:16.937707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:16.937707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 355/722] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:29:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:16.943323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd24bd-257b-40e7-a6be-ed6da38b26e9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:17.014799 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:17.083907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd24bd-257b-40e7-a6be-ed6da38b26e9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:17.138270 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9f636-867f-4970-8818-afc2572e0b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:17.139001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9f636-867f-4970-8818-afc2572e0b07 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:17.139280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9f636-867f-4970-8818-afc2572e0b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:17.139549 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9f636-867f-4970-8818-afc2572e0b07 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:17.140306 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9f636-867f-4970-8818-afc2572e0b07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:17.140610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9f636-867f-4970-8818-afc2572e0b07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:17.141976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9f636-867f-4970-8818-afc2572e0b07 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:17.154594 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 368/723] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:29:16 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:17.160831 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ad7f0-957b-4b8d-8d5c-c5a97f68ee68 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:17.203439 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1fcc2-4b5e-4a7d-8133-14184faca0e4 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:17.203735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1fcc2-4b5e-4a7d-8133-14184faca0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:17.203937 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1fcc2-4b5e-4a7d-8133-14184faca0e4 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:17.205445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 369/724] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:29:17.216709 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7c389-6d75-4f21-86df-a1f24c758b2f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:17.216998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7c389-6d75-4f21-86df-a1f24c758b2f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:17.217274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7c389-6d75-4f21-86df-a1f24c758b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:17.237988 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b7e7c389-6d75-4f21-86df-a1f24c758b2f None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:17.240227 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b7e7c389-6d75-4f21-86df-a1f24c758b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:17.305060 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ad7f0-957b-4b8d-8d5c-c5a97f68ee68 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:17.317048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 370/725] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:17.318220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45659d-0cc6-46c9-be3c-4a53dadbee68 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:17.318501 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45659d-0cc6-46c9-be3c-4a53dadbee68 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:17.318825 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45659d-0cc6-46c9-be3c-4a53dadbee68 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:17.320259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 371/726] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:17.321229 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d9c30-9a8d-4694-839e-cef434f827f9 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:17.321513 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d9c30-9a8d-4694-839e-cef434f827f9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:17.321787 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d9c30-9a8d-4694-839e-cef434f827f9 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:17.325696 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 372/727] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:17 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:17.331684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb176418-9a8d-4f7b-bdad-3351fe8d81e4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:17.331967 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb176418-9a8d-4f7b-bdad-3351fe8d81e4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:17.332240 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb176418-9a8d-4f7b-bdad-3351fe8d81e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:17.353254 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-eb176418-9a8d-4f7b-bdad-3351fe8d81e4 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:17.354096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71f9f5-74c2-4157-9c07-91324735c612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:17.354441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-eb176418-9a8d-4f7b-bdad-3351fe8d81e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:17.355370 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71f9f5-74c2-4157-9c07-91324735c612 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:17.355866 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71f9f5-74c2-4157-9c07-91324735c612 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:17.356495 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71f9f5-74c2-4157-9c07-91324735c612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:17.372497 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71f9f5-74c2-4157-9c07-91324735c612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:17.374212 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71f9f5-74c2-4157-9c07-91324735c612 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:17.392891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-dc71f9f5-74c2-4157-9c07-91324735c612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:17.392891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:17.392891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:17.392891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:17.392891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:17.392891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:17.392891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:17.392891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:17.392891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:17.392891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:17.392891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:17.392891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:17.392891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:17.392891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:17.392891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:17.393839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:17.393839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:17.393839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:17.393839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:17.393839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:17.393839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:17.393839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:17.393839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:17.393839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:17.393839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:17.393839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:17.393839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:17.393839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:17.393839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:17.393839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:17.393839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:17.393839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:17.394752 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:17.394752 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:17.394752 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:17.394752 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:17.394752 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 356/728] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:17.395667 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3a0c-d4fb-452d-a0af-cd2630b4a7af None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:17.395926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3a0c-d4fb-452d-a0af-cd2630b4a7af None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:17.396200 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3a0c-d4fb-452d-a0af-cd2630b4a7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:17.408334 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:17.412969 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9dbe3a0c-d4fb-452d-a0af-cd2630b4a7af None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:17.414150 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9dbe3a0c-d4fb-452d-a0af-cd2630b4a7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:17.437300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:17.445876 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 373/729] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:29:17.456212 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb176418-9a8d-4f7b-bdad-3351fe8d81e4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:17.498963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 357/730] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:17.500458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe3a0c-d4fb-452d-a0af-cd2630b4a7af None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:17.565496 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb176418-9a8d-4f7b-bdad-3351fe8d81e4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:17.601676 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc853a30-b80c-4f44-925f-cabb538baaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:17.602607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc853a30-b80c-4f44-925f-cabb538baaaa None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:17.602932 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc853a30-b80c-4f44-925f-cabb538baaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:17.603200 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc853a30-b80c-4f44-925f-cabb538baaaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:17.606150 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe3a0c-d4fb-452d-a0af-cd2630b4a7af None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:17.614390 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc853a30-b80c-4f44-925f-cabb538baaaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:17.622820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-dc853a30-b80c-4f44-925f-cabb538baaaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:17.622820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:17.622820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:17.622820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:17.622820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:17.622820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:17.622820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:17.622820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:17.622820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:17.622820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:17.622820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:17.622820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:17.622820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:17.622820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:17.622820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:17.622820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:17.624177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:17.624177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:17.624177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:17.624177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:17.624177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:17.624177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:17.624177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:17.624177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:17.624177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:17.624177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:17.624177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:17.624177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:17.624177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:17.624177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:17.624177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:17.624177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:17.625051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:17.625051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:17.625051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:17.625051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:17.625051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:17.625051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:17.625051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:17.625051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:17.625051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:17.625051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:17.625051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:17.625051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:17.625051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 374/731] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:29:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:17.625721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc853a30-b80c-4f44-925f-cabb538baaaa None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:17.649655 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99130639-404b-4a13-8c32-544dbd2913d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:17.650329 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99130639-404b-4a13-8c32-544dbd2913d1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:17.650646 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99130639-404b-4a13-8c32-544dbd2913d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:17.650930 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99130639-404b-4a13-8c32-544dbd2913d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:17.651652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99130639-404b-4a13-8c32-544dbd2913d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:17.651969 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99130639-404b-4a13-8c32-544dbd2913d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:17.653336 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99130639-404b-4a13-8c32-544dbd2913d1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:17.659089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:17.664660 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 358/732] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:17.665450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99130639-404b-4a13-8c32-544dbd2913d1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:17.685398 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:17.746125 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc853a30-b80c-4f44-925f-cabb538baaaa None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:17.771365 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99130639-404b-4a13-8c32-544dbd2913d1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:17.782495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d5afd-4c74-40ff-b19d-045c301dac75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:17.783901 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d5afd-4c74-40ff-b19d-045c301dac75 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:17.784456 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d5afd-4c74-40ff-b19d-045c301dac75 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:17.784740 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d5afd-4c74-40ff-b19d-045c301dac75 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:17.785582 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d5afd-4c74-40ff-b19d-045c301dac75 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:17.786977 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d5afd-4c74-40ff-b19d-045c301dac75 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:17.810596 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 375/733] 10.222.0.110 () {60 vars in 1146 bytes} [Thu May 26 16:29:17 2022] POST /identity/v3/services => generated 241 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:29:17.810596 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d5afd-4c74-40ff-b19d-045c301dac75 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:17.822578 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ae6a1-0af7-4f69-9fe2-fb38dce8c5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:17.823413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ae6a1-0af7-4f69-9fe2-fb38dce8c5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:17.823792 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ae6a1-0af7-4f69-9fe2-fb38dce8c5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:17.824074 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ae6a1-0af7-4f69-9fe2-fb38dce8c5b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:17.837389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ae6a1-0af7-4f69-9fe2-fb38dce8c5b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:17.847523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ad2ae6a1-0af7-4f69-9fe2-fb38dce8c5b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:17.847523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:17.847523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:17.847523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:17.847523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:17.847523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:17.847523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:17.847523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:17.847523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:17.847523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:17.847523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:17.847523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:17.847523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:17.847523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:17.847523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:17.847523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:17.848570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:17.848570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:17.848570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:17.848570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:17.848570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:17.848570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:17.848570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:17.848570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:17.848570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:17.848570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:17.848570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:17.848570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:17.848570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:17.848570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:17.848570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:17.848570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:17.849415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:17.849415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:17.849415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:17.849415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:17.849415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:17.849415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:17.849415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:17.849415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:17.849415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:17.849415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:17.849415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:17.849415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:17.854901 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 359/734] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:29:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:17.855220 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ae6a1-0af7-4f69-9fe2-fb38dce8c5b3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:17.925091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:17.937499 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d5afd-4c74-40ff-b19d-045c301dac75 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:17.953526 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:17.981260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca739351-9d44-458d-8c31-ef2fd363c409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:17.981951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca739351-9d44-458d-8c31-ef2fd363c409 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:17.982238 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca739351-9d44-458d-8c31-ef2fd363c409 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:17.982514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca739351-9d44-458d-8c31-ef2fd363c409 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:17.983304 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca739351-9d44-458d-8c31-ef2fd363c409 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:17.983610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca739351-9d44-458d-8c31-ef2fd363c409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:17.984615 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ae6a1-0af7-4f69-9fe2-fb38dce8c5b3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:17.984996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca739351-9d44-458d-8c31-ef2fd363c409 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:17.995192 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 376/735] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:29:17 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:17.996279 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca739351-9d44-458d-8c31-ef2fd363c409 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:18.025843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4b891-ea88-406a-bb7d-da2fbf129656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:18.026691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4b891-ea88-406a-bb7d-da2fbf129656 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.026981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4b891-ea88-406a-bb7d-da2fbf129656 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.027257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4b891-ea88-406a-bb7d-da2fbf129656 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.039619 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4b891-ea88-406a-bb7d-da2fbf129656 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:18.041069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4b891-ea88-406a-bb7d-da2fbf129656 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:18.060580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-0ca4b891-ea88-406a-bb7d-da2fbf129656 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:18.060580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:18.060580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:18.060580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:18.060580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:18.060580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:18.060580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:18.060580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:18.060580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:18.060580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:18.060580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:18.060580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:18.060580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:18.060580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:18.060580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:18.060580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:18.061794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:18.061794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:18.061794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:18.061794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:18.061794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:18.061794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:18.061794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:18.061794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:18.061794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:18.061794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:18.061794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:18.061794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:18.061794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:18.061794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:18.061794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:18.061794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:18.061794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:18.061794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:18.062855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:18.062855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:18.062855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:18.062855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:18.062855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:18.062855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:18.062855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:18.062855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:18.062855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:18.062855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:18.062855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 360/736] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:29:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:18.063465 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4b891-ea88-406a-bb7d-da2fbf129656 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:18.115178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca739351-9d44-458d-8c31-ef2fd363c409 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:18.151040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4e8fb-d44d-4de5-85eb-4f74f7ecde06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:18.151731 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4e8fb-d44d-4de5-85eb-4f74f7ecde06 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.152024 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4e8fb-d44d-4de5-85eb-4f74f7ecde06 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.152309 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4e8fb-d44d-4de5-85eb-4f74f7ecde06 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.153057 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4e8fb-d44d-4de5-85eb-4f74f7ecde06 None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:18.153374 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4e8fb-d44d-4de5-85eb-4f74f7ecde06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:18.154778 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4e8fb-d44d-4de5-85eb-4f74f7ecde06 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:18.163523 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 377/737] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:29:17 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:18.165572 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592f3a7-1df3-4ce5-9973-b3fcebd0067b None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.165870 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592f3a7-1df3-4ce5-9973-b3fcebd0067b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.166153 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592f3a7-1df3-4ce5-9973-b3fcebd0067b None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.171546 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 378/738] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:18 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:18.171546 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592f3a7-1df3-4ce5-9973-b3fcebd0067b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:18.180217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4b891-ea88-406a-bb7d-da2fbf129656 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:18.188276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:18.216369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25d3e6-6fba-4ab9-882b-9b66798b0de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:18.217179 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25d3e6-6fba-4ab9-882b-9b66798b0de0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.217466 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25d3e6-6fba-4ab9-882b-9b66798b0de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.217742 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25d3e6-6fba-4ab9-882b-9b66798b0de0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.219880 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:18.231859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25d3e6-6fba-4ab9-882b-9b66798b0de0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:18.233294 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25d3e6-6fba-4ab9-882b-9b66798b0de0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:18.251413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3d25d3e6-6fba-4ab9-882b-9b66798b0de0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:18.251413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:18.251413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:18.251413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:18.251413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:18.251413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:18.251413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:18.251413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:18.251413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:18.251413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:18.251413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:18.251413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:18.251413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:18.251413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:18.251413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:18.252387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:18.252387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:18.252387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:18.252387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:18.252387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:18.252387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:18.252387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:18.252387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:18.252387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:18.252387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:18.252387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:18.252387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:18.252387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:18.252387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:18.252387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:18.252387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:18.252387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:18.253881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:18.253881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:18.253881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:18.253881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:18.253881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 361/739] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:18.253881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25d3e6-6fba-4ab9-882b-9b66798b0de0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:18.285878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592f3a7-1df3-4ce5-9973-b3fcebd0067b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:18.319414 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95768b8f-6faf-4665-989d-ae39af122430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:18.320083 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95768b8f-6faf-4665-989d-ae39af122430 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.320367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95768b8f-6faf-4665-989d-ae39af122430 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.320649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95768b8f-6faf-4665-989d-ae39af122430 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.321477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95768b8f-6faf-4665-989d-ae39af122430 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:18.321789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95768b8f-6faf-4665-989d-ae39af122430 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:18.323285 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95768b8f-6faf-4665-989d-ae39af122430 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:18.341627 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 379/740] 10.222.0.110 () {56 vars in 1140 bytes} [Thu May 26 16:29:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:18.343069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439afdd-8688-4deb-8781-4385f83d9d61 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.343363 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439afdd-8688-4deb-8781-4385f83d9d61 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.343713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439afdd-8688-4deb-8781-4385f83d9d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.360479 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f439afdd-8688-4deb-8781-4385f83d9d61 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:18.362859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f439afdd-8688-4deb-8781-4385f83d9d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:18.373886 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25d3e6-6fba-4ab9-882b-9b66798b0de0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:18.409012 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1826c-0da7-469b-ae2d-d0a5f5bef129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:18.409815 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1826c-0da7-469b-ae2d-d0a5f5bef129 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.410100 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1826c-0da7-469b-ae2d-d0a5f5bef129 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.410375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1826c-0da7-469b-ae2d-d0a5f5bef129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.420922 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1826c-0da7-469b-ae2d-d0a5f5bef129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:18.422356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1826c-0da7-469b-ae2d-d0a5f5bef129 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:18.441281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f2f1826c-0da7-469b-ae2d-d0a5f5bef129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:18.441281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:18.441281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:18.441281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:18.441281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:18.441281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:18.441281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:18.441281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:18.441281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:18.441281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:18.441281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:18.441281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:18.441281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:18.441281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:18.441281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:18.446977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:18.446977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:18.446977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:18.446977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:18.446977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:18.446977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:18.446977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:18.446977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:18.446977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:18.446977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:18.446977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:18.446977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:18.446977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:18.446977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:18.446977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:18.446977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:18.446977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:18.447888 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:18.447888 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:18.447888 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:18.447888 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:18.447888 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 362/741] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:18.448194 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 380/742] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:18 2022] POST /identity/v3/auth/tokens => generated 899 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:18.448269 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1826c-0da7-469b-ae2d-d0a5f5bef129 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:18.448337 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439afdd-8688-4deb-8781-4385f83d9d61 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:18.460855 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:18.497340 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:18.559229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1826c-0da7-469b-ae2d-d0a5f5bef129 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:18.578238 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439afdd-8688-4deb-8781-4385f83d9d61 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:18.594301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f38496-48c2-485e-a6a6-08d888f7d7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:18.595005 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f38496-48c2-485e-a6a6-08d888f7d7dc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.595291 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f38496-48c2-485e-a6a6-08d888f7d7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.595601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f38496-48c2-485e-a6a6-08d888f7d7dc None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.596388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f38496-48c2-485e-a6a6-08d888f7d7dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:18.596641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f38496-48c2-485e-a6a6-08d888f7d7dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:18.598036 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f38496-48c2-485e-a6a6-08d888f7d7dc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:18.609920 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 363/743] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:18.610748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f38496-48c2-485e-a6a6-08d888f7d7dc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:18.619378 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90f587-ca05-4b59-bc2c-704bc98ab633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:18.620271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90f587-ca05-4b59-bc2c-704bc98ab633 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.620485 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90f587-ca05-4b59-bc2c-704bc98ab633 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.620816 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90f587-ca05-4b59-bc2c-704bc98ab633 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.690968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90f587-ca05-4b59-bc2c-704bc98ab633 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:18.692395 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90f587-ca05-4b59-bc2c-704bc98ab633 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:18.696185 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:18.715835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:18.719388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f38496-48c2-485e-a6a6-08d888f7d7dc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:18.757761 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394dec7-b384-45ec-987e-7177bff1bde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:18.758421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394dec7-b384-45ec-987e-7177bff1bde9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.758743 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394dec7-b384-45ec-987e-7177bff1bde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.759022 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394dec7-b384-45ec-987e-7177bff1bde9 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.759786 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394dec7-b384-45ec-987e-7177bff1bde9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:18.760038 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394dec7-b384-45ec-987e-7177bff1bde9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:18.761401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394dec7-b384-45ec-987e-7177bff1bde9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:18.773357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 364/744] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:18.774037 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394dec7-b384-45ec-987e-7177bff1bde9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:18.805128 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 381/745] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:29:18 2022] GET /identity/v3/auth/tokens => generated 899 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:18.806301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90f587-ca05-4b59-bc2c-704bc98ab633 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:18.891500 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394dec7-b384-45ec-987e-7177bff1bde9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:18.911751 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90f587-ca05-4b59-bc2c-704bc98ab633 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:18.914996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:18.929103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800535c4-0b37-4eef-8306-36d073770994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:18.930359 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800535c4-0b37-4eef-8306-36d073770994 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.931148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800535c4-0b37-4eef-8306-36d073770994 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.931637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800535c4-0b37-4eef-8306-36d073770994 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.932855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800535c4-0b37-4eef-8306-36d073770994 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:18.934417 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800535c4-0b37-4eef-8306-36d073770994 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:18.948990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 365/746] 10.222.0.110 () {60 vars in 1146 bytes} [Thu May 26 16:29:18 2022] POST /identity/v3/services => generated 252 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:29:18.948990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800535c4-0b37-4eef-8306-36d073770994 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:18.974400 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25321e9e-ecac-43bf-9106-6826cf0e9392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:18.975453 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321e9e-ecac-43bf-9106-6826cf0e9392 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.975816 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321e9e-ecac-43bf-9106-6826cf0e9392 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.976166 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321e9e-ecac-43bf-9106-6826cf0e9392 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.983180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:18.988372 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25321e9e-ecac-43bf-9106-6826cf0e9392 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:18.990687 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25321e9e-ecac-43bf-9106-6826cf0e9392 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:19.007744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-25321e9e-ecac-43bf-9106-6826cf0e9392 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:19.007744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:19.007744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:19.007744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:19.007744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:19.007744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:19.007744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:19.007744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:19.007744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:19.007744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:19.007744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:19.007744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:19.007744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:19.007744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:19.007744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:19.007744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:19.008754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:19.008754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:19.008754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:19.008754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:19.008754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:19.008754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:19.008754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:19.008754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:19.008754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:19.008754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:19.008754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:19.008754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:19.008754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:19.008754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:19.008754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:19.008754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:19.008754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:19.008754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:19.009765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:19.009765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:19.009765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:19.009765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:19.009765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:19.009765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:19.009765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:19.009765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:19.009765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:19.009765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:19.009765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 382/747] 10.222.0.110 () {56 vars in 1098 bytes} [Thu May 26 16:29:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:19.010343 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25321e9e-ecac-43bf-9106-6826cf0e9392 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:19.104375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800535c4-0b37-4eef-8306-36d073770994 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:19.135545 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25321e9e-ecac-43bf-9106-6826cf0e9392 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:19.158562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8e8d1-2f1b-4014-8ed2-d9cd5ccdb980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:19.160486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8e8d1-2f1b-4014-8ed2-d9cd5ccdb980 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:19.161081 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8e8d1-2f1b-4014-8ed2-d9cd5ccdb980 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:19.161565 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8e8d1-2f1b-4014-8ed2-d9cd5ccdb980 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:19.171476 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8e8d1-2f1b-4014-8ed2-d9cd5ccdb980 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:19.173195 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8e8d1-2f1b-4014-8ed2-d9cd5ccdb980 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:19.176623 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6a39a-774e-4fe2-ab11-8b42d4de705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:19.177973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6a39a-774e-4fe2-ab11-8b42d4de705e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:19.177973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6a39a-774e-4fe2-ab11-8b42d4de705e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:19.177973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6a39a-774e-4fe2-ab11-8b42d4de705e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:19.188831 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6a39a-774e-4fe2-ab11-8b42d4de705e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:19.191308 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6a39a-774e-4fe2-ab11-8b42d4de705e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:19.193396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-7db8e8d1-2f1b-4014-8ed2-d9cd5ccdb980 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:29:19.193396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:19.193396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:19.193396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:19.193396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:19.193396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:19.193396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:19.193396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:19.193396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:19.193396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:19.193396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:19.193396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:19.193396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:19.193396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:19.193396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:19.193396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:19.194313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:19.194313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:19.194313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:19.194313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:19.194313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:19.194313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:19.194313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:19.194313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:19.194313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:19.194313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:19.194313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:19.194313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:19.194313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:19.194313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:19.194313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:19.194313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:19.194313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:19.194313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:19.195315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:19.195315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:19.195315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:19.195315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:19.195315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:19.195315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:19.195315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:19.195315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:19.195315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:29:19.195315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:19.197785 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 366/748] 10.222.0.110 () {56 vars in 1122 bytes} [Thu May 26 16:29:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:19.198835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8e8d1-2f1b-4014-8ed2-d9cd5ccdb980 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:19.210134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-56f6a39a-774e-4fe2-ab11-8b42d4de705e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:19.210134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:19.210134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:19.210134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:19.210134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:19.210134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:19.210134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:19.210134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:19.210134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:19.210134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:19.210134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:19.210134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:19.210134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:19.210134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:19.210134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:19.211112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:19.211112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:19.211112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:19.211112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:19.211112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:19.211112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:19.211112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:19.211112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:19.211112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:19.211112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:19.211112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:19.211112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:19.211112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:19.211112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:19.211112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:19.211112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:19.211112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:19.211990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:19.211990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:19.211990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:19.211990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:19.214644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 383/749] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:19.215703 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6a39a-774e-4fe2-ab11-8b42d4de705e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:19.237422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:19.292099 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:19.316736 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8e8d1-2f1b-4014-8ed2-d9cd5ccdb980 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:19.339672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6a39a-774e-4fe2-ab11-8b42d4de705e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:19.352977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7b688-15dd-4579-8c64-b66e3fa45f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:19.353660 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7b688-15dd-4579-8c64-b66e3fa45f67 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:19.353951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7b688-15dd-4579-8c64-b66e3fa45f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:19.354235 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7b688-15dd-4579-8c64-b66e3fa45f67 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:19.355206 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7b688-15dd-4579-8c64-b66e3fa45f67 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:19.355634 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7b688-15dd-4579-8c64-b66e3fa45f67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:19.359075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7b688-15dd-4579-8c64-b66e3fa45f67 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:19.376410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 367/750] 10.222.0.110 () {56 vars in 1138 bytes} [Thu May 26 16:29:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:19.382701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd807a-27f5-499c-9556-d480e701d7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:19.382874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7b688-15dd-4579-8c64-b66e3fa45f67 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:19.382986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd807a-27f5-499c-9556-d480e701d7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:19.382986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd807a-27f5-499c-9556-d480e701d7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:19.382986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd807a-27f5-499c-9556-d480e701d7c0 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:19.382986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd807a-27f5-499c-9556-d480e701d7c0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:19.382986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd807a-27f5-499c-9556-d480e701d7c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:19.383470 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd807a-27f5-499c-9556-d480e701d7c0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:19.403440 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 384/751] 10.222.0.110 () {56 vars in 1154 bytes} [Thu May 26 16:29:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:19.404927 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd807a-27f5-499c-9556-d480e701d7c0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:19.481167 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:19.487771 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7b688-15dd-4579-8c64-b66e3fa45f67 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:19.516688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd807a-27f5-499c-9556-d480e701d7c0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:19.525048 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7788fa-bd9d-40b5-8993-c0b74cb05a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:19.525725 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7788fa-bd9d-40b5-8993-c0b74cb05a5f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:19.526392 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7788fa-bd9d-40b5-8993-c0b74cb05a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:19.526392 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7788fa-bd9d-40b5-8993-c0b74cb05a5f None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:19.527163 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7788fa-bd9d-40b5-8993-c0b74cb05a5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:19.527475 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7788fa-bd9d-40b5-8993-c0b74cb05a5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:19.529199 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7788fa-bd9d-40b5-8993-c0b74cb05a5f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:19.531500 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:19.547331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 368/752] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:19.547331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7788fa-bd9d-40b5-8993-c0b74cb05a5f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:19.564967 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef966d1-7320-441f-ba50-a84018ee6791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:19.566436 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef966d1-7320-441f-ba50-a84018ee6791 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:19.566997 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef966d1-7320-441f-ba50-a84018ee6791 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:19.567473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef966d1-7320-441f-ba50-a84018ee6791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:19.579382 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef966d1-7320-441f-ba50-a84018ee6791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:19.581669 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef966d1-7320-441f-ba50-a84018ee6791 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:19.601373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-4ef966d1-7320-441f-ba50-a84018ee6791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:19.601373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:19.601373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:19.601373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:19.601373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:19.601373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:19.601373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:19.601373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:19.601373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:19.601373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:19.601373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:19.601373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:19.601373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:19.601373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:19.601373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:19.602318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:19.602318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:19.602318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:19.602318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:19.602318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:19.602318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:19.602318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:19.602318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:19.602318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:19.602318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:19.602318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:19.602318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:19.602318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:19.602318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:19.602318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:19.602318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:19.602318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:19.603227 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:19.603227 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:19.603227 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:19.603227 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:19.605732 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 385/753] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:19.606942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef966d1-7320-441f-ba50-a84018ee6791 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:19.656386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7788fa-bd9d-40b5-8993-c0b74cb05a5f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:19.693425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c144105-fc2c-45a0-91f8-0801d48286f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:19.694100 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c144105-fc2c-45a0-91f8-0801d48286f2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:19.694390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c144105-fc2c-45a0-91f8-0801d48286f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:19.694699 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c144105-fc2c-45a0-91f8-0801d48286f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:19.719100 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef966d1-7320-441f-ba50-a84018ee6791 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:19.745774 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:19.759712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4ecac-9139-4015-830b-29f365c12456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:19.760941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4ecac-9139-4015-830b-29f365c12456 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:19.761453 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4ecac-9139-4015-830b-29f365c12456 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:19.761927 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4ecac-9139-4015-830b-29f365c12456 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:19.763378 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:19.772036 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4ecac-9139-4015-830b-29f365c12456 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:19.772181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c144105-fc2c-45a0-91f8-0801d48286f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:19.773503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c144105-fc2c-45a0-91f8-0801d48286f2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:19.774120 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4ecac-9139-4015-830b-29f365c12456 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:19.789595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-a9d4ecac-9139-4015-830b-29f365c12456 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:19.789595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:19.789595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:19.789595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:19.789595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:19.789595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:19.789595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:19.789595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:19.789595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:19.789595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:19.789595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:19.789595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:19.789595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:19.789595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:19.789595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:19.790495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:19.790495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:19.790495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:19.790495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:19.790495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:19.790495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:19.790495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:19.790495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:19.790495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:19.790495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:19.790495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:19.790495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:19.790495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:19.790495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:19.790495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:19.790495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:19.790495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:19.791408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:19.791408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:19.791408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:19.791408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:19.791408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:19.791408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:19.791408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:19.791408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:19.798400 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 386/754] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:19.800279 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4ecac-9139-4015-830b-29f365c12456 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:19.879614 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 369/755] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:29:19 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:29:19.880480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c144105-fc2c-45a0-91f8-0801d48286f2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:19.914842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4ecac-9139-4015-830b-29f365c12456 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:19.954126 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83e600-fb9a-4343-a7c2-fd489ffe2a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:19.955343 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e600-fb9a-4343-a7c2-fd489ffe2a18 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:19.955838 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e600-fb9a-4343-a7c2-fd489ffe2a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:19.956318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e600-fb9a-4343-a7c2-fd489ffe2a18 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:19.957361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83e600-fb9a-4343-a7c2-fd489ffe2a18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:19.957883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83e600-fb9a-4343-a7c2-fd489ffe2a18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:19.959555 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83e600-fb9a-4343-a7c2-fd489ffe2a18 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:19.973610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 387/756] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:19.974922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83e600-fb9a-4343-a7c2-fd489ffe2a18 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:19.984105 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:19.991586 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c144105-fc2c-45a0-91f8-0801d48286f2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:20.024358 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:20.030490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfc3dc-91f3-465d-b4df-117708188895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:20.031234 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfc3dc-91f3-465d-b4df-117708188895 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:20.031529 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfc3dc-91f3-465d-b4df-117708188895 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:20.031811 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfc3dc-91f3-465d-b4df-117708188895 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:20.032720 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfc3dc-91f3-465d-b4df-117708188895 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:20.033557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfc3dc-91f3-465d-b4df-117708188895 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:20.035146 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfc3dc-91f3-465d-b4df-117708188895 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:20.048380 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 370/757] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:20.049563 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfc3dc-91f3-465d-b4df-117708188895 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:20.105001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83e600-fb9a-4343-a7c2-fd489ffe2a18 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:20.143861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff0d3d-7976-41f7-b3f6-29a68ec2afb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:20.144935 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff0d3d-7976-41f7-b3f6-29a68ec2afb6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:20.145268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff0d3d-7976-41f7-b3f6-29a68ec2afb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:20.145591 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff0d3d-7976-41f7-b3f6-29a68ec2afb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:20.155812 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff0d3d-7976-41f7-b3f6-29a68ec2afb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:20.157246 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff0d3d-7976-41f7-b3f6-29a68ec2afb6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:20.163057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfc3dc-91f3-465d-b4df-117708188895 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:20.175052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-64ff0d3d-7976-41f7-b3f6-29a68ec2afb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:20.175052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:20.175052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:20.175052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:20.175052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:20.175052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:20.175052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:20.175052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:20.175052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:20.175052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:20.175052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:20.175052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:20.175052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:20.175052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:20.175052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:20.175955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:20.175955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:20.175955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:20.175955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:20.175955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:20.175955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:20.175955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:20.175955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:20.175955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:20.175955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:20.175955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:20.175955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:20.175955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:20.175955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:20.175955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:20.175955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:20.175955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:20.176842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:20.176842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:20.176842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:20.176842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:20.176842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 388/758] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:20.177125 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff0d3d-7976-41f7-b3f6-29a68ec2afb6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:20.200398 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d973b40-c3d6-40f5-821a-2bfaea3d2b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:20.201249 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d973b40-c3d6-40f5-821a-2bfaea3d2b33 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:20.201539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d973b40-c3d6-40f5-821a-2bfaea3d2b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:20.201841 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d973b40-c3d6-40f5-821a-2bfaea3d2b33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:20.209746 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d973b40-c3d6-40f5-821a-2bfaea3d2b33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:20.211236 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d973b40-c3d6-40f5-821a-2bfaea3d2b33 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:20.226033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-1d973b40-c3d6-40f5-821a-2bfaea3d2b33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:20.226033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:20.226033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:20.226033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:20.226033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:20.226033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:20.226033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:20.226033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:20.226033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:20.226033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:20.226033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:20.226033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:20.226033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:20.226033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:20.226033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:20.227120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:20.227120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:20.227120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:20.227120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:20.227120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:20.227120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:20.227120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:20.227120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:20.227120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:20.227120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:20.227120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:20.227120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:20.227120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:20.227120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:20.227120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:20.227120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:20.227120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:20.228190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:20.228190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:20.228190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:20.228190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:20.228190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:20.228190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:20.228190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:20.228190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:20.231810 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 371/759] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:20.233171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f147a48-0371-4c99-98f4-b399fc27e61e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:20.233466 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f147a48-0371-4c99-98f4-b399fc27e61e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:20.233753 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f147a48-0371-4c99-98f4-b399fc27e61e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:20.235053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 372/760] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:20.239237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f147a48-0371-4c99-98f4-b399fc27e61e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:20.260669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:20.288686 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:20.297202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff0d3d-7976-41f7-b3f6-29a68ec2afb6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:20.337100 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e50daa-1f1d-437e-a3c4-a700fabadfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:20.337767 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e50daa-1f1d-437e-a3c4-a700fabadfcd None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:20.338052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e50daa-1f1d-437e-a3c4-a700fabadfcd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:20.338331 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e50daa-1f1d-437e-a3c4-a700fabadfcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:20.339201 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e50daa-1f1d-437e-a3c4-a700fabadfcd None admin] RBAC: Adding query filter params (role.id=1393d128d39b4649b6cd71b6609846cb, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=aa4502c57e324c31a8bce12770a92371) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:20.339526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e50daa-1f1d-437e-a3c4-a700fabadfcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:20.340938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e50daa-1f1d-437e-a3c4-a700fabadfcd None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:20.354608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 389/761] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:29:20 2022] GET /identity/v3/role_assignments?user.id=aa4502c57e324c31a8bce12770a92371&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=1393d128d39b4649b6cd71b6609846cb => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:20.354608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e50daa-1f1d-437e-a3c4-a700fabadfcd None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:20.368574 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f147a48-0371-4c99-98f4-b399fc27e61e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:20.413219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4993a-a33e-4e55-95d8-a2de6eda6c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:20.414002 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4993a-a33e-4e55-95d8-a2de6eda6c6a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:20.414357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4993a-a33e-4e55-95d8-a2de6eda6c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:20.414736 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4993a-a33e-4e55-95d8-a2de6eda6c6a None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:20.415647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4993a-a33e-4e55-95d8-a2de6eda6c6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:20.416027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4993a-a33e-4e55-95d8-a2de6eda6c6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:20.417540 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4993a-a33e-4e55-95d8-a2de6eda6c6a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:20.431823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 373/762] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:20.433257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc37ea-c094-4454-b00b-b1427499072b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:20.433607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc37ea-c094-4454-b00b-b1427499072b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:20.433942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc37ea-c094-4454-b00b-b1427499072b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:20.453591 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f0cc37ea-c094-4454-b00b-b1427499072b None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:20.455027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f0cc37ea-c094-4454-b00b-b1427499072b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:20.499263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e50daa-1f1d-437e-a3c4-a700fabadfcd None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:20.541946 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 374/763] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:20 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:20.542823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc37ea-c094-4454-b00b-b1427499072b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:20.553613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f909b3-ce43-47d0-a576-2765759627d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:20.556071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f909b3-ce43-47d0-a576-2765759627d4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:20.556071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f909b3-ce43-47d0-a576-2765759627d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:20.556071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f909b3-ce43-47d0-a576-2765759627d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:20.556071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f909b3-ce43-47d0-a576-2765759627d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:20.560090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f909b3-ce43-47d0-a576-2765759627d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:20.560527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:20.561550 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f909b3-ce43-47d0-a576-2765759627d4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:20.576702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 390/764] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:20.577568 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f909b3-ce43-47d0-a576-2765759627d4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:20.600623 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:20.683222 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f909b3-ce43-47d0-a576-2765759627d4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:20.685716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc37ea-c094-4454-b00b-b1427499072b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:20.719686 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8be37-7c9e-4b00-883a-0e913b49ebd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:20.721726 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8be37-7c9e-4b00-883a-0e913b49ebd9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:20.722305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8be37-7c9e-4b00-883a-0e913b49ebd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:20.722831 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8be37-7c9e-4b00-883a-0e913b49ebd9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:20.723692 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8be37-7c9e-4b00-883a-0e913b49ebd9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:20.725267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8be37-7c9e-4b00-883a-0e913b49ebd9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:20.729047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11cca5-9c87-4d33-826f-0baa9aa5341f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:20.730216 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11cca5-9c87-4d33-826f-0baa9aa5341f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:20.730590 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11cca5-9c87-4d33-826f-0baa9aa5341f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:20.730940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11cca5-9c87-4d33-826f-0baa9aa5341f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:20.738238 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11cca5-9c87-4d33-826f-0baa9aa5341f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:20.739106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-45b8be37-7c9e-4b00-883a-0e913b49ebd9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:29:20.739106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:20.739106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:20.739106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:20.739106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:20.739106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:20.739106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:20.739106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:20.739106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:29:20.739106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:20.739106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:20.739106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:20.739106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:20.739106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:20.739106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:20.739106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:20.739106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:20.740103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:20.740103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:20.740103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:20.740103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:20.740103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:20.740103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:20.740103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:20.740103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:20.740103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:20.740103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:20.740103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:20.740103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:20.740103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:20.740103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:20.740103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:20.740103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:20.740941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:20.740941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:20.740941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:20.740941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:20.740941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:20.740941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:20.740941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:20.740941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:20.740941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:20.740941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:20.740941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:20.740941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:20.740941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:29:20.740941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:20.741770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11cca5-9c87-4d33-826f-0baa9aa5341f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:20.744064 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 391/765] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:20 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:20.745027 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8be37-7c9e-4b00-883a-0e913b49ebd9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:20.769527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-9a11cca5-9c87-4d33-826f-0baa9aa5341f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:20.769527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:20.769527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:20.769527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:20.769527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:20.769527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:20.769527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:20.769527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:20.769527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:20.769527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:20.769527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:20.769527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:20.769527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:20.769527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:20.769527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:20.770486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:20.770486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:20.770486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:20.770486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:20.770486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:20.770486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:20.770486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:20.770486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:20.770486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:20.770486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:20.770486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:20.770486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:20.770486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:20.770486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:20.770486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:20.770486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:20.770486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:20.771438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:20.771438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:20.771438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:20.771438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:20.771438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:20.771438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:20.771438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:20.771438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:20.771438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 375/766] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:20.772476 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11cca5-9c87-4d33-826f-0baa9aa5341f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:20.842471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:20.856533 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:20.882688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8be37-7c9e-4b00-883a-0e913b49ebd9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:20.883984 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11cca5-9c87-4d33-826f-0baa9aa5341f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:20.920082 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a5ae8-0254-4e62-952b-43ddbbdd25bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:20.921184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a5ae8-0254-4e62-952b-43ddbbdd25bd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:20.921675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a5ae8-0254-4e62-952b-43ddbbdd25bd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:20.922139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a5ae8-0254-4e62-952b-43ddbbdd25bd None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:20.923105 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a5ae8-0254-4e62-952b-43ddbbdd25bd None admin] RBAC: Adding query filter params (name=network) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:20.923701 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a5ae8-0254-4e62-952b-43ddbbdd25bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:20.925247 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a5ae8-0254-4e62-952b-43ddbbdd25bd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:20.925663 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7748155-a767-4098-be08-8b56d6eae688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:20.926818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7748155-a767-4098-be08-8b56d6eae688 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:20.927175 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7748155-a767-4098-be08-8b56d6eae688 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:20.927522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7748155-a767-4098-be08-8b56d6eae688 None admin] PATH_INFO: `/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/0043a7d5877f41de905afe6bef355867/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:20.930163 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7748155-a767-4098-be08-8b56d6eae688 None admin] RBAC: Authorizing `identity:create_grant(project_id=d33e1f400b3e46379d2a0abd05921181, user_id=0043a7d5877f41de905afe6bef355867, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:20.935699 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7748155-a767-4098-be08-8b56d6eae688 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:20.936231 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 376/767] 10.222.0.110 () {56 vars in 1117 bytes} [Thu May 26 16:29:20 2022] GET /identity/v3/services?name=network => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:20.937374 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a5ae8-0254-4e62-952b-43ddbbdd25bd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:20.948482 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 392/768] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:29:20 2022] PUT /identity/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/0043a7d5877f41de905afe6bef355867/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:29:20.949780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7748155-a767-4098-be08-8b56d6eae688 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:21.084109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a5ae8-0254-4e62-952b-43ddbbdd25bd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:21.118876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:21.131029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb1e14-c3d6-4405-96fb-2a8dc3c34e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:21.132154 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb1e14-c3d6-4405-96fb-2a8dc3c34e4e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:21.132647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb1e14-c3d6-4405-96fb-2a8dc3c34e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:21.133146 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb1e14-c3d6-4405-96fb-2a8dc3c34e4e None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:21.134162 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb1e14-c3d6-4405-96fb-2a8dc3c34e4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:21.134722 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb1e14-c3d6-4405-96fb-2a8dc3c34e4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:21.144878 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb1e14-c3d6-4405-96fb-2a8dc3c34e4e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:21.166083 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 377/769] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:21.172581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb1e14-c3d6-4405-96fb-2a8dc3c34e4e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:21.186476 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7748155-a767-4098-be08-8b56d6eae688 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:21.229075 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4998d1-c8c9-4b44-a0e1-453e6d0cccb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:21.229766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4998d1-c8c9-4b44-a0e1-453e6d0cccb7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:21.230060 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4998d1-c8c9-4b44-a0e1-453e6d0cccb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:21.230343 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4998d1-c8c9-4b44-a0e1-453e6d0cccb7 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:21.231256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4998d1-c8c9-4b44-a0e1-453e6d0cccb7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:21.232784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4998d1-c8c9-4b44-a0e1-453e6d0cccb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:21.234346 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4998d1-c8c9-4b44-a0e1-453e6d0cccb7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:21.241446 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 393/770] 10.222.0.110 () {56 vars in 1117 bytes} [Thu May 26 16:29:20 2022] GET /identity/v3/services?type=network => generated 352 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:21.247349 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4998d1-c8c9-4b44-a0e1-453e6d0cccb7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:21.260783 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:21.327651 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb1e14-c3d6-4405-96fb-2a8dc3c34e4e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:21.397667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4998d1-c8c9-4b44-a0e1-453e6d0cccb7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:21.415280 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0fa91-ca0c-4877-b45f-1f5bb5867f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:21.416195 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0fa91-ca0c-4877-b45f-1f5bb5867f6f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:21.416624 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0fa91-ca0c-4877-b45f-1f5bb5867f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:21.417069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0fa91-ca0c-4877-b45f-1f5bb5867f6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:21.418048 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0fa91-ca0c-4877-b45f-1f5bb5867f6f None admin] RBAC: Adding query filter params (role.id=a21e569e87fa4cb7bfb252986942b9ab, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=ebf3257328b94092b544cb0dadb789c3) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:21.418506 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0fa91-ca0c-4877-b45f-1f5bb5867f6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:21.420257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0fa91-ca0c-4877-b45f-1f5bb5867f6f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:21.432283 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42223d-cfc8-4fc4-8929-f72c3e88d231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:21.432966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42223d-cfc8-4fc4-8929-f72c3e88d231 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:21.433262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42223d-cfc8-4fc4-8929-f72c3e88d231 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:21.433546 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42223d-cfc8-4fc4-8929-f72c3e88d231 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:21.434351 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42223d-cfc8-4fc4-8929-f72c3e88d231 None admin] RBAC: Adding query filter params (interface=public, service_id=3f9c9dba1aba49f7a92378915abf5681, region_id=RegionOne) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:21.434702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42223d-cfc8-4fc4-8929-f72c3e88d231 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:21.435523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 378/771] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:29:21 2022] GET /identity/v3/role_assignments?user.id=ebf3257328b94092b544cb0dadb789c3&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=a21e569e87fa4cb7bfb252986942b9ab => generated 260 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:21.438591 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42223d-cfc8-4fc4-8929-f72c3e88d231 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:21.445256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 394/772] 10.222.0.110 () {56 vars in 1256 bytes} [Thu May 26 16:29:21 2022] GET /identity/v3/endpoints?service_id=3f9c9dba1aba49f7a92378915abf5681&interface=public®ion_id=RegionOne => generated 195 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:21.450548 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0fa91-ca0c-4877-b45f-1f5bb5867f6f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:21.474586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456c85b-d5e2-4bd0-bc57-459afed808ec None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:21.474586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456c85b-d5e2-4bd0-bc57-459afed808ec None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:21.474586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456c85b-d5e2-4bd0-bc57-459afed808ec None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:21.474586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 395/773] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:21.484294 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7717a-137d-40e5-859a-6a4a656c38a8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:21.484601 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7717a-137d-40e5-859a-6a4a656c38a8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:21.484857 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7717a-137d-40e5-859a-6a4a656c38a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:21.512631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-13b7717a-137d-40e5-859a-6a4a656c38a8 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:21.513843 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-13b7717a-137d-40e5-859a-6a4a656c38a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:21.523975 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:21.622807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 396/774] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:21 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) May 26 16:29:21.623401 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:21.636592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0fa91-ca0c-4877-b45f-1f5bb5867f6f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:21.663085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7717a-137d-40e5-859a-6a4a656c38a8 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:21.687642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9b2a8-2dc3-4e7a-a62c-786305176dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:21.688324 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9b2a8-2dc3-4e7a-a62c-786305176dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:21.688614 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9b2a8-2dc3-4e7a-a62c-786305176dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:21.688894 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9b2a8-2dc3-4e7a-a62c-786305176dd1 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:21.690116 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9b2a8-2dc3-4e7a-a62c-786305176dd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:21.691551 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9b2a8-2dc3-4e7a-a62c-786305176dd1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:21.700316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 379/775] 10.222.0.110 () {56 vars in 1092 bytes} [Thu May 26 16:29:21 2022] GET /identity/v3/services => generated 776 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:21.794255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7717a-137d-40e5-859a-6a4a656c38a8 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:21.833223 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82d712-1f96-4518-9dae-d3d23aefc7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:21.834048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82d712-1f96-4518-9dae-d3d23aefc7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:21.834338 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82d712-1f96-4518-9dae-d3d23aefc7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:21.834645 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82d712-1f96-4518-9dae-d3d23aefc7b3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:21.835310 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82d712-1f96-4518-9dae-d3d23aefc7b3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:21.836687 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82d712-1f96-4518-9dae-d3d23aefc7b3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:21.849352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-ca82d712-1f96-4518-9dae-d3d23aefc7b3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:29:21.849352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:21.849352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:21.849352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:21.849352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:21.849352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:21.849352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:21.849352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:21.849352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:29:21.849352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:21.849352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:21.849352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:21.849352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:21.849352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:21.849352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:21.849352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:21.850332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:21.850332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:21.850332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:21.850332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:21.850332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:21.850332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:21.850332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:21.850332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:21.850332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:21.850332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:21.850332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:21.850332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:21.850332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:21.850332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:21.850332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:21.850332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:21.851225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:21.851225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:21.851225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:21.851225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:21.851225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:21.851225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:21.851225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:21.851225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:21.851225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:21.851225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:21.851225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:21.851225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:21.851225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:21.851225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:29:21.851225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:21.851225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 397/776] 10.222.0.110 () {56 vars in 1134 bytes} [Thu May 26 16:29:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:21.857007 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9b2a8-2dc3-4e7a-a62c-786305176dd1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:21.980785 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9b2a8-2dc3-4e7a-a62c-786305176dd1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:21.998996 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:22.020119 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471046e-5088-4393-a0be-a74844c17ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:22.020800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471046e-5088-4393-a0be-a74844c17ece None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:22.021089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471046e-5088-4393-a0be-a74844c17ece None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:22.021371 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471046e-5088-4393-a0be-a74844c17ece None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:22.022082 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471046e-5088-4393-a0be-a74844c17ece None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:22.022395 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471046e-5088-4393-a0be-a74844c17ece None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:22.023794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471046e-5088-4393-a0be-a74844c17ece None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:22.028775 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 380/777] 10.222.0.110 () {56 vars in 1129 bytes} [Thu May 26 16:29:21 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:22.034273 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82d712-1f96-4518-9dae-d3d23aefc7b3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:22.119242 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:22.171305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82d712-1f96-4518-9dae-d3d23aefc7b3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:22.210703 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7d475-3d7f-40e8-9293-8f0af3934095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:22.211837 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7d475-3d7f-40e8-9293-8f0af3934095 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:22.212332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7d475-3d7f-40e8-9293-8f0af3934095 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:22.212817 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7d475-3d7f-40e8-9293-8f0af3934095 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:22.213737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7d475-3d7f-40e8-9293-8f0af3934095 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:22.214253 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7d475-3d7f-40e8-9293-8f0af3934095 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:22.215957 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7d475-3d7f-40e8-9293-8f0af3934095 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:22.222556 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 398/778] 10.222.0.110 () {56 vars in 1129 bytes} [Thu May 26 16:29:22 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:22.227884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471046e-5088-4393-a0be-a74844c17ece None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:22.366054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471046e-5088-4393-a0be-a74844c17ece None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:22.425793 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2a428-ad79-4c0a-bf6a-62ec33a9d03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:22.426479 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2a428-ad79-4c0a-bf6a-62ec33a9d03a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:22.426805 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2a428-ad79-4c0a-bf6a-62ec33a9d03a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:22.427086 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2a428-ad79-4c0a-bf6a-62ec33a9d03a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:22.427885 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2a428-ad79-4c0a-bf6a-62ec33a9d03a None admin] RBAC: Adding query filter params (interface=public, service_id=c374ff0df7764c89bccace6f01f7f90f, region_id=RegionOne) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:22.428203 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2a428-ad79-4c0a-bf6a-62ec33a9d03a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:22.429574 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2a428-ad79-4c0a-bf6a-62ec33a9d03a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:22.440907 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 381/779] 10.222.0.110 () {56 vars in 1256 bytes} [Thu May 26 16:29:22 2022] GET /identity/v3/endpoints?service_id=c374ff0df7764c89bccace6f01f7f90f&interface=public®ion_id=RegionOne => generated 195 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:22.446411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7d475-3d7f-40e8-9293-8f0af3934095 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:22.571291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7d475-3d7f-40e8-9293-8f0af3934095 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:22.607016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:22.621838 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55988e2f-5c22-4107-a0b1-df0555c9455a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:22.622447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55988e2f-5c22-4107-a0b1-df0555c9455a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:22.622765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55988e2f-5c22-4107-a0b1-df0555c9455a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:22.623356 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55988e2f-5c22-4107-a0b1-df0555c9455a None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:22.624047 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55988e2f-5c22-4107-a0b1-df0555c9455a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:22.625433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55988e2f-5c22-4107-a0b1-df0555c9455a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:22.632628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 399/780] 10.222.0.110 () {56 vars in 1092 bytes} [Thu May 26 16:29:22 2022] GET /identity/v3/services => generated 776 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:22.722033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59746c17-8abc-493f-a458-1a8c4e6a9d36 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:22.723031 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59746c17-8abc-493f-a458-1a8c4e6a9d36 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:22.723508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59746c17-8abc-493f-a458-1a8c4e6a9d36 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:22.725346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 382/781] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:29:22.731006 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881bbe6-6433-4804-91d6-84e4d25077f1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:22.731599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881bbe6-6433-4804-91d6-84e4d25077f1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:22.732078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881bbe6-6433-4804-91d6-84e4d25077f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:22.763452 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f881bbe6-6433-4804-91d6-84e4d25077f1 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:22.765046 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f881bbe6-6433-4804-91d6-84e4d25077f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:22.865937 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 400/782] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:22 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:22.890836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59746c17-8abc-493f-a458-1a8c4e6a9d36 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:22.967771 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:23.051335 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59746c17-8abc-493f-a458-1a8c4e6a9d36 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:23.101683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eaacc3-3f2a-41a7-871c-9d5fff89b719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:23.102495 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaacc3-3f2a-41a7-871c-9d5fff89b719 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:23.102808 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaacc3-3f2a-41a7-871c-9d5fff89b719 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:23.103082 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaacc3-3f2a-41a7-871c-9d5fff89b719 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:23.123704 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eaacc3-3f2a-41a7-871c-9d5fff89b719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:23.131991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-81eaacc3-3f2a-41a7-871c-9d5fff89b719 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:23.131991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:23.131991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:23.131991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:23.131991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:23.131991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:23.131991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:23.131991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:23.131991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:23.131991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:23.131991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:23.131991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:23.131991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:23.131991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:23.131991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:23.131991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:23.132874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:23.132874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:23.132874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:23.132874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:23.132874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:23.132874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:23.132874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:23.132874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:23.132874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:23.132874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:23.132874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:23.132874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:23.132874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:23.132874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:23.132874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:23.132874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:23.133718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:23.133718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:23.133718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:23.133718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:23.133718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:23.133718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:23.133718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:23.133718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:23.133718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:23.133718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:23.133718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:23.133718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:23.133718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 383/783] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:29:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:23.139161 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881bbe6-6433-4804-91d6-84e4d25077f1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:23.275811 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881bbe6-6433-4804-91d6-84e4d25077f1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:23.314011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:23.331431 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2b10d-bca7-4d09-8413-82d947e2b133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:23.332143 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2b10d-bca7-4d09-8413-82d947e2b133 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:23.332429 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2b10d-bca7-4d09-8413-82d947e2b133 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:23.332705 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2b10d-bca7-4d09-8413-82d947e2b133 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:23.333474 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2b10d-bca7-4d09-8413-82d947e2b133 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:23.333781 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2b10d-bca7-4d09-8413-82d947e2b133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:23.335203 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2b10d-bca7-4d09-8413-82d947e2b133 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:23.344954 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 401/784] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:29:23 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:23.350745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eaacc3-3f2a-41a7-871c-9d5fff89b719 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:23.497319 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eaacc3-3f2a-41a7-871c-9d5fff89b719 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:23.505148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:23.542094 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e05e9-7291-4621-bda3-78d9ba894be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:23.542844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e05e9-7291-4621-bda3-78d9ba894be0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:23.543133 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e05e9-7291-4621-bda3-78d9ba894be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:23.543412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e05e9-7291-4621-bda3-78d9ba894be0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:23.555117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e05e9-7291-4621-bda3-78d9ba894be0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:23.556565 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e05e9-7291-4621-bda3-78d9ba894be0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:23.576180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8043b-7ffe-41b7-8f9c-177d28504c8e None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:23.576467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8043b-7ffe-41b7-8f9c-177d28504c8e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:23.576751 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8043b-7ffe-41b7-8f9c-177d28504c8e None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:23.578110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 402/785] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:23.580577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f55e05e9-7291-4621-bda3-78d9ba894be0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:23.580577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:23.580577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:23.580577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:23.580577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:23.580577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:23.580577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:23.580577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:23.580577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:23.580577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:23.580577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:23.580577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:23.580577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:23.580577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:23.580577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:23.581444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:23.581444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:23.581444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:23.581444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:23.581444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:23.581444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:23.581444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:23.581444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:23.581444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:23.581444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:23.581444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:23.581444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:23.581444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:23.581444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:23.581444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:23.581444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:23.581444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:23.582340 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:23.582340 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:23.582340 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:23.582340 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:23.585120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 384/786] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:23.586773 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab1c08-15eb-4baa-a17d-6467bf4c41ea None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:23.587074 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab1c08-15eb-4baa-a17d-6467bf4c41ea None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:23.587361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab1c08-15eb-4baa-a17d-6467bf4c41ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:23.587520 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e05e9-7291-4621-bda3-78d9ba894be0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:23.617828 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-5cab1c08-15eb-4baa-a17d-6467bf4c41ea None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:23.627177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5cab1c08-15eb-4baa-a17d-6467bf4c41ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:23.728900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e05e9-7291-4621-bda3-78d9ba894be0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:23.734597 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 403/787] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:23 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:23.780842 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8d3d2-ee7b-4d8e-bc75-33fcc7d445c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:23.781877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8d3d2-ee7b-4d8e-bc75-33fcc7d445c4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:23.782439 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8d3d2-ee7b-4d8e-bc75-33fcc7d445c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:23.783531 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8d3d2-ee7b-4d8e-bc75-33fcc7d445c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:23.784473 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8d3d2-ee7b-4d8e-bc75-33fcc7d445c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:23.784580 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab1c08-15eb-4baa-a17d-6467bf4c41ea None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:23.785109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8d3d2-ee7b-4d8e-bc75-33fcc7d445c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:23.786834 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8d3d2-ee7b-4d8e-bc75-33fcc7d445c4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:23.800097 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 385/788] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:23.806010 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8d3d2-ee7b-4d8e-bc75-33fcc7d445c4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:23.838380 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:23.981652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab1c08-15eb-4baa-a17d-6467bf4c41ea None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:24.001939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:24.005173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8d3d2-ee7b-4d8e-bc75-33fcc7d445c4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:24.046641 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943debac-e15b-4b83-b499-ca8483251fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:24.047899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943debac-e15b-4b83-b499-ca8483251fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.048932 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943debac-e15b-4b83-b499-ca8483251fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.050529 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943debac-e15b-4b83-b499-ca8483251fd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.066299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d49c8-2622-46c9-a2b0-584862f2e8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:24.069760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d49c8-2622-46c9-a2b0-584862f2e8ae None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.070254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d49c8-2622-46c9-a2b0-584862f2e8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.070767 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d49c8-2622-46c9-a2b0-584862f2e8ae None admin] PATH_INFO: `/v3/users/swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.072354 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943debac-e15b-4b83-b499-ca8483251fd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:24.082416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-943debac-e15b-4b83-b499-ca8483251fd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:24.082416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:24.082416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:24.082416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:24.082416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:24.082416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:24.082416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:24.082416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:24.082416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:24.082416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:24.082416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:24.082416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:24.082416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:24.082416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:24.082416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:24.082416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:24.083371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:24.083371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:24.083371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:24.083371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:24.083371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:24.083371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:24.083371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:24.083371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:24.083371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:24.083371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:24.083371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:24.083371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:24.083371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:24.083371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:24.083371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:24.083371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:24.084211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:24.084211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:24.084211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:24.084211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:24.084211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:24.084211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:24.084211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:24.084211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:24.084211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:24.084211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:24.084211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:24.084211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:24.091316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d49c8-2622-46c9-a2b0-584862f2e8ae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:24.093029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d49c8-2622-46c9-a2b0-584862f2e8ae None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:24.096178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 404/789] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:29:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:24.103629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943debac-e15b-4b83-b499-ca8483251fd1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:24.113372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-528d49c8-2622-46c9-a2b0-584862f2e8ae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:24.113372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:24.113372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:24.113372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:24.113372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:24.113372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:24.113372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:24.113372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:24.113372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:24.113372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:24.113372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:24.113372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:24.113372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:24.113372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:24.113372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:24.113372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:24.114384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:24.114384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:24.114384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:24.114384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:24.114384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:24.114384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:24.114384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:24.114384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:24.114384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:24.114384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:24.114384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:24.114384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:24.114384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:24.114384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:24.114384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:24.114384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:24.114384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:24.114384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:24.115432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:24.115432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:24.115432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:24.115432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:24.115432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:24.115432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:24.115432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:24.115432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:24.115432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:24.115432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:24.118409 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 386/790] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:29:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:24.130698 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d49c8-2622-46c9-a2b0-584862f2e8ae None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:24.243347 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943debac-e15b-4b83-b499-ca8483251fd1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:24.283286 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84e6d8-aa1a-4b48-8b56-bc12b7eabe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:24.284353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84e6d8-aa1a-4b48-8b56-bc12b7eabe3f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.284866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84e6d8-aa1a-4b48-8b56-bc12b7eabe3f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.286268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84e6d8-aa1a-4b48-8b56-bc12b7eabe3f None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.287353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84e6d8-aa1a-4b48-8b56-bc12b7eabe3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:24.287881 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84e6d8-aa1a-4b48-8b56-bc12b7eabe3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:24.289506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84e6d8-aa1a-4b48-8b56-bc12b7eabe3f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:24.300636 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 405/791] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:29:24 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:24.307042 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84e6d8-aa1a-4b48-8b56-bc12b7eabe3f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:24.320813 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:24.349528 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:24.388329 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d49c8-2622-46c9-a2b0-584862f2e8ae None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:24.437162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84e6d8-aa1a-4b48-8b56-bc12b7eabe3f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:24.479122 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05df3e-c9af-4e9c-b2b6-82ca82695996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:24.480322 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05df3e-c9af-4e9c-b2b6-82ca82695996 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.480810 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05df3e-c9af-4e9c-b2b6-82ca82695996 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.481281 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05df3e-c9af-4e9c-b2b6-82ca82695996 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.487325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a47e12-4f9b-4208-a805-475f6a26bfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:24.488020 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a47e12-4f9b-4208-a805-475f6a26bfad None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.488306 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a47e12-4f9b-4208-a805-475f6a26bfad None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.488585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a47e12-4f9b-4208-a805-475f6a26bfad None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.489430 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a47e12-4f9b-4208-a805-475f6a26bfad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:24.489742 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a47e12-4f9b-4208-a805-475f6a26bfad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:24.491198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a47e12-4f9b-4208-a805-475f6a26bfad None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:24.494687 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05df3e-c9af-4e9c-b2b6-82ca82695996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:24.496364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05df3e-c9af-4e9c-b2b6-82ca82695996 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:24.515421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-8d05df3e-c9af-4e9c-b2b6-82ca82695996 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:24.515421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:24.515421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:24.515421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:24.515421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:24.515421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:24.515421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:24.515421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:24.515421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:24.515421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:24.515421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:24.515421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:24.515421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:24.515421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:24.515421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:24.516366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:24.516366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:24.516366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:24.516366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:24.516366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:24.516366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:24.516366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:24.516366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:24.516366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:24.516366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:24.516366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:24.516366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:24.516366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:24.516366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:24.516366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:24.516366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:24.516366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:24.517396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:24.517396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:24.517396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:24.517396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:24.519691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 406/792] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:24.526612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 387/793] 10.222.0.110 () {56 vars in 1140 bytes} [Thu May 26 16:29:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:24.531824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05df3e-c9af-4e9c-b2b6-82ca82695996 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:24.533611 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a47e12-4f9b-4208-a805-475f6a26bfad None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:24.653009 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:24.666562 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05df3e-c9af-4e9c-b2b6-82ca82695996 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:24.671272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a47e12-4f9b-4208-a805-475f6a26bfad None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:24.701533 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f29f92-1fcd-4193-990d-12523bc78847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:24.702194 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f29f92-1fcd-4193-990d-12523bc78847 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.702481 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f29f92-1fcd-4193-990d-12523bc78847 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.702792 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f29f92-1fcd-4193-990d-12523bc78847 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.703512 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f29f92-1fcd-4193-990d-12523bc78847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:24.703820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f29f92-1fcd-4193-990d-12523bc78847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:24.705229 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f29f92-1fcd-4193-990d-12523bc78847 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:24.707783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3792041-8734-4cf8-9961-362df24e4b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:24.708582 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3792041-8734-4cf8-9961-362df24e4b83 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.708868 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3792041-8734-4cf8-9961-362df24e4b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.709146 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3792041-8734-4cf8-9961-362df24e4b83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.712156 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:24.718588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 407/794] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:24.720794 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440942bc-4e67-40c7-a37d-9ba50ae44e12 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.721134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440942bc-4e67-40c7-a37d-9ba50ae44e12 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.721413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440942bc-4e67-40c7-a37d-9ba50ae44e12 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.726659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 408/795] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:24.726659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8821f-1484-4984-8759-62b1ae3e5339 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.726659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8821f-1484-4984-8759-62b1ae3e5339 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.726659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8821f-1484-4984-8759-62b1ae3e5339 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.729102 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3792041-8734-4cf8-9961-362df24e4b83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:24.730024 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 409/796] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:24 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:24.730835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8821f-1484-4984-8759-62b1ae3e5339 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:24.730959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3792041-8734-4cf8-9961-362df24e4b83 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:24.749658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b3792041-8734-4cf8-9961-362df24e4b83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:24.749658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:24.749658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:24.749658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:24.749658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:24.749658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:24.749658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:24.749658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:24.749658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:24.749658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:24.749658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:24.749658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:24.749658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:24.749658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:24.749658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:24.750776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:24.750776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:24.750776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:24.750776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:24.750776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:24.750776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:24.750776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:24.750776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:24.750776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:24.750776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:24.750776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:24.750776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:24.750776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:24.750776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:24.750776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:24.750776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:24.750776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:24.752248 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:24.752248 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:24.752248 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:24.752248 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:24.756088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 388/797] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:24.757201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2bfde-6741-4ff8-98d1-606799cf605c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.757492 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2bfde-6741-4ff8-98d1-606799cf605c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.757777 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2bfde-6741-4ff8-98d1-606799cf605c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.775283 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-97d2bfde-6741-4ff8-98d1-606799cf605c None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:24.776474 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-97d2bfde-6741-4ff8-98d1-606799cf605c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:24.848425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8821f-1484-4984-8759-62b1ae3e5339 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:24.856971 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 389/798] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:24 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:24.856971 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24f723-4d99-4a0a-8702-aa49f8fa962a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.856971 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24f723-4d99-4a0a-8702-aa49f8fa962a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.856971 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24f723-4d99-4a0a-8702-aa49f8fa962a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.873577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fe24f723-4d99-4a0a-8702-aa49f8fa962a None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:24.874891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fe24f723-4d99-4a0a-8702-aa49f8fa962a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:24.898389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fc55e-26d8-4194-82cc-972f6e4bb117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:24.899224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fc55e-26d8-4194-82cc-972f6e4bb117 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.899512 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fc55e-26d8-4194-82cc-972f6e4bb117 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.899791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fc55e-26d8-4194-82cc-972f6e4bb117 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.907380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fc55e-26d8-4194-82cc-972f6e4bb117 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:24.908796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fc55e-26d8-4194-82cc-972f6e4bb117 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:24.923996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-328fc55e-26d8-4194-82cc-972f6e4bb117 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:24.923996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:24.923996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:24.923996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:24.923996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:24.923996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:24.923996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:24.923996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:24.923996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:24.923996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:24.923996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:24.923996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:24.923996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:24.923996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:24.923996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:24.923996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:24.924968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:24.924968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:24.924968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:24.924968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:24.924968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:24.924968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:24.924968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:24.924968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:24.924968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:24.924968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:24.924968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:24.924968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:24.924968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:24.924968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:24.924968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:24.924968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:24.924968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:24.924968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:24.925880 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:24.925880 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:24.925880 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:24.925880 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:24.925880 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:24.925880 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:24.925880 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:24.925880 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:24.925880 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:24.925880 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:24.925880 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 410/799] 10.222.0.110 () {56 vars in 1098 bytes} [Thu May 26 16:29:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:24.926582 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fc55e-26d8-4194-82cc-972f6e4bb117 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:24.938361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:24.951710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 390/800] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:24 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:24.952800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24f723-4d99-4a0a-8702-aa49f8fa962a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:25.012806 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:25.043916 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fc55e-26d8-4194-82cc-972f6e4bb117 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.069445 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24f723-4d99-4a0a-8702-aa49f8fa962a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.082670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ab00f-e13c-4aa9-9ee8-d961f1d5895f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.083362 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ab00f-e13c-4aa9-9ee8-d961f1d5895f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.083649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ab00f-e13c-4aa9-9ee8-d961f1d5895f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.083929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ab00f-e13c-4aa9-9ee8-d961f1d5895f None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.084673 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ab00f-e13c-4aa9-9ee8-d961f1d5895f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:25.084986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ab00f-e13c-4aa9-9ee8-d961f1d5895f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:25.086399 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ab00f-e13c-4aa9-9ee8-d961f1d5895f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:25.100461 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 411/801] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:25.100461 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ab00f-e13c-4aa9-9ee8-d961f1d5895f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:25.113851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3916005-e78a-44b4-96f7-57aa6c3d0452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.114692 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3916005-e78a-44b4-96f7-57aa6c3d0452 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.114975 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3916005-e78a-44b4-96f7-57aa6c3d0452 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.115251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3916005-e78a-44b4-96f7-57aa6c3d0452 None admin] PATH_INFO: `/v3/services/network` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.115906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3916005-e78a-44b4-96f7-57aa6c3d0452 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:25.117259 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3916005-e78a-44b4-96f7-57aa6c3d0452 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:25.130477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a3916005-e78a-44b4-96f7-57aa6c3d0452 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:29:25.130477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:25.130477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:25.130477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:25.130477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:25.130477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:25.130477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:25.130477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:25.130477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:29:25.130477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:25.130477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:25.130477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:25.130477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:25.130477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:25.130477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:25.130477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:25.130477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:25.131511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:25.131511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:25.131511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:25.131511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:25.131511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:25.131511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:25.131511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:25.131511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:25.131511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:25.131511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:25.131511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:25.131511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:25.131511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:25.131511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:25.131511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:25.131511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:25.132317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:25.132317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:25.132317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:25.132317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:25.132317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:25.132317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:25.132317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:25.132317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:25.132317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:25.132317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:25.132317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:25.132317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:25.132317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:29:25.132317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:25.132317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 391/802] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:24 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:25.133819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3916005-e78a-44b4-96f7-57aa6c3d0452 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:25.176287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:25.213064 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ab00f-e13c-4aa9-9ee8-d961f1d5895f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.242255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3916005-e78a-44b4-96f7-57aa6c3d0452 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.250156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea095c6d-1651-446e-9c26-efaab55e6279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.251132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea095c6d-1651-446e-9c26-efaab55e6279 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.252181 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea095c6d-1651-446e-9c26-efaab55e6279 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.252656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea095c6d-1651-446e-9c26-efaab55e6279 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.253765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea095c6d-1651-446e-9c26-efaab55e6279 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:25.254084 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea095c6d-1651-446e-9c26-efaab55e6279 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:25.255555 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea095c6d-1651-446e-9c26-efaab55e6279 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:25.256396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:25.275602 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 412/803] 10.222.0.110 () {56 vars in 1138 bytes} [Thu May 26 16:29:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:25.276433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea095c6d-1651-446e-9c26-efaab55e6279 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:25.278219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32215e-4887-4bb8-aa71-d90ce967ae7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.279055 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32215e-4887-4bb8-aa71-d90ce967ae7d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.279333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32215e-4887-4bb8-aa71-d90ce967ae7d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.279600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32215e-4887-4bb8-aa71-d90ce967ae7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.289824 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32215e-4887-4bb8-aa71-d90ce967ae7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:25.297663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5b32215e-4887-4bb8-aa71-d90ce967ae7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:25.297663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:25.297663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:25.297663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:25.297663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:25.297663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:25.297663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:25.297663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:25.297663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:25.297663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:25.297663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:25.297663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:25.297663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:25.297663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:25.297663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:25.297663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:25.299043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:25.299043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:25.299043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:25.299043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:25.299043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:25.299043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:25.299043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:25.299043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:25.299043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:25.299043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:25.299043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:25.299043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:25.299043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:25.299043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:25.299043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:25.299043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:25.299992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:25.299992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:25.299992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:25.299992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:25.299992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:25.299992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:25.299992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:25.299992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:25.299992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:25.299992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:25.299992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:25.299992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:25.303701 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 392/804] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:29:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:25.304393 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32215e-4887-4bb8-aa71-d90ce967ae7d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:25.376002 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea095c6d-1651-446e-9c26-efaab55e6279 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.402508 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:25.403415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32215e-4887-4bb8-aa71-d90ce967ae7d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.411658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61434be4-8bee-4677-b573-416e66f27c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.412461 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61434be4-8bee-4677-b573-416e66f27c89 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.412748 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61434be4-8bee-4677-b573-416e66f27c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.413028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61434be4-8bee-4677-b573-416e66f27c89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.419693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61434be4-8bee-4677-b573-416e66f27c89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:25.421129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61434be4-8bee-4677-b573-416e66f27c89 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:25.434941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-61434be4-8bee-4677-b573-416e66f27c89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:25.434941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:25.434941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:25.434941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:25.434941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:25.434941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:25.434941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:25.434941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:25.434941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:25.434941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:25.434941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:25.434941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:25.434941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:25.434941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:25.434941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:25.435808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:25.435808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:25.435808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:25.435808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:25.435808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:25.435808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:25.435808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:25.435808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:25.435808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:25.435808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:25.435808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:25.435808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:25.435808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:25.435808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:25.435808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:25.435808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:25.435808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:25.436700 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:25.436700 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:25.436700 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:25.436700 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:25.436700 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:25.436700 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:25.436700 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:25.436700 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:25.436700 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 413/805] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:25.437763 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee11d60-d0eb-4981-82d8-0880a044688b None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.437964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee11d60-d0eb-4981-82d8-0880a044688b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.438277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee11d60-d0eb-4981-82d8-0880a044688b None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.439468 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a5e3e-905f-4deb-b5f4-a714024bdddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.440244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 414/806] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:25.440347 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a5e3e-905f-4deb-b5f4-a714024bdddc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.440864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee11d60-d0eb-4981-82d8-0880a044688b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:25.442937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a5e3e-905f-4deb-b5f4-a714024bdddc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.443231 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a5e3e-905f-4deb-b5f4-a714024bdddc None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.444123 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a5e3e-905f-4deb-b5f4-a714024bdddc None admin] RBAC: Adding query filter params (name=network) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:25.444303 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a5e3e-905f-4deb-b5f4-a714024bdddc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:25.445682 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a5e3e-905f-4deb-b5f4-a714024bdddc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:25.450468 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 393/807] 10.222.0.110 () {56 vars in 1117 bytes} [Thu May 26 16:29:25 2022] GET /identity/v3/services?name=network => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:25.451159 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a5e3e-905f-4deb-b5f4-a714024bdddc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:25.487478 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:25.546851 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee11d60-d0eb-4981-82d8-0880a044688b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.551985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a5e3e-905f-4deb-b5f4-a714024bdddc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.582052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21233438-2be5-4de5-9857-2eab8c241dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.582741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21233438-2be5-4de5-9857-2eab8c241dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.583035 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21233438-2be5-4de5-9857-2eab8c241dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.583344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21233438-2be5-4de5-9857-2eab8c241dd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.588717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea236cae-a9b2-4474-ae5c-49f49feb8c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.589392 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea236cae-a9b2-4474-ae5c-49f49feb8c8d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.589677 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea236cae-a9b2-4474-ae5c-49f49feb8c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.589952 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea236cae-a9b2-4474-ae5c-49f49feb8c8d None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.590728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea236cae-a9b2-4474-ae5c-49f49feb8c8d None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:25.591039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea236cae-a9b2-4474-ae5c-49f49feb8c8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:25.592808 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea236cae-a9b2-4474-ae5c-49f49feb8c8d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:25.601620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 394/808] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:29:25 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:25.602597 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea236cae-a9b2-4474-ae5c-49f49feb8c8d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:25.641441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:25.655084 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21233438-2be5-4de5-9857-2eab8c241dd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:25.656538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21233438-2be5-4de5-9857-2eab8c241dd0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:25.700085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:25.704460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea236cae-a9b2-4474-ae5c-49f49feb8c8d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.737742 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f3f1e-94cd-485e-8bab-5c3964016e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.738409 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f3f1e-94cd-485e-8bab-5c3964016e55 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.738731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f3f1e-94cd-485e-8bab-5c3964016e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.739010 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f3f1e-94cd-485e-8bab-5c3964016e55 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.739788 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f3f1e-94cd-485e-8bab-5c3964016e55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:25.740100 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f3f1e-94cd-485e-8bab-5c3964016e55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:25.741525 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f3f1e-94cd-485e-8bab-5c3964016e55 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:25.754230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 395/809] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:25.760057 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 415/810] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:29:25 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:29:25.760215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6f7f7-0b68-4fa2-8e6e-24106b79714b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.760215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6f7f7-0b68-4fa2-8e6e-24106b79714b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.760215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6f7f7-0b68-4fa2-8e6e-24106b79714b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.760452 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21233438-2be5-4de5-9857-2eab8c241dd0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:25.772671 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-04a6f7f7-0b68-4fa2-8e6e-24106b79714b None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:25.773861 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-04a6f7f7-0b68-4fa2-8e6e-24106b79714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:25.840931 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 396/811] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:25 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:25.841758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6f7f7-0b68-4fa2-8e6e-24106b79714b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:25.855395 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21233438-2be5-4de5-9857-2eab8c241dd0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.863880 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:25.890951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bb0c6-2a9b-4e40-8df6-487cd5adf24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.891616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bb0c6-2a9b-4e40-8df6-487cd5adf24d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.892489 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bb0c6-2a9b-4e40-8df6-487cd5adf24d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.892769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bb0c6-2a9b-4e40-8df6-487cd5adf24d None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.893596 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664bb0c6-2a9b-4e40-8df6-487cd5adf24d None admin] RBAC: Adding query filter params (type=network) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:25.893907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664bb0c6-2a9b-4e40-8df6-487cd5adf24d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:25.895300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664bb0c6-2a9b-4e40-8df6-487cd5adf24d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:25.900043 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 416/812] 10.222.0.110 () {56 vars in 1117 bytes} [Thu May 26 16:29:25 2022] GET /identity/v3/services?type=network => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:25.900778 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bb0c6-2a9b-4e40-8df6-487cd5adf24d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:25.928815 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:25.941453 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6f7f7-0b68-4fa2-8e6e-24106b79714b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.975669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac8f6d-9cf5-431e-a758-d33df4c0588a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.976393 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac8f6d-9cf5-431e-a758-d33df4c0588a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.976677 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac8f6d-9cf5-431e-a758-d33df4c0588a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.976951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac8f6d-9cf5-431e-a758-d33df4c0588a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.987016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac8f6d-9cf5-431e-a758-d33df4c0588a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:25.988866 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac8f6d-9cf5-431e-a758-d33df4c0588a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:25.999194 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bb0c6-2a9b-4e40-8df6-487cd5adf24d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:26.007049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-03ac8f6d-9cf5-431e-a758-d33df4c0588a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:26.007049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:26.007049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:26.007049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:26.007049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:26.007049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:26.007049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:26.007049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:26.007049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:26.007049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:26.007049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:26.007049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:26.007049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:26.007049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:26.007049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:26.008098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:26.008098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:26.008098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:26.008098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:26.008098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:26.008098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:26.008098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:26.008098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:26.008098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:26.008098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:26.008098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:26.008098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:26.008098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:26.008098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:26.008098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:26.008098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:26.008098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:26.009137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:26.009137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:26.009137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:26.009137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:26.009137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 397/813] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:26.009137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac8f6d-9cf5-431e-a758-d33df4c0588a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:26.033442 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0afebd-6d0a-4849-9386-9d5011d5d400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:26.034322 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0afebd-6d0a-4849-9386-9d5011d5d400 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:26.034627 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0afebd-6d0a-4849-9386-9d5011d5d400 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:26.034908 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0afebd-6d0a-4849-9386-9d5011d5d400 None admin] PATH_INFO: `/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/aa4502c57e324c31a8bce12770a92371/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:26.036994 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0afebd-6d0a-4849-9386-9d5011d5d400 None admin] RBAC: Authorizing `identity:create_grant(project_id=d33e1f400b3e46379d2a0abd05921181, user_id=aa4502c57e324c31a8bce12770a92371, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:26.038525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0afebd-6d0a-4849-9386-9d5011d5d400 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:26.053372 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 417/814] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:29:25 2022] PUT /identity/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/aa4502c57e324c31a8bce12770a92371/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:29:26.054171 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0afebd-6d0a-4849-9386-9d5011d5d400 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:26.079255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:26.121836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac8f6d-9cf5-431e-a758-d33df4c0588a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:26.160818 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae19a5-8730-4e32-b85c-6fb78108ba1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:26.162048 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae19a5-8730-4e32-b85c-6fb78108ba1a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:26.162544 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae19a5-8730-4e32-b85c-6fb78108ba1a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:26.163101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae19a5-8730-4e32-b85c-6fb78108ba1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:26.172866 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:26.175674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae19a5-8730-4e32-b85c-6fb78108ba1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:26.178090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae19a5-8730-4e32-b85c-6fb78108ba1a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:26.188309 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0afebd-6d0a-4849-9386-9d5011d5d400 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:26.198000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4dae19a5-8730-4e32-b85c-6fb78108ba1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:26.198000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:26.198000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:26.198000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:26.198000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:26.198000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:26.198000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:26.198000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:26.198000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:26.198000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:26.198000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:26.198000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:26.198000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:26.198000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:26.198000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:26.199016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:26.199016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:26.199016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:26.199016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:26.199016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:26.199016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:26.199016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:26.199016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:26.199016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:26.199016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:26.199016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:26.199016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:26.199016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:26.199016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:26.199016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:26.199016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:26.199016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:26.199955 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:26.199955 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:26.199955 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:26.199955 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:26.202910 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 398/815] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:26.204359 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae19a5-8730-4e32-b85c-6fb78108ba1a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:26.229242 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33239ca3-ac20-4acd-ac00-31967af1e71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:26.229980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33239ca3-ac20-4acd-ac00-31967af1e71e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:26.230267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33239ca3-ac20-4acd-ac00-31967af1e71e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:26.230600 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33239ca3-ac20-4acd-ac00-31967af1e71e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:26.231229 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33239ca3-ac20-4acd-ac00-31967af1e71e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:26.232613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33239ca3-ac20-4acd-ac00-31967af1e71e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:26.250373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-33239ca3-ac20-4acd-ac00-31967af1e71e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:29:26.250373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:26.250373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:26.250373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:26.250373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:26.250373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:26.250373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:26.250373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:26.250373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:29:26.250373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:26.250373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:26.250373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:26.250373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:26.250373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:26.250373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:26.250373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:26.252028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:26.252028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:26.252028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:26.252028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:26.252028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:26.252028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:26.252028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:26.252028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:26.252028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:26.252028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:26.252028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:26.252028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:26.252028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:26.252028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:26.252028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:26.252028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:26.252839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:26.252839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:26.252839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:26.252839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:26.252839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:26.252839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:26.252839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:26.252839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:26.252839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:26.252839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:26.252839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:26.252839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:26.252839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:26.252839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:29:26.252839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:26.252839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 418/816] 10.222.0.110 () {56 vars in 1134 bytes} [Thu May 26 16:29:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:26.254127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33239ca3-ac20-4acd-ac00-31967af1e71e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:26.320710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae19a5-8730-4e32-b85c-6fb78108ba1a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:26.332122 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:26.362005 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44a407-8f06-45d7-a5e8-ddf7fac3322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:26.362462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33239ca3-ac20-4acd-ac00-31967af1e71e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:26.363336 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44a407-8f06-45d7-a5e8-ddf7fac3322c None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:26.363810 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44a407-8f06-45d7-a5e8-ddf7fac3322c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:26.364275 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44a407-8f06-45d7-a5e8-ddf7fac3322c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:26.365236 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44a407-8f06-45d7-a5e8-ddf7fac3322c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:26.366636 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44a407-8f06-45d7-a5e8-ddf7fac3322c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:26.398602 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 399/817] 10.222.0.110 () {60 vars in 1149 bytes} [Thu May 26 16:29:26 2022] POST /identity/v3/endpoints => generated 329 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:29:26.398602 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44a407-8f06-45d7-a5e8-ddf7fac3322c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:26.420325 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd5172-05c2-4e87-acb9-71c5fd0e7439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:26.421119 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd5172-05c2-4e87-acb9-71c5fd0e7439 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:26.421464 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd5172-05c2-4e87-acb9-71c5fd0e7439 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:26.421846 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd5172-05c2-4e87-acb9-71c5fd0e7439 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:26.422875 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd5172-05c2-4e87-acb9-71c5fd0e7439 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:26.423887 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd5172-05c2-4e87-acb9-71c5fd0e7439 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:26.425374 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd5172-05c2-4e87-acb9-71c5fd0e7439 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:26.445435 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 419/818] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:26.445435 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd5172-05c2-4e87-acb9-71c5fd0e7439 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:26.468369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:26.542731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44a407-8f06-45d7-a5e8-ddf7fac3322c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:26.587226 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd5172-05c2-4e87-acb9-71c5fd0e7439 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:26.594215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86395129-9938-4a5a-8d72-d8916615cfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:26.595045 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86395129-9938-4a5a-8d72-d8916615cfa7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:26.595333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86395129-9938-4a5a-8d72-d8916615cfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:26.595615 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86395129-9938-4a5a-8d72-d8916615cfa7 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:26.596346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86395129-9938-4a5a-8d72-d8916615cfa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:26.596655 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86395129-9938-4a5a-8d72-d8916615cfa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:26.598872 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86395129-9938-4a5a-8d72-d8916615cfa7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:26.615293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 400/819] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:26.616312 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86395129-9938-4a5a-8d72-d8916615cfa7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:26.624518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:26.632581 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331eb5c-f33a-47ca-80d8-52b63923c73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:26.633421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331eb5c-f33a-47ca-80d8-52b63923c73e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:26.633817 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331eb5c-f33a-47ca-80d8-52b63923c73e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:26.634198 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331eb5c-f33a-47ca-80d8-52b63923c73e None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:26.636642 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331eb5c-f33a-47ca-80d8-52b63923c73e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:26.637073 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331eb5c-f33a-47ca-80d8-52b63923c73e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:26.638713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331eb5c-f33a-47ca-80d8-52b63923c73e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:26.644753 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 420/820] 10.222.0.110 () {56 vars in 1129 bytes} [Thu May 26 16:29:26 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:26.645678 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331eb5c-f33a-47ca-80d8-52b63923c73e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:26.750133 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86395129-9938-4a5a-8d72-d8916615cfa7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:26.761755 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:26.763157 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331eb5c-f33a-47ca-80d8-52b63923c73e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:26.790426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0066f0-f504-4928-9668-04ca4d2102ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:26.791679 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0066f0-f504-4928-9668-04ca4d2102ed None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:26.792448 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0066f0-f504-4928-9668-04ca4d2102ed None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:26.793209 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0066f0-f504-4928-9668-04ca4d2102ed None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:26.800583 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffab72-4b49-4107-80df-0b7241a4aaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:26.801560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffab72-4b49-4107-80df-0b7241a4aaa4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:26.801853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffab72-4b49-4107-80df-0b7241a4aaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:26.801975 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0066f0-f504-4928-9668-04ca4d2102ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:26.802134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffab72-4b49-4107-80df-0b7241a4aaa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:26.803376 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0066f0-f504-4928-9668-04ca4d2102ed None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:26.809314 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffab72-4b49-4107-80df-0b7241a4aaa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:26.810789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffab72-4b49-4107-80df-0b7241a4aaa4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:26.820716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8b0066f0-f504-4928-9668-04ca4d2102ed None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:29:26.820716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:26.820716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:26.820716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:26.820716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:26.820716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:26.820716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:26.820716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:26.820716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:26.820716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:26.820716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:26.820716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:26.820716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:26.820716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:26.820716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:26.820716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:26.821642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:26.821642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:26.821642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:26.821642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:26.821642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:26.821642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:26.821642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:26.821642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:26.821642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:26.821642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:26.821642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:26.821642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:26.821642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:26.821642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:26.821642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:26.821642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:26.821642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:26.821642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:26.822977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:26.822977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:26.822977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:26.822977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:26.822977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:26.822977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:26.822977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:26.822977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:26.822977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:29:26.822977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:26.822977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 401/821] 10.222.0.110 () {56 vars in 1122 bytes} [Thu May 26 16:29:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:26.822977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0066f0-f504-4928-9668-04ca4d2102ed None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:26.830830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-20ffab72-4b49-4107-80df-0b7241a4aaa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:26.830830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:26.830830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:26.830830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:26.830830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:26.830830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:26.830830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:26.830830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:26.830830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:26.830830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:26.830830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:26.830830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:26.830830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:26.830830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:26.830830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:26.831717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:26.831717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:26.831717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:26.831717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:26.831717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:26.831717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:26.831717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:26.831717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:26.831717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:26.831717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:26.831717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:26.831717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:26.831717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:26.831717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:26.831717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:26.831717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:26.831717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:26.832631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:26.832631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:26.832631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:26.832631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:26.832631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:26.832631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:26.832631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:26.832631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:26.832631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 421/822] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:26.833106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffab72-4b49-4107-80df-0b7241a4aaa4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:26.897092 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:26.932045 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0066f0-f504-4928-9668-04ca4d2102ed None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:26.947968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffab72-4b49-4107-80df-0b7241a4aaa4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:26.968450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6018e12-2335-481f-90ca-d5fd7f5db3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:26.969166 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6018e12-2335-481f-90ca-d5fd7f5db3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:26.969457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6018e12-2335-481f-90ca-d5fd7f5db3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:26.969739 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6018e12-2335-481f-90ca-d5fd7f5db3d2 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:26.971041 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6018e12-2335-481f-90ca-d5fd7f5db3d2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:26.971354 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6018e12-2335-481f-90ca-d5fd7f5db3d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:26.972717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6018e12-2335-481f-90ca-d5fd7f5db3d2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:26.982179 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 402/823] 10.222.0.110 () {56 vars in 1129 bytes} [Thu May 26 16:29:26 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:26.982179 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6018e12-2335-481f-90ca-d5fd7f5db3d2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:26.989091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54568925-009e-49ea-a14f-7cf5ee10013c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:26.989776 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54568925-009e-49ea-a14f-7cf5ee10013c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:26.990347 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54568925-009e-49ea-a14f-7cf5ee10013c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:26.990675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54568925-009e-49ea-a14f-7cf5ee10013c None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:26.991511 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54568925-009e-49ea-a14f-7cf5ee10013c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:26.991823 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54568925-009e-49ea-a14f-7cf5ee10013c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:26.993239 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54568925-009e-49ea-a14f-7cf5ee10013c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:27.011684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 422/824] 10.222.0.110 () {56 vars in 1154 bytes} [Thu May 26 16:29:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:27.012036 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:27.012457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54568925-009e-49ea-a14f-7cf5ee10013c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:27.091503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6018e12-2335-481f-90ca-d5fd7f5db3d2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:27.116424 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54568925-009e-49ea-a14f-7cf5ee10013c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:27.131448 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7318890-fcc0-4f1f-81c1-94e8e50a2405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:27.131667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:27.132109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7318890-fcc0-4f1f-81c1-94e8e50a2405 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:27.132424 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7318890-fcc0-4f1f-81c1-94e8e50a2405 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:27.132692 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7318890-fcc0-4f1f-81c1-94e8e50a2405 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:27.133636 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7318890-fcc0-4f1f-81c1-94e8e50a2405 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:27.133857 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7318890-fcc0-4f1f-81c1-94e8e50a2405 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:27.135304 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7318890-fcc0-4f1f-81c1-94e8e50a2405 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:27.147780 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 403/825] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:27.151977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7318890-fcc0-4f1f-81c1-94e8e50a2405 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:27.155388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930a343-559d-4bf6-a47a-73dcfb035be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:27.156053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930a343-559d-4bf6-a47a-73dcfb035be0 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:27.156339 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930a343-559d-4bf6-a47a-73dcfb035be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:27.156620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930a343-559d-4bf6-a47a-73dcfb035be0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:27.157909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930a343-559d-4bf6-a47a-73dcfb035be0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:27.159313 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930a343-559d-4bf6-a47a-73dcfb035be0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:27.182953 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 423/826] 10.222.0.110 () {60 vars in 1149 bytes} [Thu May 26 16:29:27 2022] POST /identity/v3/endpoints => generated 348 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:29:27.183918 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930a343-559d-4bf6-a47a-73dcfb035be0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:27.269321 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:27.280714 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7318890-fcc0-4f1f-81c1-94e8e50a2405 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:27.333235 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22a5d5-87bc-4c3e-8cfb-cc74fbd47d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:27.334370 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22a5d5-87bc-4c3e-8cfb-cc74fbd47d16 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:27.334859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22a5d5-87bc-4c3e-8cfb-cc74fbd47d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:27.335287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22a5d5-87bc-4c3e-8cfb-cc74fbd47d16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:27.336554 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930a343-559d-4bf6-a47a-73dcfb035be0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:27.348525 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22a5d5-87bc-4c3e-8cfb-cc74fbd47d16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:27.350272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22a5d5-87bc-4c3e-8cfb-cc74fbd47d16 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:27.371103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-1c22a5d5-87bc-4c3e-8cfb-cc74fbd47d16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:27.371103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:27.371103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:27.371103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:27.371103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:27.371103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:27.371103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:27.371103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:27.371103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:27.371103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:27.371103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:27.371103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:27.371103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:27.371103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:27.371103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:27.372128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:27.372128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:27.372128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:27.372128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:27.372128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:27.372128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:27.372128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:27.372128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:27.372128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:27.372128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:27.372128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:27.372128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:27.372128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:27.372128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:27.372128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:27.372128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:27.372128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:27.373291 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:27.373291 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:27.373291 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:27.373291 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:27.378726 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 404/827] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:27.380769 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22a5d5-87bc-4c3e-8cfb-cc74fbd47d16 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:27.383828 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899c8e6-9fa2-437f-a8a2-050c6a0ad0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:27.384512 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899c8e6-9fa2-437f-a8a2-050c6a0ad0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:27.384797 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899c8e6-9fa2-437f-a8a2-050c6a0ad0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:27.385077 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899c8e6-9fa2-437f-a8a2-050c6a0ad0f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:27.387646 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899c8e6-9fa2-437f-a8a2-050c6a0ad0f4 None admin] RBAC: Adding query filter params (role.id=1393d128d39b4649b6cd71b6609846cb, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=0043a7d5877f41de905afe6bef355867) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:27.387646 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899c8e6-9fa2-437f-a8a2-050c6a0ad0f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:27.388770 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899c8e6-9fa2-437f-a8a2-050c6a0ad0f4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:27.396605 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 424/828] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:29:27 2022] GET /identity/v3/role_assignments?user.id=0043a7d5877f41de905afe6bef355867&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=1393d128d39b4649b6cd71b6609846cb => generated 610 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:27.504701 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22a5d5-87bc-4c3e-8cfb-cc74fbd47d16 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:27.543377 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c614eb-db2c-4a8e-b69c-4ea01546e497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:27.544317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c614eb-db2c-4a8e-b69c-4ea01546e497 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:27.544783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c614eb-db2c-4a8e-b69c-4ea01546e497 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:27.545211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c614eb-db2c-4a8e-b69c-4ea01546e497 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:27.546103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c614eb-db2c-4a8e-b69c-4ea01546e497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:27.546589 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c614eb-db2c-4a8e-b69c-4ea01546e497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:27.548353 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c614eb-db2c-4a8e-b69c-4ea01546e497 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:27.559019 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:27.564303 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 405/829] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:27.569514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899c8e6-9fa2-437f-a8a2-050c6a0ad0f4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:27.614014 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:27.690725 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899c8e6-9fa2-437f-a8a2-050c6a0ad0f4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:27.727224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcc1f7-1db0-40e4-861c-10533923f8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:27.728414 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcc1f7-1db0-40e4-861c-10533923f8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:27.728903 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcc1f7-1db0-40e4-861c-10533923f8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:27.729402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcc1f7-1db0-40e4-861c-10533923f8b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:27.736919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcc1f7-1db0-40e4-861c-10533923f8b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:27.738625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcc1f7-1db0-40e4-861c-10533923f8b8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:27.754544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-11bcc1f7-1db0-40e4-861c-10533923f8b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:27.754544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:27.754544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:27.754544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:27.754544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:27.754544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:27.754544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:27.754544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:27.754544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:27.754544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:27.754544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:27.754544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:27.754544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:27.754544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:27.754544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:27.755577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:27.755577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:27.755577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:27.755577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:27.755577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:27.755577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:27.755577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:27.755577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:27.755577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:27.755577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:27.755577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:27.755577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:27.755577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:27.755577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:27.755577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:27.755577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:27.755577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:27.756473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:27.756473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:27.756473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:27.756473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:27.756473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:27.756473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:27.756473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:27.756473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:27.758991 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 425/830] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:27.764223 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c614eb-db2c-4a8e-b69c-4ea01546e497 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:27.871999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c614eb-db2c-4a8e-b69c-4ea01546e497 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:27.909153 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb01eb-f882-4b5e-8fc8-755a579234a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:27.910101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb01eb-f882-4b5e-8fc8-755a579234a1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:27.910537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb01eb-f882-4b5e-8fc8-755a579234a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:27.910986 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb01eb-f882-4b5e-8fc8-755a579234a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:27.911943 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb01eb-f882-4b5e-8fc8-755a579234a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:27.912408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb01eb-f882-4b5e-8fc8-755a579234a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:27.914104 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb01eb-f882-4b5e-8fc8-755a579234a1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:27.927367 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 406/831] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:27.933278 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcc1f7-1db0-40e4-861c-10533923f8b8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:28.033044 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:28.043519 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcc1f7-1db0-40e4-861c-10533923f8b8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:28.084060 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9ee50-61ad-4d5d-81e7-8bc4ec7ac949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:28.084965 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9ee50-61ad-4d5d-81e7-8bc4ec7ac949 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:28.085247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9ee50-61ad-4d5d-81e7-8bc4ec7ac949 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:28.085524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9ee50-61ad-4d5d-81e7-8bc4ec7ac949 None admin] PATH_INFO: `/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/ebf3257328b94092b544cb0dadb789c3/roles/a21e569e87fa4cb7bfb252986942b9ab` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:28.100701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9ee50-61ad-4d5d-81e7-8bc4ec7ac949 None admin] RBAC: Authorizing `identity:create_grant(project_id=d33e1f400b3e46379d2a0abd05921181, user_id=ebf3257328b94092b544cb0dadb789c3, role_id=a21e569e87fa4cb7bfb252986942b9ab)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:28.102153 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9ee50-61ad-4d5d-81e7-8bc4ec7ac949 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:28.117297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 426/832] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:29:27 2022] PUT /identity/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/ebf3257328b94092b544cb0dadb789c3/roles/a21e569e87fa4cb7bfb252986942b9ab => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:29:28.330821 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90bec8-0569-4608-b643-ff5385e6e70e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:28.331185 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90bec8-0569-4608-b643-ff5385e6e70e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:28.331397 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90bec8-0569-4608-b643-ff5385e6e70e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:28.332918 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 407/833] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:28.338489 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9298b-5af4-42f7-87d5-47dcaa600481 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:28.339047 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9298b-5af4-42f7-87d5-47dcaa600481 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:28.339535 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9298b-5af4-42f7-87d5-47dcaa600481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:28.357824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-edd9298b-5af4-42f7-87d5-47dcaa600481 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:28.359403 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-edd9298b-5af4-42f7-87d5-47dcaa600481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:28.437393 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 427/834] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:28 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:28.461077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90bec8-0569-4608-b643-ff5385e6e70e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:28.535361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:28.580606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90bec8-0569-4608-b643-ff5385e6e70e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:28.616204 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264c8de-086c-452d-abaa-02236e9ddb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:28.616933 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264c8de-086c-452d-abaa-02236e9ddb83 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:28.617218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264c8de-086c-452d-abaa-02236e9ddb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:28.617493 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264c8de-086c-452d-abaa-02236e9ddb83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:28.629043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264c8de-086c-452d-abaa-02236e9ddb83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:28.637093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3264c8de-086c-452d-abaa-02236e9ddb83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:28.637093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:28.637093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:28.637093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:28.637093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:28.637093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:28.637093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:28.637093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:28.637093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:28.637093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:28.637093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:28.637093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:28.637093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:28.637093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:28.637093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:28.637093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:28.638016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:28.638016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:28.638016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:28.638016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:28.638016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:28.638016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:28.638016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:28.638016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:28.638016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:28.638016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:28.638016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:28.638016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:28.638016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:28.638016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:28.638016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:28.638016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:28.638877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:28.638877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:28.638877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:28.638877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:28.638877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:28.638877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:28.638877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:28.638877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:28.638877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:28.638877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:28.638877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:28.638877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:28.638877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 408/835] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:29:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:28.644275 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9298b-5af4-42f7-87d5-47dcaa600481 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:28.719767 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:28.752037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9298b-5af4-42f7-87d5-47dcaa600481 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:28.787103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e129391-1fb3-4c73-b3e0-8b2f8d90ba63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:28.787786 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e129391-1fb3-4c73-b3e0-8b2f8d90ba63 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:28.788079 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e129391-1fb3-4c73-b3e0-8b2f8d90ba63 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:28.788361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e129391-1fb3-4c73-b3e0-8b2f8d90ba63 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:28.789108 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e129391-1fb3-4c73-b3e0-8b2f8d90ba63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:28.789419 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e129391-1fb3-4c73-b3e0-8b2f8d90ba63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:28.790810 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e129391-1fb3-4c73-b3e0-8b2f8d90ba63 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:28.800039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 428/836] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:29:28 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:28.805523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264c8de-086c-452d-abaa-02236e9ddb83 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:28.910609 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264c8de-086c-452d-abaa-02236e9ddb83 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:28.931094 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:28.946817 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbdf2d-7ed3-4b4e-a208-d1ffd185a020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:28.947897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbdf2d-7ed3-4b4e-a208-d1ffd185a020 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:28.948449 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbdf2d-7ed3-4b4e-a208-d1ffd185a020 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:28.948927 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbdf2d-7ed3-4b4e-a208-d1ffd185a020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:28.960644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbdf2d-7ed3-4b4e-a208-d1ffd185a020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:28.962316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbdf2d-7ed3-4b4e-a208-d1ffd185a020 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:28.980877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-54fbdf2d-7ed3-4b4e-a208-d1ffd185a020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:28.980877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:28.980877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:28.980877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:28.980877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:28.980877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:28.980877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:28.980877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:28.980877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:28.980877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:28.980877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:28.980877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:28.980877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:28.980877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:28.980877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:28.981862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:28.981862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:28.981862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:28.981862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:28.981862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:28.981862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:28.981862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:28.981862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:28.981862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:28.981862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:28.981862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:28.981862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:28.981862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:28.981862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:28.981862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:28.981862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:28.981862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:28.982778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:28.982778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:28.982778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:28.982778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:28.984923 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 409/837] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:28.991282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e129391-1fb3-4c73-b3e0-8b2f8d90ba63 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:29.103778 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e129391-1fb3-4c73-b3e0-8b2f8d90ba63 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:29.139532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25103548-bef1-474d-afa0-7cef9b885d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:29.140245 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25103548-bef1-474d-afa0-7cef9b885d1f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:29.140532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25103548-bef1-474d-afa0-7cef9b885d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:29.140812 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25103548-bef1-474d-afa0-7cef9b885d1f None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:29.141579 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25103548-bef1-474d-afa0-7cef9b885d1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:29.142388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25103548-bef1-474d-afa0-7cef9b885d1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:29.143836 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25103548-bef1-474d-afa0-7cef9b885d1f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:29.146929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:29.157375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 429/838] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:29.162717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbdf2d-7ed3-4b4e-a208-d1ffd185a020 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:29.264552 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbdf2d-7ed3-4b4e-a208-d1ffd185a020 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:29.300176 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeced7e3-2ec9-4970-ad55-fa2fcda9bc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:29.301056 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeced7e3-2ec9-4970-ad55-fa2fcda9bc9f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:29.301348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeced7e3-2ec9-4970-ad55-fa2fcda9bc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:29.301626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeced7e3-2ec9-4970-ad55-fa2fcda9bc9f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:29.310374 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeced7e3-2ec9-4970-ad55-fa2fcda9bc9f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:29.311863 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeced7e3-2ec9-4970-ad55-fa2fcda9bc9f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:29.326557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-aeced7e3-2ec9-4970-ad55-fa2fcda9bc9f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:29.326557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:29.326557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:29.326557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:29.326557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:29.326557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:29.326557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:29.326557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:29.326557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:29.326557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:29.326557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:29.326557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:29.326557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:29.326557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:29.326557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:29.326557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:29.327537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:29.327537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:29.327537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:29.327537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:29.327537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:29.327537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:29.327537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:29.327537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:29.327537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:29.327537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:29.327537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:29.327537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:29.327537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:29.327537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:29.327537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:29.327537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:29.327537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:29.327537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:29.328454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:29.328454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:29.328454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:29.328454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:29.328454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:29.328454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:29.328454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:29.328454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:29.328454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:29.328454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:29.328454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 410/839] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:29:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:29.335686 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25103548-bef1-474d-afa0-7cef9b885d1f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:29.453519 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25103548-bef1-474d-afa0-7cef9b885d1f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:29.493443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74735aba-2bfe-4262-9de6-3a70e5fd7a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:29.494143 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74735aba-2bfe-4262-9de6-3a70e5fd7a75 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:29.494432 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74735aba-2bfe-4262-9de6-3a70e5fd7a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:29.494749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74735aba-2bfe-4262-9de6-3a70e5fd7a75 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:29.495616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74735aba-2bfe-4262-9de6-3a70e5fd7a75 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:29.495930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74735aba-2bfe-4262-9de6-3a70e5fd7a75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:29.497431 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74735aba-2bfe-4262-9de6-3a70e5fd7a75 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:29.517650 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 430/840] 10.222.0.110 () {56 vars in 1140 bytes} [Thu May 26 16:29:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:29.523683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeced7e3-2ec9-4970-ad55-fa2fcda9bc9f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:29.558394 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:29.635012 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeced7e3-2ec9-4970-ad55-fa2fcda9bc9f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:29.669024 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51938b63-c8db-4f07-a574-214fcdd8d3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:29.669728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51938b63-c8db-4f07-a574-214fcdd8d3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:29.670010 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51938b63-c8db-4f07-a574-214fcdd8d3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:29.670283 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51938b63-c8db-4f07-a574-214fcdd8d3d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:29.671312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67f5ce-3fef-489f-8bd0-93f0f664abce None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:29.671525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67f5ce-3fef-489f-8bd0-93f0f664abce None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:29.671809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67f5ce-3fef-489f-8bd0-93f0f664abce None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:29.678667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 431/841] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:29:29.680756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c259502-1e5d-4453-93e0-2a7cdc475f04 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:29.681055 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c259502-1e5d-4453-93e0-2a7cdc475f04 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:29.681337 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c259502-1e5d-4453-93e0-2a7cdc475f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:29.699861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6c259502-1e5d-4453-93e0-2a7cdc475f04 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:29.701086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6c259502-1e5d-4453-93e0-2a7cdc475f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:29.746325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51938b63-c8db-4f07-a574-214fcdd8d3d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:29.748164 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51938b63-c8db-4f07-a574-214fcdd8d3d4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:29.754159 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:29.782694 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 432/842] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:29 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:29:29.786986 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:29.797892 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c259502-1e5d-4453-93e0-2a7cdc475f04 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:29.856589 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 411/843] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:29:29 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:29:29.863296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51938b63-c8db-4f07-a574-214fcdd8d3d4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:29.905947 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c259502-1e5d-4453-93e0-2a7cdc475f04 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:29.950216 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5fc06-aeee-447d-8602-8552ede1575a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:29.951460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5fc06-aeee-447d-8602-8552ede1575a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:29.951752 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5fc06-aeee-447d-8602-8552ede1575a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:29.952299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5fc06-aeee-447d-8602-8552ede1575a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:29.952968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5fc06-aeee-447d-8602-8552ede1575a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:29.955427 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5fc06-aeee-447d-8602-8552ede1575a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:29.968146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-2fd5fc06-aeee-447d-8602-8552ede1575a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:29:29.968146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:29.968146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:29.968146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:29.968146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:29.968146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:29.968146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:29.968146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:29.968146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:29:29.968146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:29.968146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:29.968146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:29.968146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:29.968146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:29.968146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:29.968146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:29.968146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:29.969258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:29.969258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:29.969258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:29.969258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:29.969258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:29.969258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:29.969258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:29.969258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:29.969258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:29.969258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:29.969258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:29.969258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:29.969258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:29.969258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:29.969258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:29.969258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:29.970801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:29.970801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:29.970801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:29.970801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:29.970801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:29.970801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:29.970801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:29.970801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:29.970801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:29.970801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:29.970801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:29.970801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:29.970801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:29:29.970801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:29.970801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 433/844] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:29:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:29.972133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbe145-8599-4325-9d77-5066dcf3d3c9 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:29.972133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbe145-8599-4325-9d77-5066dcf3d3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:29.972133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbe145-8599-4325-9d77-5066dcf3d3c9 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:29.977404 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 434/845] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:29.977404 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbe145-8599-4325-9d77-5066dcf3d3c9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:29.982653 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51938b63-c8db-4f07-a574-214fcdd8d3d4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:30.015321 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:30.021466 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508431c-777d-47ef-959b-043d7825e6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:30.022722 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508431c-777d-47ef-959b-043d7825e6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.023009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508431c-777d-47ef-959b-043d7825e6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.023298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508431c-777d-47ef-959b-043d7825e6f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.028448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:30.034257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508431c-777d-47ef-959b-043d7825e6f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:30.035745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508431c-777d-47ef-959b-043d7825e6f1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:30.054096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4508431c-777d-47ef-959b-043d7825e6f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:30.054096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:30.054096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:30.054096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:30.054096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:30.054096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:30.054096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:30.054096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:30.054096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:30.054096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:30.054096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:30.054096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:30.054096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:30.054096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:30.054096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:30.055121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:30.055121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:30.055121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:30.055121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:30.055121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:30.055121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:30.055121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:30.055121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:30.055121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:30.055121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:30.055121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:30.055121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:30.055121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:30.055121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:30.055121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:30.055121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:30.055121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:30.056202 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:30.056202 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:30.056202 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:30.056202 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:30.059766 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 412/846] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:30.061048 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8802d-7ffa-461e-9334-a0ece04554e0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.061340 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8802d-7ffa-461e-9334-a0ece04554e0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.061629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8802d-7ffa-461e-9334-a0ece04554e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.082381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d0e8802d-7ffa-461e-9334-a0ece04554e0 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:30.083632 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d0e8802d-7ffa-461e-9334-a0ece04554e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:30.091990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbe145-8599-4325-9d77-5066dcf3d3c9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:30.131111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc13a0-83b5-4c89-a8ec-e6292d09594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:30.131846 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc13a0-83b5-4c89-a8ec-e6292d09594a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.132253 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc13a0-83b5-4c89-a8ec-e6292d09594a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.132537 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc13a0-83b5-4c89-a8ec-e6292d09594a None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.133258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc13a0-83b5-4c89-a8ec-e6292d09594a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:30.133567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc13a0-83b5-4c89-a8ec-e6292d09594a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:30.134964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc13a0-83b5-4c89-a8ec-e6292d09594a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:30.139868 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 435/847] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:29:29 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:30.140423 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc13a0-83b5-4c89-a8ec-e6292d09594a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:30.159003 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 413/848] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:30 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:30.167474 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8802d-7ffa-461e-9334-a0ece04554e0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:30.267759 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc13a0-83b5-4c89-a8ec-e6292d09594a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:30.278267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8802d-7ffa-461e-9334-a0ece04554e0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:30.280115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:30.294090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:30.306528 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e275f9-ca18-46d9-a4da-6d57f129d6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:30.307231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e275f9-ca18-46d9-a4da-6d57f129d6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.307518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e275f9-ca18-46d9-a4da-6d57f129d6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.307795 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e275f9-ca18-46d9-a4da-6d57f129d6e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.308514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e275f9-ca18-46d9-a4da-6d57f129d6e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:30.308817 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e275f9-ca18-46d9-a4da-6d57f129d6e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:30.310178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e275f9-ca18-46d9-a4da-6d57f129d6e8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:30.317160 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb874f8-a3ea-4774-8523-0bab6289d625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:30.317831 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb874f8-a3ea-4774-8523-0bab6289d625 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.318119 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb874f8-a3ea-4774-8523-0bab6289d625 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.318397 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb874f8-a3ea-4774-8523-0bab6289d625 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.319147 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb874f8-a3ea-4774-8523-0bab6289d625 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:30.319707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb874f8-a3ea-4774-8523-0bab6289d625 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:30.320802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb874f8-a3ea-4774-8523-0bab6289d625 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:30.322772 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 436/849] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:30.323518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e275f9-ca18-46d9-a4da-6d57f129d6e8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:30.338617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 414/850] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:29:30 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:30.338617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb874f8-a3ea-4774-8523-0bab6289d625 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:30.460429 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e275f9-ca18-46d9-a4da-6d57f129d6e8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:30.483162 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb874f8-a3ea-4774-8523-0bab6289d625 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:30.501987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a30b1-5b34-4f06-afe4-14781b42c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:30.503050 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a30b1-5b34-4f06-afe4-14781b42c656 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.503343 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a30b1-5b34-4f06-afe4-14781b42c656 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.503621 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a30b1-5b34-4f06-afe4-14781b42c656 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.504631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a30b1-5b34-4f06-afe4-14781b42c656 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:30.506046 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a30b1-5b34-4f06-afe4-14781b42c656 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:30.520649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-7f6a30b1-5b34-4f06-afe4-14781b42c656 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:29:30.520649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:30.520649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:30.520649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:30.520649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:30.520649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:30.520649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:30.520649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:30.520649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:29:30.520649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:30.520649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:30.520649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:30.520649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:30.520649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:30.520649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:30.520649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:30.521652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:30.521652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:30.521652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:30.521652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:30.521652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:30.521652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:30.521652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:30.521652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:30.521652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:30.521652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:30.521652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:30.521652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:30.521652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:30.521652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:30.521652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:30.521652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:30.522552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:30.522552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:30.522552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:30.522552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:30.522552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:30.522552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:30.522552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:30.522552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:30.522552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:30.522552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:30.522552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:30.522552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:30.522552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:30.522552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:29:30.522552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:30.522552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 437/851] 10.222.0.110 () {56 vars in 1137 bytes} [Thu May 26 16:29:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:30.524687 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091be62a-67d3-4078-ae4f-05f7fedaf793 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.524687 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091be62a-67d3-4078-ae4f-05f7fedaf793 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.524687 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091be62a-67d3-4078-ae4f-05f7fedaf793 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.528531 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8025d-3393-4b15-a420-f172bd620c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:30.529058 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 438/852] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:30 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:30.529424 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8025d-3393-4b15-a420-f172bd620c0d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.529718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8025d-3393-4b15-a420-f172bd620c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.529895 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091be62a-67d3-4078-ae4f-05f7fedaf793 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:30.529991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8025d-3393-4b15-a420-f172bd620c0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.539006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8025d-3393-4b15-a420-f172bd620c0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:30.540457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8025d-3393-4b15-a420-f172bd620c0d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:30.555190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-53b8025d-3393-4b15-a420-f172bd620c0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:30.555190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:30.555190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:30.555190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:30.555190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:30.555190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:30.555190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:30.555190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:30.555190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:30.555190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:30.555190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:30.555190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:30.555190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:30.555190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:30.555190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:30.556121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:30.556121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:30.556121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:30.556121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:30.556121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:30.556121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:30.556121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:30.556121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:30.556121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:30.556121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:30.556121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:30.556121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:30.556121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:30.556121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:30.556121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:30.556121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:30.556121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:30.557028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:30.557028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:30.557028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:30.557028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:30.557028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:30.557028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:30.557028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:30.557028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:30.557028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 415/853] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:30.557987 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7aeda6-684c-499b-b3cd-3907c22fc64f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.557987 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7aeda6-684c-499b-b3cd-3907c22fc64f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.558159 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7aeda6-684c-499b-b3cd-3907c22fc64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.570325 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:30.575823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4f7aeda6-684c-499b-b3cd-3907c22fc64f None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:30.577248 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4f7aeda6-684c-499b-b3cd-3907c22fc64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:30.610888 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:30.643059 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091be62a-67d3-4078-ae4f-05f7fedaf793 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:30.650907 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 416/854] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:30 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:30.652118 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7aeda6-684c-499b-b3cd-3907c22fc64f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:30.680045 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f16b3-91cf-4c4c-9465-2dc94c612954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:30.680760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f16b3-91cf-4c4c-9465-2dc94c612954 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.681059 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f16b3-91cf-4c4c-9465-2dc94c612954 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.681342 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f16b3-91cf-4c4c-9465-2dc94c612954 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.682057 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f16b3-91cf-4c4c-9465-2dc94c612954 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:30.682373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f16b3-91cf-4c4c-9465-2dc94c612954 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:30.683945 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f16b3-91cf-4c4c-9465-2dc94c612954 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:30.692889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 439/855] 10.222.0.110 () {56 vars in 1131 bytes} [Thu May 26 16:29:30 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:30.692889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f16b3-91cf-4c4c-9465-2dc94c612954 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:30.775957 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7aeda6-684c-499b-b3cd-3907c22fc64f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:30.801944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:30.806840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f16b3-91cf-4c4c-9465-2dc94c612954 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:30.815938 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54d95c-c061-4872-bd39-b11794d8fdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:30.816614 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54d95c-c061-4872-bd39-b11794d8fdc5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.816898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54d95c-c061-4872-bd39-b11794d8fdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.817173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54d95c-c061-4872-bd39-b11794d8fdc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.817956 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54d95c-c061-4872-bd39-b11794d8fdc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:30.818271 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54d95c-c061-4872-bd39-b11794d8fdc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:30.819818 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54d95c-c061-4872-bd39-b11794d8fdc5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:30.832289 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 417/856] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:30.837886 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54d95c-c061-4872-bd39-b11794d8fdc5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:30.843057 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e24c07-a74d-4fd0-9bb1-59101bf0e81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:30.843857 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e24c07-a74d-4fd0-9bb1-59101bf0e81e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.844137 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e24c07-a74d-4fd0-9bb1-59101bf0e81e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.844412 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e24c07-a74d-4fd0-9bb1-59101bf0e81e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.855701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e24c07-a74d-4fd0-9bb1-59101bf0e81e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:30.863985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-16e24c07-a74d-4fd0-9bb1-59101bf0e81e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:30.863985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:30.863985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:30.863985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:30.863985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:30.863985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:30.863985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:30.863985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:30.863985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:30.863985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:30.863985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:30.863985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:30.863985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:30.863985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:30.863985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:30.863985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:30.864973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:30.864973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:30.864973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:30.864973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:30.864973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:30.864973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:30.864973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:30.864973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:30.864973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:30.864973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:30.864973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:30.864973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:30.864973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:30.864973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:30.864973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:30.864973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:30.865863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:30.865863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:30.865863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:30.865863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:30.865863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:30.865863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:30.865863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:30.865863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:30.865863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:30.865863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:30.865863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:30.865863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:30.865863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 440/857] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:29:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:30.866629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e24c07-a74d-4fd0-9bb1-59101bf0e81e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:30.877882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:30.954550 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54d95c-c061-4872-bd39-b11794d8fdc5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:30.973684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e24c07-a74d-4fd0-9bb1-59101bf0e81e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:30.989160 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5303fc-9c7b-42ab-b7cf-9cd537c97516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:30.989825 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5303fc-9c7b-42ab-b7cf-9cd537c97516 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.990116 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5303fc-9c7b-42ab-b7cf-9cd537c97516 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.990393 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5303fc-9c7b-42ab-b7cf-9cd537c97516 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.991123 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5303fc-9c7b-42ab-b7cf-9cd537c97516 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:30.991433 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5303fc-9c7b-42ab-b7cf-9cd537c97516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:30.992786 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5303fc-9c7b-42ab-b7cf-9cd537c97516 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:30.997429 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 418/858] 10.222.0.110 () {56 vars in 1131 bytes} [Thu May 26 16:29:30 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:31.003977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5303fc-9c7b-42ab-b7cf-9cd537c97516 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:31.014726 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef70dcc-c4a2-4c4b-9fd2-a8592d975bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:31.015828 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef70dcc-c4a2-4c4b-9fd2-a8592d975bbc None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:31.016916 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef70dcc-c4a2-4c4b-9fd2-a8592d975bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:31.017549 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef70dcc-c4a2-4c4b-9fd2-a8592d975bbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:31.018685 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef70dcc-c4a2-4c4b-9fd2-a8592d975bbc None admin] RBAC: Adding query filter params (role.id=1393d128d39b4649b6cd71b6609846cb, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=aa4502c57e324c31a8bce12770a92371) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:31.019240 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef70dcc-c4a2-4c4b-9fd2-a8592d975bbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:31.021059 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef70dcc-c4a2-4c4b-9fd2-a8592d975bbc None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:31.029185 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 441/859] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:29:30 2022] GET /identity/v3/role_assignments?user.id=aa4502c57e324c31a8bce12770a92371&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=1393d128d39b4649b6cd71b6609846cb => generated 610 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:31.121752 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:31.132880 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5303fc-9c7b-42ab-b7cf-9cd537c97516 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:31.175958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb5a60-ee39-46f4-bf84-96fee942f2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:31.176671 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb5a60-ee39-46f4-bf84-96fee942f2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:31.176955 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb5a60-ee39-46f4-bf84-96fee942f2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:31.177232 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb5a60-ee39-46f4-bf84-96fee942f2a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:31.178011 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb5a60-ee39-46f4-bf84-96fee942f2a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:31.178319 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb5a60-ee39-46f4-bf84-96fee942f2a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:31.179796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb5a60-ee39-46f4-bf84-96fee942f2a5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:31.195022 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 419/860] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:29:30 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:31.196723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef70dcc-c4a2-4c4b-9fd2-a8592d975bbc None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:31.228674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:31.311821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef70dcc-c4a2-4c4b-9fd2-a8592d975bbc None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:31.347553 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9efd4a-1318-4a81-8d64-32692a04ebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:31.348353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9efd4a-1318-4a81-8d64-32692a04ebb8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:31.348637 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9efd4a-1318-4a81-8d64-32692a04ebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:31.348913 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9efd4a-1318-4a81-8d64-32692a04ebb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:31.362840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9efd4a-1318-4a81-8d64-32692a04ebb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:31.362840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9efd4a-1318-4a81-8d64-32692a04ebb8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:31.381557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-3e9efd4a-1318-4a81-8d64-32692a04ebb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:31.381557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:31.381557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:31.381557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:31.381557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:31.381557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:31.381557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:31.381557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:31.381557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:31.381557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:31.381557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:31.381557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:31.381557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:31.381557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:31.381557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:31.382510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:31.382510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:31.382510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:31.382510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:31.382510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:31.382510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:31.382510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:31.382510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:31.382510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:31.382510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:31.382510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:31.382510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:31.382510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:31.382510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:31.382510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:31.382510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:31.382510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:31.383423 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:31.383423 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:31.383423 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:31.383423 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:31.383423 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 442/861] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:31.388824 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb5a60-ee39-46f4-bf84-96fee942f2a5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:31.492485 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb5a60-ee39-46f4-bf84-96fee942f2a5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:31.527552 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1c313-deb4-43d4-bc10-542d38b3bc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:31.528241 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1c313-deb4-43d4-bc10-542d38b3bc3f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:31.528581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1c313-deb4-43d4-bc10-542d38b3bc3f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:31.528876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1c313-deb4-43d4-bc10-542d38b3bc3f None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:31.529613 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1c313-deb4-43d4-bc10-542d38b3bc3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:31.529920 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1c313-deb4-43d4-bc10-542d38b3bc3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:31.531362 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1c313-deb4-43d4-bc10-542d38b3bc3f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:31.545768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 420/862] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:31.552113 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9efd4a-1318-4a81-8d64-32692a04ebb8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:31.631613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:31.657813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9efd4a-1318-4a81-8d64-32692a04ebb8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:31.692824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d69e03-4e35-42ab-80f0-71fae23c52b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:31.693639 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d69e03-4e35-42ab-80f0-71fae23c52b2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:31.693922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d69e03-4e35-42ab-80f0-71fae23c52b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:31.694201 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d69e03-4e35-42ab-80f0-71fae23c52b2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:31.702210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d69e03-4e35-42ab-80f0-71fae23c52b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:31.703680 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d69e03-4e35-42ab-80f0-71fae23c52b2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:31.718757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-17d69e03-4e35-42ab-80f0-71fae23c52b2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:29:31.718757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:31.718757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:31.718757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:31.718757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:31.718757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:31.718757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:31.718757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:31.718757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:31.718757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:31.718757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:31.718757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:31.718757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:31.718757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:31.718757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:31.718757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:31.720010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:31.720010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:31.720010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:31.720010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:31.720010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:31.720010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:31.720010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:31.720010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:31.720010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:31.720010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:31.720010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:31.720010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:31.720010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:31.720010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:31.720010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:31.720010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:31.720010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:31.720010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:31.720949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:31.720949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:31.720949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:31.720949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:31.720949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:31.720949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:31.720949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:31.720949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:31.720949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:29:31.720949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:31.721963 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 443/863] 10.222.0.110 () {56 vars in 1122 bytes} [Thu May 26 16:29:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:31.726702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1c313-deb4-43d4-bc10-542d38b3bc3f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:31.743288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:31.832711 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1c313-deb4-43d4-bc10-542d38b3bc3f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:31.868257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe90826-d29d-45c7-acdc-4ebe3934adb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:31.868941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe90826-d29d-45c7-acdc-4ebe3934adb1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:31.869223 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe90826-d29d-45c7-acdc-4ebe3934adb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:31.869495 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe90826-d29d-45c7-acdc-4ebe3934adb1 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:31.870325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe90826-d29d-45c7-acdc-4ebe3934adb1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:31.870659 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe90826-d29d-45c7-acdc-4ebe3934adb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:31.872080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe90826-d29d-45c7-acdc-4ebe3934adb1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:31.890361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 421/864] 10.222.0.110 () {56 vars in 1154 bytes} [Thu May 26 16:29:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:31.896352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d69e03-4e35-42ab-80f0-71fae23c52b2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:31.999560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d69e03-4e35-42ab-80f0-71fae23c52b2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:32.034544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf9187-be9f-4031-8916-3082a060b70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:32.035265 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf9187-be9f-4031-8916-3082a060b70f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:32.035550 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf9187-be9f-4031-8916-3082a060b70f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:32.035824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf9187-be9f-4031-8916-3082a060b70f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:32.038701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:32.105537 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf9187-be9f-4031-8916-3082a060b70f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:32.107023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf9187-be9f-4031-8916-3082a060b70f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:32.212303 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 444/865] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:29:31 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:29:32.217711 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe90826-d29d-45c7-acdc-4ebe3934adb1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:32.303578 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:32.323180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe90826-d29d-45c7-acdc-4ebe3934adb1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:32.359003 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e950e-a0e1-413f-925c-050ac3d8c65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:32.359593 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e950e-a0e1-413f-925c-050ac3d8c65a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:32.359874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e950e-a0e1-413f-925c-050ac3d8c65a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:32.360722 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e950e-a0e1-413f-925c-050ac3d8c65a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:32.371361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e950e-a0e1-413f-925c-050ac3d8c65a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:32.378586 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e950e-a0e1-413f-925c-050ac3d8c65a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:32.390995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-340e950e-a0e1-413f-925c-050ac3d8c65a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:32.390995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:32.390995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:32.390995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:32.390995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:32.390995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:32.390995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:32.390995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:32.390995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:32.390995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:32.390995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:32.390995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:32.390995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:32.390995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:32.390995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:32.392422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:32.392422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:32.392422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:32.392422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:32.392422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:32.392422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:32.392422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:32.392422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:32.392422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:32.392422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:32.392422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:32.392422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:32.392422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:32.392422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:32.392422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:32.392422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:32.392422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:32.393283 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:32.393283 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:32.393283 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:32.393283 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:32.393283 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 422/866] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:32.398902 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf9187-be9f-4031-8916-3082a060b70f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:32.441799 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:32.514185 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf9187-be9f-4031-8916-3082a060b70f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:32.553848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cb831-db1b-4acd-bdd9-46142be91e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:32.554520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cb831-db1b-4acd-bdd9-46142be91e1c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:32.554832 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cb831-db1b-4acd-bdd9-46142be91e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:32.555109 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cb831-db1b-4acd-bdd9-46142be91e1c None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:32.555836 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cb831-db1b-4acd-bdd9-46142be91e1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:32.556144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cb831-db1b-4acd-bdd9-46142be91e1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:32.557510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cb831-db1b-4acd-bdd9-46142be91e1c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:32.570662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 445/867] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:32.576065 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e950e-a0e1-413f-925c-050ac3d8c65a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:32.682542 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e950e-a0e1-413f-925c-050ac3d8c65a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:32.707690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:32.718885 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59985ef5-4387-4144-b1fa-6e316270650c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:32.720194 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59985ef5-4387-4144-b1fa-6e316270650c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:32.720515 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59985ef5-4387-4144-b1fa-6e316270650c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:32.720866 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59985ef5-4387-4144-b1fa-6e316270650c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:32.722627 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97d41b-f92b-4e1e-9f1d-87e8d889d2db None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:32.723089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97d41b-f92b-4e1e-9f1d-87e8d889d2db None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:32.723520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97d41b-f92b-4e1e-9f1d-87e8d889d2db None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:32.725249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 446/868] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:32.727966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59985ef5-4387-4144-b1fa-6e316270650c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:32.729520 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59985ef5-4387-4144-b1fa-6e316270650c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:32.731050 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f523c-ae02-495a-b892-755da11effa1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:32.731566 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f523c-ae02-495a-b892-755da11effa1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:32.732062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f523c-ae02-495a-b892-755da11effa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:32.746357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-59985ef5-4387-4144-b1fa-6e316270650c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:32.746357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:32.746357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:32.746357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:32.746357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:32.746357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:32.746357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:32.746357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:32.746357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:32.746357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:32.746357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:32.746357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:32.746357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:32.746357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:32.746357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:32.747361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:32.747361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:32.747361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:32.747361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:32.747361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:32.747361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:32.747361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:32.747361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:32.747361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:32.747361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:32.747361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:32.747361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:32.747361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:32.747361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:32.747361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:32.747361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:32.747361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:32.748494 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:32.748494 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:32.748494 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:32.748494 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:32.748494 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:32.748494 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:32.748494 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:32.748494 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:32.748494 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 423/869] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:32.754252 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59985ef5-4387-4144-b1fa-6e316270650c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:32.754547 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f91f523c-ae02-495a-b892-755da11effa1 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:32.757074 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f91f523c-ae02-495a-b892-755da11effa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:32.854847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 447/870] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:32 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:32.867943 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59985ef5-4387-4144-b1fa-6e316270650c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:32.877854 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f523c-ae02-495a-b892-755da11effa1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:32.903258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:32.909977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180fc9f-e4f7-4d6c-9232-6fe6c7c69806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:32.911359 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180fc9f-e4f7-4d6c-9232-6fe6c7c69806 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:32.911639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180fc9f-e4f7-4d6c-9232-6fe6c7c69806 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:32.911916 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180fc9f-e4f7-4d6c-9232-6fe6c7c69806 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:32.912716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180fc9f-e4f7-4d6c-9232-6fe6c7c69806 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:32.913027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180fc9f-e4f7-4d6c-9232-6fe6c7c69806 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:32.914473 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180fc9f-e4f7-4d6c-9232-6fe6c7c69806 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:32.931807 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 424/871] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:32.934011 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180fc9f-e4f7-4d6c-9232-6fe6c7c69806 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:32.991692 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f523c-ae02-495a-b892-755da11effa1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:33.001158 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:33.029877 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b4a03-d2de-447f-b66f-1aa1e816a2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:33.030552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b4a03-d2de-447f-b66f-1aa1e816a2d3 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:33.030865 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b4a03-d2de-447f-b66f-1aa1e816a2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:33.031143 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b4a03-d2de-447f-b66f-1aa1e816a2d3 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:33.032115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b4a03-d2de-447f-b66f-1aa1e816a2d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:33.033491 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b4a03-d2de-447f-b66f-1aa1e816a2d3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:33.049170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180fc9f-e4f7-4d6c-9232-6fe6c7c69806 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:33.050610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 448/872] 10.222.0.110 () {60 vars in 1146 bytes} [Thu May 26 16:29:32 2022] POST /identity/v3/services => generated 252 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:29:33.108239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fba7b-9417-4231-8193-026fd7176778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:33.110644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fba7b-9417-4231-8193-026fd7176778 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:33.110644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fba7b-9417-4231-8193-026fd7176778 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:33.110644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fba7b-9417-4231-8193-026fd7176778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:33.110984 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fba7b-9417-4231-8193-026fd7176778 None admin] RBAC: Adding query filter params (role.id=a21e569e87fa4cb7bfb252986942b9ab, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=ebf3257328b94092b544cb0dadb789c3) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:33.111280 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fba7b-9417-4231-8193-026fd7176778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:33.112761 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fba7b-9417-4231-8193-026fd7176778 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:33.120626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 425/873] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:29:32 2022] GET /identity/v3/role_assignments?user.id=ebf3257328b94092b544cb0dadb789c3&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=a21e569e87fa4cb7bfb252986942b9ab => generated 610 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:33.344667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea54be-6559-4ec8-8b62-aab7e7ca673b None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:33.345179 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea54be-6559-4ec8-8b62-aab7e7ca673b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:33.345286 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea54be-6559-4ec8-8b62-aab7e7ca673b None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:33.346937 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 449/874] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:33.352480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabdd7a-e590-4ed7-a9d8-f5e89c10dcbd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:33.352773 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabdd7a-e590-4ed7-a9d8-f5e89c10dcbd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:33.353056 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabdd7a-e590-4ed7-a9d8-f5e89c10dcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:33.375701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c6717-3f9f-4f66-a161-b18e5b0e1595 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:33.376128 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c6717-3f9f-4f66-a161-b18e5b0e1595 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:33.376498 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c6717-3f9f-4f66-a161-b18e5b0e1595 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:33.377877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2cabdd7a-e590-4ed7-a9d8-f5e89c10dcbd None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:33.378445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 450/875] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:29:33.379111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2cabdd7a-e590-4ed7-a9d8-f5e89c10dcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:33.384751 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42e577-30f4-4583-990f-a9b03ad967a3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:33.384751 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42e577-30f4-4583-990f-a9b03ad967a3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:33.384751 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42e577-30f4-4583-990f-a9b03ad967a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:33.402727 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ed42e577-30f4-4583-990f-a9b03ad967a3 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:33.404255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ed42e577-30f4-4583-990f-a9b03ad967a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:33.466591 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 426/876] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:33 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:33.483801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabdd7a-e590-4ed7-a9d8-f5e89c10dcbd None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:33.486399 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 451/877] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:33 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:29:33.510095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42e577-30f4-4583-990f-a9b03ad967a3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:33.523198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:33.526678 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:33.610677 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabdd7a-e590-4ed7-a9d8-f5e89c10dcbd None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:33.616241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42e577-30f4-4583-990f-a9b03ad967a3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:33.659780 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53996e-5263-4b3d-be77-3b37811d8a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:33.660355 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198b835-4640-46f0-a239-010b6e226d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:33.660549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53996e-5263-4b3d-be77-3b37811d8a68 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:33.660961 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53996e-5263-4b3d-be77-3b37811d8a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:33.661308 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53996e-5263-4b3d-be77-3b37811d8a68 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:33.661882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198b835-4640-46f0-a239-010b6e226d1c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:33.662162 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53996e-5263-4b3d-be77-3b37811d8a68 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:33.662538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198b835-4640-46f0-a239-010b6e226d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:33.663019 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198b835-4640-46f0-a239-010b6e226d1c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:33.663755 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53996e-5263-4b3d-be77-3b37811d8a68 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:33.664039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198b835-4640-46f0-a239-010b6e226d1c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:33.665571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198b835-4640-46f0-a239-010b6e226d1c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:33.679115 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 427/878] 10.222.0.110 () {60 vars in 1146 bytes} [Thu May 26 16:29:33 2022] POST /identity/v3/services => generated 270 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:29:33.680818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-b198b835-4640-46f0-a239-010b6e226d1c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:29:33.680818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:33.680818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:33.680818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:33.680818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:33.680818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:33.680818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:33.680818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:33.680818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:29:33.680818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:33.680818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:33.680818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:33.680818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:33.680818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:33.680818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:33.680818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:33.680818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:33.681847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:33.681847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:33.681847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:33.681847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:33.681847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:33.681847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:33.681847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:33.681847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:33.681847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:33.681847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:33.681847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:33.681847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:33.681847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:33.681847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:33.681847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:33.681847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:33.682766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:33.682766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:33.682766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:33.682766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:33.682766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:33.682766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:33.682766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:33.682766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:33.682766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:33.682766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:33.682766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:33.682766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:33.682766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:29:33.682766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:33.694622 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 452/879] 10.222.0.110 () {56 vars in 1131 bytes} [Thu May 26 16:29:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:33.694886 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53996e-5263-4b3d-be77-3b37811d8a68 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:33.809126 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:33.824039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53996e-5263-4b3d-be77-3b37811d8a68 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:33.865851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93906cb-febd-4d13-bc25-6308e87add3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:33.866533 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93906cb-febd-4d13-bc25-6308e87add3d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:33.866853 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93906cb-febd-4d13-bc25-6308e87add3d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:33.867128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93906cb-febd-4d13-bc25-6308e87add3d None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:33.867843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93906cb-febd-4d13-bc25-6308e87add3d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:33.868154 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93906cb-febd-4d13-bc25-6308e87add3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:33.869523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93906cb-febd-4d13-bc25-6308e87add3d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:33.875226 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 428/880] 10.222.0.110 () {56 vars in 1127 bytes} [Thu May 26 16:29:33 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:33.880816 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198b835-4640-46f0-a239-010b6e226d1c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:33.970411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:34.010599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198b835-4640-46f0-a239-010b6e226d1c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:34.047025 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131d2d6-9ee5-4f2c-b667-222d5f50bdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:34.048345 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131d2d6-9ee5-4f2c-b667-222d5f50bdff None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:34.048635 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131d2d6-9ee5-4f2c-b667-222d5f50bdff None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:34.048915 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131d2d6-9ee5-4f2c-b667-222d5f50bdff None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:34.049627 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131d2d6-9ee5-4f2c-b667-222d5f50bdff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:34.049940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131d2d6-9ee5-4f2c-b667-222d5f50bdff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:34.051397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131d2d6-9ee5-4f2c-b667-222d5f50bdff None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:34.056586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 453/881] 10.222.0.110 () {56 vars in 1127 bytes} [Thu May 26 16:29:33 2022] GET /identity/v3/services?type=object-store => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:35.372642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b547937-47f4-44da-ac26-105ace68b553 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:35.373034 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b547937-47f4-44da-ac26-105ace68b553 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:35.373143 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b547937-47f4-44da-ac26-105ace68b553 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:35.374925 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 429/882] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:35.381046 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed93d77-0cb3-4b5e-be3e-e94d2eadab04 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:35.381590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed93d77-0cb3-4b5e-be3e-e94d2eadab04 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:35.381590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed93d77-0cb3-4b5e-be3e-e94d2eadab04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:35.400373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6ed93d77-0cb3-4b5e-be3e-e94d2eadab04 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:35.401588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6ed93d77-0cb3-4b5e-be3e-e94d2eadab04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:35.473151 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 454/883] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:35 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:35.496507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b547937-47f4-44da-ac26-105ace68b553 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:35.591400 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97338dc7-3cb3-4e80-9e82-cf64eb634d0f None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:35.591754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97338dc7-3cb3-4e80-9e82-cf64eb634d0f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:35.591962 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97338dc7-3cb3-4e80-9e82-cf64eb634d0f None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:35.593592 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 455/884] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:35.599054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f85d9-4689-429e-989c-f74b3fefae10 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:35.599302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f85d9-4689-429e-989c-f74b3fefae10 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:35.599585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f85d9-4689-429e-989c-f74b3fefae10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:35.607390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b547937-47f4-44da-ac26-105ace68b553 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:35.617803 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-620f85d9-4689-429e-989c-f74b3fefae10 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:35.619174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-620f85d9-4689-429e-989c-f74b3fefae10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:35.644983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b112193-58cb-4076-938e-4dc90d599250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:35.646108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b112193-58cb-4076-938e-4dc90d599250 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:35.646654 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b112193-58cb-4076-938e-4dc90d599250 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:35.647133 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b112193-58cb-4076-938e-4dc90d599250 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:35.647979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b112193-58cb-4076-938e-4dc90d599250 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:35.649542 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b112193-58cb-4076-938e-4dc90d599250 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:35.662054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-0b112193-58cb-4076-938e-4dc90d599250 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:29:35.662054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:35.662054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:35.662054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:35.662054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:35.662054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:35.662054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:35.662054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:35.662054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:29:35.662054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:35.662054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:35.662054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:35.662054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:35.662054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:35.662054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:35.662054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:35.662054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:35.663113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:35.663113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:35.663113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:35.663113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:35.663113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:35.663113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:35.663113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:35.663113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:35.663113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:35.663113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:35.663113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:35.663113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:35.663113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:35.663113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:35.663113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:35.663113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:35.663954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:35.663954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:35.663954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:35.663954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:35.663954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:35.663954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:35.663954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:35.663954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:35.663954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:35.663954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:35.663954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:35.663954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:35.663954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:29:35.663954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:35.666837 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 430/885] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:29:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:35.672393 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b112193-58cb-4076-938e-4dc90d599250 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:35.699268 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:35.706851 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 456/886] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:35 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:29:35.728531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f85d9-4689-429e-989c-f74b3fefae10 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:35.731258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:35.809273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b112193-58cb-4076-938e-4dc90d599250 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:35.846130 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f85d9-4689-429e-989c-f74b3fefae10 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:35.851687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3bfe5-b71a-412e-85dd-cc2182ce11e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:35.852373 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3bfe5-b71a-412e-85dd-cc2182ce11e5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:35.852664 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3bfe5-b71a-412e-85dd-cc2182ce11e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:35.852946 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3bfe5-b71a-412e-85dd-cc2182ce11e5 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:35.853656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3bfe5-b71a-412e-85dd-cc2182ce11e5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:35.853969 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3bfe5-b71a-412e-85dd-cc2182ce11e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:35.855779 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3bfe5-b71a-412e-85dd-cc2182ce11e5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:35.865390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 431/887] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:29:35 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:35.866386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3bfe5-b71a-412e-85dd-cc2182ce11e5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:35.886883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8066117-5fa2-4b9c-b7d1-7b5b05b946cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:35.888279 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8066117-5fa2-4b9c-b7d1-7b5b05b946cf None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:35.888788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8066117-5fa2-4b9c-b7d1-7b5b05b946cf None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:35.889308 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8066117-5fa2-4b9c-b7d1-7b5b05b946cf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:35.901469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8066117-5fa2-4b9c-b7d1-7b5b05b946cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:35.911156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-c8066117-5fa2-4b9c-b7d1-7b5b05b946cf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:29:35.911156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:35.911156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:35.911156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:35.911156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:35.911156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:35.911156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:35.911156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:35.911156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:35.911156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:35.911156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:35.911156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:35.911156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:35.911156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:35.911156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:35.911156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:35.912102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:35.912102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:35.912102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:35.912102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:35.912102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:35.912102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:35.912102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:35.912102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:35.912102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:35.912102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:35.912102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:35.912102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:35.912102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:35.912102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:35.912102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:35.912102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:35.912939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:35.912939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:35.912939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:35.912939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:35.912939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:35.912939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:35.912939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:35.912939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:35.912939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:35.912939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:35.912939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:29:35.912939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:35.920508 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 457/888] 10.222.0.110 () {56 vars in 1125 bytes} [Thu May 26 16:29:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:35.921774 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8066117-5fa2-4b9c-b7d1-7b5b05b946cf None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:35.955350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:35.976072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3bfe5-b71a-412e-85dd-cc2182ce11e5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:35.991953 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:36.014999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf38ba-189b-4665-8464-d2c9af51f899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:36.015671 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf38ba-189b-4665-8464-d2c9af51f899 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.016009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf38ba-189b-4665-8464-d2c9af51f899 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.016981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf38ba-189b-4665-8464-d2c9af51f899 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.017639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf38ba-189b-4665-8464-d2c9af51f899 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:36.017951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf38ba-189b-4665-8464-d2c9af51f899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:36.019340 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf38ba-189b-4665-8464-d2c9af51f899 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:36.029053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 432/889] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:29:35 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:36.029053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9516b-1543-43a3-b44d-dd75738610d4 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.029053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9516b-1543-43a3-b44d-dd75738610d4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.029053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9516b-1543-43a3-b44d-dd75738610d4 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.029053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 433/890] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:36.031364 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9516b-1543-43a3-b44d-dd75738610d4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:36.041710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8066117-5fa2-4b9c-b7d1-7b5b05b946cf None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:36.078622 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c1e16-7dcc-4972-b9f3-6ce191fd1ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:36.079287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c1e16-7dcc-4972-b9f3-6ce191fd1ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.079578 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c1e16-7dcc-4972-b9f3-6ce191fd1ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.079941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c1e16-7dcc-4972-b9f3-6ce191fd1ec4 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.080593 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c1e16-7dcc-4972-b9f3-6ce191fd1ec4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:36.080904 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c1e16-7dcc-4972-b9f3-6ce191fd1ec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:36.082264 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c1e16-7dcc-4972-b9f3-6ce191fd1ec4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:36.091317 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 458/891] 10.222.0.110 () {56 vars in 1120 bytes} [Thu May 26 16:29:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:36.097057 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe084f9-8a1a-4643-bde9-0edb41c94735 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.097322 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe084f9-8a1a-4643-bde9-0edb41c94735 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.097605 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe084f9-8a1a-4643-bde9-0edb41c94735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.115511 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9fe084f9-8a1a-4643-bde9-0edb41c94735 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:36.116694 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9fe084f9-8a1a-4643-bde9-0edb41c94735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:36.152298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9516b-1543-43a3-b44d-dd75738610d4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:36.202595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 459/892] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:36 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:36.202595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe084f9-8a1a-4643-bde9-0edb41c94735 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:36.205942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1def0-862b-46b7-87bd-6adb755b03c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:36.207058 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1def0-862b-46b7-87bd-6adb755b03c8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.207351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1def0-862b-46b7-87bd-6adb755b03c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.207913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1def0-862b-46b7-87bd-6adb755b03c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.208717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1def0-862b-46b7-87bd-6adb755b03c8 None admin] RBAC: Adding query filter params (interface=public, service_id=e9c61835f91e4661bedac13731368b35, region_id=RegionOne) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:36.209291 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1def0-862b-46b7-87bd-6adb755b03c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:36.211427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1def0-862b-46b7-87bd-6adb755b03c8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:36.218923 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 434/893] 10.222.0.110 () {56 vars in 1256 bytes} [Thu May 26 16:29:36 2022] GET /identity/v3/endpoints?service_id=e9c61835f91e4661bedac13731368b35&interface=public®ion_id=RegionOne => generated 195 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:36.224438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1def0-862b-46b7-87bd-6adb755b03c8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:36.240673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:36.253143 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:36.298602 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe084f9-8a1a-4643-bde9-0edb41c94735 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:36.335273 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6555e8a-b11f-4483-b327-a4d262abbbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:36.336072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6555e8a-b11f-4483-b327-a4d262abbbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.336357 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6555e8a-b11f-4483-b327-a4d262abbbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.336635 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6555e8a-b11f-4483-b327-a4d262abbbc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.345401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1def0-862b-46b7-87bd-6adb755b03c8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:36.347647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6555e8a-b11f-4483-b327-a4d262abbbc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:36.349174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6555e8a-b11f-4483-b327-a4d262abbbc2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:36.367514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-c6555e8a-b11f-4483-b327-a4d262abbbc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:36.367514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:36.367514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:36.367514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:36.367514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:36.367514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:36.367514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:36.367514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:36.367514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:36.367514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:36.367514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:36.367514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:36.367514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:36.367514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:36.367514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:36.368447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:36.368447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:36.368447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:36.368447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:36.368447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:36.368447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:36.368447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:36.368447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:36.368447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:36.368447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:36.368447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:36.368447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:36.368447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:36.368447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:36.368447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:36.368447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:36.368447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:36.369910 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:36.369910 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:36.369910 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:36.369910 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:36.369910 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 460/894] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:36.369910 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6555e8a-b11f-4483-b327-a4d262abbbc2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:36.386146 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63e9a7-c682-4e9f-879e-f1a026da2bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:36.386964 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63e9a7-c682-4e9f-879e-f1a026da2bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.387249 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63e9a7-c682-4e9f-879e-f1a026da2bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.387533 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63e9a7-c682-4e9f-879e-f1a026da2bf1 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.388214 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63e9a7-c682-4e9f-879e-f1a026da2bf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:36.389570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63e9a7-c682-4e9f-879e-f1a026da2bf1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:36.395911 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 435/895] 10.222.0.110 () {56 vars in 1092 bytes} [Thu May 26 16:29:36 2022] GET /identity/v3/services => generated 1274 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:29:36.397188 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d753f-a865-456f-ab5f-da47b95db80d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.397487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d753f-a865-456f-ab5f-da47b95db80d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.397763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d753f-a865-456f-ab5f-da47b95db80d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.399186 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 436/896] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:36.404381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d753f-a865-456f-ab5f-da47b95db80d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:36.493189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6555e8a-b11f-4483-b327-a4d262abbbc2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:36.495615 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:36.503490 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:36.525243 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d753f-a865-456f-ab5f-da47b95db80d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:36.538059 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a358d6-fc65-4622-b2d7-3473123e8b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:36.539203 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a358d6-fc65-4622-b2d7-3473123e8b4e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.539489 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a358d6-fc65-4622-b2d7-3473123e8b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.539765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a358d6-fc65-4622-b2d7-3473123e8b4e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.540631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a358d6-fc65-4622-b2d7-3473123e8b4e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:36.542467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a358d6-fc65-4622-b2d7-3473123e8b4e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:36.555780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-53a358d6-fc65-4622-b2d7-3473123e8b4e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:29:36.555780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:36.555780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:36.555780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:36.555780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:36.555780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:36.555780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:36.555780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:36.555780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:29:36.555780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:36.555780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:36.555780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:36.555780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:36.555780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:36.555780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:36.555780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:36.556833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:36.556833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:36.556833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:36.556833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:36.556833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:36.556833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:36.556833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:36.556833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:36.556833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:36.556833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:36.556833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:36.556833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:36.556833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:36.556833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:36.556833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:36.556833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:36.557662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:36.557662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:36.557662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:36.557662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:36.557662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:36.557662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:36.557662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:36.557662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:36.557662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:36.557662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:36.557662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:36.557662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:36.557662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:36.557662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:29:36.557662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:36.557662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 461/897] 10.222.0.110 () {56 vars in 1137 bytes} [Thu May 26 16:29:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:36.559227 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1744e3-ed23-4e4a-8a76-fb99dd10a75a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.559227 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1744e3-ed23-4e4a-8a76-fb99dd10a75a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.559227 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1744e3-ed23-4e4a-8a76-fb99dd10a75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.571269 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dec6e8-e5a3-4f75-bdf3-302b6c495bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:36.572039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dec6e8-e5a3-4f75-bdf3-302b6c495bbf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.572365 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dec6e8-e5a3-4f75-bdf3-302b6c495bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.572662 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dec6e8-e5a3-4f75-bdf3-302b6c495bbf None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.573392 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dec6e8-e5a3-4f75-bdf3-302b6c495bbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:36.573826 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dec6e8-e5a3-4f75-bdf3-302b6c495bbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:36.575227 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dec6e8-e5a3-4f75-bdf3-302b6c495bbf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:36.580007 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-bb1744e3-ed23-4e4a-8a76-fb99dd10a75a None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:36.581401 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bb1744e3-ed23-4e4a-8a76-fb99dd10a75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:36.590767 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 437/898] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:36.592327 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dec6e8-e5a3-4f75-bdf3-302b6c495bbf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:36.654044 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 462/899] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:36 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:36.663432 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1744e3-ed23-4e4a-8a76-fb99dd10a75a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:36.702688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dec6e8-e5a3-4f75-bdf3-302b6c495bbf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:36.741530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325379c1-52fc-49e0-b251-ecb29111b0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:36.742213 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325379c1-52fc-49e0-b251-ecb29111b0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.742508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325379c1-52fc-49e0-b251-ecb29111b0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.742814 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325379c1-52fc-49e0-b251-ecb29111b0c2 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.743527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325379c1-52fc-49e0-b251-ecb29111b0c2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:36.743836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325379c1-52fc-49e0-b251-ecb29111b0c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:36.745202 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325379c1-52fc-49e0-b251-ecb29111b0c2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:36.746320 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:36.751539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 438/900] 10.222.0.110 () {56 vars in 1131 bytes} [Thu May 26 16:29:36 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:36.752408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325379c1-52fc-49e0-b251-ecb29111b0c2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:36.779369 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:36.783675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1744e3-ed23-4e4a-8a76-fb99dd10a75a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:36.822360 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809756a-1800-4bff-9481-388c9e2099d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:36.823375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809756a-1800-4bff-9481-388c9e2099d3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.823667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809756a-1800-4bff-9481-388c9e2099d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.823945 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809756a-1800-4bff-9481-388c9e2099d3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.833256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809756a-1800-4bff-9481-388c9e2099d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:36.835152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809756a-1800-4bff-9481-388c9e2099d3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:36.854873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-9809756a-1800-4bff-9481-388c9e2099d3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:29:36.854873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:36.854873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:36.854873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:36.854873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:36.854873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:36.854873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:36.854873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:36.854873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:36.854873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:36.854873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:36.854873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:36.854873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:36.854873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:36.854873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:36.854873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:36.855839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:36.855839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:36.855839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:36.855839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:36.855839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:36.855839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:36.855839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:36.855839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:36.855839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:36.855839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:36.855839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:36.855839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:36.855839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:36.855839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:36.855839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:36.855839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:36.855839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:36.855839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:36.857244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:36.857244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:36.857244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:36.857244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:36.857244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:36.857244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:36.857244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:36.857244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:36.857244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:29:36.857244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:36.857244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 463/901] 10.222.0.110 () {56 vars in 1122 bytes} [Thu May 26 16:29:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:36.858018 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809756a-1800-4bff-9481-388c9e2099d3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:36.861707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325379c1-52fc-49e0-b251-ecb29111b0c2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:36.897049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebd6cf-69b5-43f5-a15f-7935efdd63e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:36.897723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebd6cf-69b5-43f5-a15f-7935efdd63e4 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.898012 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebd6cf-69b5-43f5-a15f-7935efdd63e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.898288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebd6cf-69b5-43f5-a15f-7935efdd63e4 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.899038 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebd6cf-69b5-43f5-a15f-7935efdd63e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:36.900407 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebd6cf-69b5-43f5-a15f-7935efdd63e4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:36.914284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 439/902] 10.222.0.110 () {60 vars in 1146 bytes} [Thu May 26 16:29:36 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:29:36.915043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebd6cf-69b5-43f5-a15f-7935efdd63e4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:36.989257 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809756a-1800-4bff-9481-388c9e2099d3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:37.004268 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:37.040379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3fb55-32c9-45b3-8cf2-e6b0ff17c7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:37.041113 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3fb55-32c9-45b3-8cf2-e6b0ff17c7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:37.041402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3fb55-32c9-45b3-8cf2-e6b0ff17c7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:37.041677 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3fb55-32c9-45b3-8cf2-e6b0ff17c7a1 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:37.042389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3fb55-32c9-45b3-8cf2-e6b0ff17c7a1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:37.042730 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3fb55-32c9-45b3-8cf2-e6b0ff17c7a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:37.044120 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3fb55-32c9-45b3-8cf2-e6b0ff17c7a1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:37.052663 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 464/903] 10.222.0.110 () {56 vars in 1131 bytes} [Thu May 26 16:29:36 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:37.058101 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3fb55-32c9-45b3-8cf2-e6b0ff17c7a1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:37.073167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebd6cf-69b5-43f5-a15f-7935efdd63e4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:37.083777 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:37.129273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e2a6d-2edb-4381-b38a-fa2d54b959e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:37.130053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e2a6d-2edb-4381-b38a-fa2d54b959e4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:37.130678 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e2a6d-2edb-4381-b38a-fa2d54b959e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:37.130905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e2a6d-2edb-4381-b38a-fa2d54b959e4 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:37.132174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e2a6d-2edb-4381-b38a-fa2d54b959e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:37.132624 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e2a6d-2edb-4381-b38a-fa2d54b959e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:37.134213 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e2a6d-2edb-4381-b38a-fa2d54b959e4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:37.160711 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 440/904] 10.222.0.110 () {56 vars in 1154 bytes} [Thu May 26 16:29:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:37.167285 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e2a6d-2edb-4381-b38a-fa2d54b959e4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:37.179316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3fb55-32c9-45b3-8cf2-e6b0ff17c7a1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:37.235071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448c8bd-f18e-4812-b4fe-95179901163c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:37.236022 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448c8bd-f18e-4812-b4fe-95179901163c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:37.236313 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448c8bd-f18e-4812-b4fe-95179901163c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:37.236891 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448c8bd-f18e-4812-b4fe-95179901163c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:37.238126 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448c8bd-f18e-4812-b4fe-95179901163c None admin] RBAC: Adding query filter params (interface=public, service_id=027777031dc0407e8affec72eadaed1b, region_id=RegionOne) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:37.238597 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448c8bd-f18e-4812-b4fe-95179901163c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:37.240371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448c8bd-f18e-4812-b4fe-95179901163c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:37.248434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 465/905] 10.222.0.110 () {56 vars in 1256 bytes} [Thu May 26 16:29:37 2022] GET /identity/v3/endpoints?service_id=027777031dc0407e8affec72eadaed1b&interface=public®ion_id=RegionOne => generated 195 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:37.255584 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448c8bd-f18e-4812-b4fe-95179901163c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:37.292428 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e2a6d-2edb-4381-b38a-fa2d54b959e4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:37.314859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:37.338740 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80f73a-9bd2-46a9-ad2d-0105470d85cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:37.339819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80f73a-9bd2-46a9-ad2d-0105470d85cf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:37.340369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80f73a-9bd2-46a9-ad2d-0105470d85cf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:37.340663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80f73a-9bd2-46a9-ad2d-0105470d85cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:37.346765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:37.375721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448c8bd-f18e-4812-b4fe-95179901163c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:37.414894 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953dcc3-d239-448d-a6de-83c2272224db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:37.415798 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953dcc3-d239-448d-a6de-83c2272224db None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:37.416310 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953dcc3-d239-448d-a6de-83c2272224db None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:37.416731 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953dcc3-d239-448d-a6de-83c2272224db None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:37.417732 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953dcc3-d239-448d-a6de-83c2272224db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:37.419396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953dcc3-d239-448d-a6de-83c2272224db None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:37.430645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80f73a-9bd2-46a9-ad2d-0105470d85cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:37.430645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80f73a-9bd2-46a9-ad2d-0105470d85cf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:37.431239 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 466/906] 10.222.0.110 () {56 vars in 1092 bytes} [Thu May 26 16:29:37 2022] GET /identity/v3/services => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:29:37.544043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 441/907] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:29:37 2022] GET /identity/v3/auth/tokens => generated 1466 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:29:37.550250 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953dcc3-d239-448d-a6de-83c2272224db None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:37.663998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953dcc3-d239-448d-a6de-83c2272224db None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:37.701105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc2bf9-c252-4400-b851-c68c43624554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:37.701825 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc2bf9-c252-4400-b851-c68c43624554 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:37.702111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc2bf9-c252-4400-b851-c68c43624554 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:37.702385 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc2bf9-c252-4400-b851-c68c43624554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:37.713379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc2bf9-c252-4400-b851-c68c43624554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:37.714852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc2bf9-c252-4400-b851-c68c43624554 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:37.723821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:37.733735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-64cc2bf9-c252-4400-b851-c68c43624554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:37.733735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:37.733735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:37.733735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:37.733735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:37.733735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:37.733735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:37.733735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:37.733735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:37.733735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:37.733735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:37.733735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:37.733735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:37.733735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:37.733735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:37.735152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:37.735152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:37.735152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:37.735152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:37.735152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:37.735152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:37.735152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:37.735152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:37.735152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:37.735152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:37.735152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:37.735152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:37.735152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:37.735152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:37.735152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:37.735152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:37.735152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:37.736049 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:37.736049 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:37.736049 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:37.736049 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:37.736049 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 467/908] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:37.741538 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80f73a-9bd2-46a9-ad2d-0105470d85cf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:37.760059 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:37.850822 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80f73a-9bd2-46a9-ad2d-0105470d85cf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:37.886507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cf981-7b40-4c74-bd53-713438ec19be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:37.887206 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cf981-7b40-4c74-bd53-713438ec19be None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:37.887491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cf981-7b40-4c74-bd53-713438ec19be None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:37.887769 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cf981-7b40-4c74-bd53-713438ec19be None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:37.888485 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cf981-7b40-4c74-bd53-713438ec19be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:37.888796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cf981-7b40-4c74-bd53-713438ec19be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:37.890154 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cf981-7b40-4c74-bd53-713438ec19be None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:37.902388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 442/909] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:37.907710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc2bf9-c252-4400-b851-c68c43624554 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:38.016178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc2bf9-c252-4400-b851-c68c43624554 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:38.051165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d35ccf-bd07-4cf9-b102-598fa9ad70f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:38.052068 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d35ccf-bd07-4cf9-b102-598fa9ad70f3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:38.052355 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d35ccf-bd07-4cf9-b102-598fa9ad70f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:38.052631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d35ccf-bd07-4cf9-b102-598fa9ad70f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:38.059849 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d35ccf-bd07-4cf9-b102-598fa9ad70f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:38.061313 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d35ccf-bd07-4cf9-b102-598fa9ad70f3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:38.075983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-a9d35ccf-bd07-4cf9-b102-598fa9ad70f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:38.075983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:38.075983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:38.075983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:38.075983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:38.075983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:38.075983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:38.075983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:38.075983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:38.075983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:38.075983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:38.075983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:38.075983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:38.075983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:38.075983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:38.078048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:38.078048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:38.078048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:38.078048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:38.078048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:38.078048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:38.078048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:38.078048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:38.078048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:38.078048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:38.078048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:38.078048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:38.078048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:38.078048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:38.078048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:38.078048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:38.078048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:38.080326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:38.080326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:38.080326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:38.080326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:38.080326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:38.080326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:38.080326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:38.080326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:38.080326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 468/910] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:38.083198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cf981-7b40-4c74-bd53-713438ec19be None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:38.170355 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:38.197841 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cf981-7b40-4c74-bd53-713438ec19be None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:38.233191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1252a-48fb-4900-ad07-f90ae963545d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:38.233859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1252a-48fb-4900-ad07-f90ae963545d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:38.234141 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1252a-48fb-4900-ad07-f90ae963545d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:38.234440 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1252a-48fb-4900-ad07-f90ae963545d None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:38.235282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1252a-48fb-4900-ad07-f90ae963545d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:38.235589 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1252a-48fb-4900-ad07-f90ae963545d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:38.237013 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1252a-48fb-4900-ad07-f90ae963545d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:38.249972 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 443/911] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:38.256611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d35ccf-bd07-4cf9-b102-598fa9ad70f3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:38.317412 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:38.369853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d35ccf-bd07-4cf9-b102-598fa9ad70f3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:38.405338 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb493a7-125c-4348-a149-9cae8936abb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:38.406500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb493a7-125c-4348-a149-9cae8936abb7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:38.407025 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb493a7-125c-4348-a149-9cae8936abb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:38.407530 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb493a7-125c-4348-a149-9cae8936abb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:38.408557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb493a7-125c-4348-a149-9cae8936abb7 None admin] RBAC: Adding query filter params (role.id=46e323c1a7614208aaaa8a31c9186f4a, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=ebf3257328b94092b544cb0dadb789c3) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:38.409073 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb493a7-125c-4348-a149-9cae8936abb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:38.410723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb493a7-125c-4348-a149-9cae8936abb7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:38.416908 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 469/912] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:29:38 2022] GET /identity/v3/role_assignments?user.id=ebf3257328b94092b544cb0dadb789c3&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=46e323c1a7614208aaaa8a31c9186f4a => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:38.682350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb8df0-1e03-4f14-8e17-67aef10af31b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:38.682874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb8df0-1e03-4f14-8e17-67aef10af31b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:38.682874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb8df0-1e03-4f14-8e17-67aef10af31b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:38.684523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 444/913] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:38.691164 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a047a-746e-45f7-afc3-ba77f1d126cf None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:38.691733 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a047a-746e-45f7-afc3-ba77f1d126cf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:38.691733 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a047a-746e-45f7-afc3-ba77f1d126cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:38.709840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-785a047a-746e-45f7-afc3-ba77f1d126cf None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:38.711071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-785a047a-746e-45f7-afc3-ba77f1d126cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:38.783417 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 470/914] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:38 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:38.806088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb8df0-1e03-4f14-8e17-67aef10af31b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:38.912490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb8df0-1e03-4f14-8e17-67aef10af31b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:38.947200 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dd2b6-3d8d-455f-9dd1-2a72dad6e967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:38.947924 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dd2b6-3d8d-455f-9dd1-2a72dad6e967 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:38.948204 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dd2b6-3d8d-455f-9dd1-2a72dad6e967 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:38.948478 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dd2b6-3d8d-455f-9dd1-2a72dad6e967 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:38.949124 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367dd2b6-3d8d-455f-9dd1-2a72dad6e967 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:38.950475 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367dd2b6-3d8d-455f-9dd1-2a72dad6e967 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:38.953353 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:38.963999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-367dd2b6-3d8d-455f-9dd1-2a72dad6e967 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:29:38.963999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:38.963999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:38.963999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:38.963999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:38.963999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:38.963999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:38.963999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:38.963999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:29:38.963999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:38.963999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:38.963999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:38.963999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:38.963999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:38.963999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:38.963999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:38.963999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:38.965240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:38.965240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:38.965240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:38.965240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:38.965240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:38.965240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:38.965240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:38.965240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:38.965240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:38.965240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:38.965240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:38.965240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:38.965240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:38.965240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:38.965240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:38.965240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:38.966298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:38.966298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:38.966298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:38.966298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:38.966298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:38.966298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:38.966298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:38.966298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:38.966298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:38.966298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:38.966298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:38.966298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:38.966298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:29:38.966298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:38.969956 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 445/915] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:29:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:38.976317 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a047a-746e-45f7-afc3-ba77f1d126cf None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:39.038970 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:39.083442 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a047a-746e-45f7-afc3-ba77f1d126cf None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:39.119868 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f253d-46e8-4f1f-8baf-7cf993510028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:39.120548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f253d-46e8-4f1f-8baf-7cf993510028 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:39.120829 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f253d-46e8-4f1f-8baf-7cf993510028 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:39.121108 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f253d-46e8-4f1f-8baf-7cf993510028 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:39.121819 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f253d-46e8-4f1f-8baf-7cf993510028 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:39.122131 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f253d-46e8-4f1f-8baf-7cf993510028 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:39.123793 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f253d-46e8-4f1f-8baf-7cf993510028 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:39.129291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 471/916] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:29:38 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:39.134982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dd2b6-3d8d-455f-9dd1-2a72dad6e967 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:39.241560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dd2b6-3d8d-455f-9dd1-2a72dad6e967 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:39.279929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c95a10-a94a-4b2c-9f6a-3fd7a93efc3d None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:39.280243 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c95a10-a94a-4b2c-9f6a-3fd7a93efc3d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:39.280486 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c95a10-a94a-4b2c-9f6a-3fd7a93efc3d None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:39.282082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 472/917] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:29:39.283155 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b73e9c-421b-4220-8552-4db11ce200e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:39.283824 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b73e9c-421b-4220-8552-4db11ce200e2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:39.284104 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b73e9c-421b-4220-8552-4db11ce200e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:39.284377 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b73e9c-421b-4220-8552-4db11ce200e2 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:39.285078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b73e9c-421b-4220-8552-4db11ce200e2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:39.285383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b73e9c-421b-4220-8552-4db11ce200e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:39.286760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b73e9c-421b-4220-8552-4db11ce200e2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:39.289062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4aae4-d113-4276-8af7-7e1b53785a8f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:39.289587 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4aae4-d113-4276-8af7-7e1b53785a8f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:39.290071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4aae4-d113-4276-8af7-7e1b53785a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:39.294620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 446/918] 10.222.0.110 () {56 vars in 1119 bytes} [Thu May 26 16:29:39 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:39.298283 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b73e9c-421b-4220-8552-4db11ce200e2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:39.312710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-74c4aae4-d113-4276-8af7-7e1b53785a8f None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:39.314398 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-74c4aae4-d113-4276-8af7-7e1b53785a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:39.366885 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:39.410754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 473/919] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:39 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:29:39.417355 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b73e9c-421b-4220-8552-4db11ce200e2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:39.432007 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4aae4-d113-4276-8af7-7e1b53785a8f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:39.456830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d6545-4bc0-4b53-a4fe-cb03d887bb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:39.457774 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d6545-4bc0-4b53-a4fe-cb03d887bb2f None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:39.458265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d6545-4bc0-4b53-a4fe-cb03d887bb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:39.458674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d6545-4bc0-4b53-a4fe-cb03d887bb2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:39.459531 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d6545-4bc0-4b53-a4fe-cb03d887bb2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:39.461124 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d6545-4bc0-4b53-a4fe-cb03d887bb2f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:39.482605 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 447/920] 10.222.0.110 () {60 vars in 1149 bytes} [Thu May 26 16:29:39 2022] POST /identity/v3/endpoints => generated 348 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:29:39.492996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:39.554051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4aae4-d113-4276-8af7-7e1b53785a8f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:39.603198 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4e4f4-3d7f-4c47-8236-290dfdb497c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:39.604027 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4e4f4-3d7f-4c47-8236-290dfdb497c7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:39.604308 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4e4f4-3d7f-4c47-8236-290dfdb497c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:39.604637 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4e4f4-3d7f-4c47-8236-290dfdb497c7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:39.605297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4e4f4-3d7f-4c47-8236-290dfdb497c7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:39.606704 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4e4f4-3d7f-4c47-8236-290dfdb497c7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:39.619848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-1de4e4f4-3d7f-4c47-8236-290dfdb497c7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:29:39.619848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:39.619848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:39.619848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:39.619848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:39.619848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:39.619848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:39.619848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:39.619848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:29:39.619848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:39.619848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:39.619848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:39.619848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:39.619848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:39.619848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:39.619848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:39.619848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:39.620942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:39.620942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:39.620942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:39.620942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:39.620942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:39.620942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:39.620942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:39.620942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:39.620942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:39.620942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:39.620942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:39.620942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:39.620942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:39.620942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:39.620942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:39.620942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:39.622477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:39.622477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:39.622477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:39.622477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:39.622477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:39.622477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:39.622477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:39.622477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:39.622477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:39.622477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:39.622477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:39.622477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:39.622477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:29:39.622477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:39.622477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 474/921] 10.222.0.110 () {56 vars in 1131 bytes} [Thu May 26 16:29:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:39.628538 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d6545-4bc0-4b53-a4fe-cb03d887bb2f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:39.744469 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d6545-4bc0-4b53-a4fe-cb03d887bb2f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:39.766458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:39.784109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330ca53-3422-426a-be64-67c554e94a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:39.784785 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330ca53-3422-426a-be64-67c554e94a56 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:39.785070 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330ca53-3422-426a-be64-67c554e94a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:39.785351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330ca53-3422-426a-be64-67c554e94a56 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:39.786055 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330ca53-3422-426a-be64-67c554e94a56 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:39.786362 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330ca53-3422-426a-be64-67c554e94a56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:39.787749 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330ca53-3422-426a-be64-67c554e94a56 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:39.793048 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 448/922] 10.222.0.110 () {56 vars in 1127 bytes} [Thu May 26 16:29:39 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:39.799377 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4e4f4-3d7f-4c47-8236-290dfdb497c7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:39.853802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e099fd-94c8-4173-81d3-dd418423c028 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:39.854112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e099fd-94c8-4173-81d3-dd418423c028 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:39.854372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e099fd-94c8-4173-81d3-dd418423c028 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:39.856164 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 449/923] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:29:39.862242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15b611-7eb5-4705-8232-9b3162513a4b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:39.862534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15b611-7eb5-4705-8232-9b3162513a4b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:39.863005 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15b611-7eb5-4705-8232-9b3162513a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:39.882776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-db15b611-7eb5-4705-8232-9b3162513a4b None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:39.884437 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-db15b611-7eb5-4705-8232-9b3162513a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:39.908414 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4e4f4-3d7f-4c47-8236-290dfdb497c7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:39.918015 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:39.945221 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e07df1-dc54-4dbd-a3fa-8eba2d1200c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:39.946198 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e07df1-dc54-4dbd-a3fa-8eba2d1200c9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:39.946313 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e07df1-dc54-4dbd-a3fa-8eba2d1200c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:39.946677 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e07df1-dc54-4dbd-a3fa-8eba2d1200c9 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:39.947399 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e07df1-dc54-4dbd-a3fa-8eba2d1200c9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:39.947747 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e07df1-dc54-4dbd-a3fa-8eba2d1200c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:39.949117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e07df1-dc54-4dbd-a3fa-8eba2d1200c9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:39.956759 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 475/924] 10.222.0.110 () {56 vars in 1127 bytes} [Thu May 26 16:29:39 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:39.962696 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e07df1-dc54-4dbd-a3fa-8eba2d1200c9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:39.964839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 450/925] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:39 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:39.988271 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15b611-7eb5-4705-8232-9b3162513a4b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:40.095790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15b611-7eb5-4705-8232-9b3162513a4b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:40.097788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e07df1-dc54-4dbd-a3fa-8eba2d1200c9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:40.127065 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:40.135497 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a9aaf-a294-4280-a8bc-c10c571c495c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:40.136286 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a9aaf-a294-4280-a8bc-c10c571c495c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:40.136709 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a9aaf-a294-4280-a8bc-c10c571c495c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:40.136990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a9aaf-a294-4280-a8bc-c10c571c495c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:40.137855 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a9aaf-a294-4280-a8bc-c10c571c495c None admin] RBAC: Adding query filter params (interface=public, service_id=3cf5b33d942c44fca311da08c1509417, region_id=RegionOne) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:40.138250 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a9aaf-a294-4280-a8bc-c10c571c495c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:40.139728 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a9aaf-a294-4280-a8bc-c10c571c495c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:40.141524 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537ac6f-8602-4634-a1f7-9f78397908df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:40.142768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537ac6f-8602-4634-a1f7-9f78397908df None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:40.143646 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537ac6f-8602-4634-a1f7-9f78397908df None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:40.144114 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537ac6f-8602-4634-a1f7-9f78397908df None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:40.145329 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537ac6f-8602-4634-a1f7-9f78397908df None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:40.146555 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 476/926] 10.222.0.110 () {56 vars in 1256 bytes} [Thu May 26 16:29:39 2022] GET /identity/v3/endpoints?service_id=3cf5b33d942c44fca311da08c1509417&interface=public®ion_id=RegionOne => generated 195 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:40.147327 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537ac6f-8602-4634-a1f7-9f78397908df None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:40.151575 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a9aaf-a294-4280-a8bc-c10c571c495c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:40.162489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-2537ac6f-8602-4634-a1f7-9f78397908df None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:29:40.162489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:40.162489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:40.162489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:40.162489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:40.162489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:40.162489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:40.162489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:40.162489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:29:40.162489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:40.162489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:40.162489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:40.162489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:40.162489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:40.162489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:40.162489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:40.163490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:40.163490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:40.163490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:40.163490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:40.163490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:40.163490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:40.163490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:40.163490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:40.163490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:40.163490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:40.163490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:40.163490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:40.163490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:40.163490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:40.163490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:40.163490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:40.164325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:40.164325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:40.164325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:40.164325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:40.164325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:40.164325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:40.164325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:40.164325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:40.164325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:40.164325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:40.164325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:40.164325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:40.164325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:40.164325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:29:40.164325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:40.166806 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 451/927] 10.222.0.110 () {56 vars in 1137 bytes} [Thu May 26 16:29:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:40.172476 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537ac6f-8602-4634-a1f7-9f78397908df None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:40.196879 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:40.275949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a9aaf-a294-4280-a8bc-c10c571c495c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:40.308271 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537ac6f-8602-4634-a1f7-9f78397908df None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:40.313172 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2899b-75a0-47b6-93b9-e9f2e94a884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:40.313847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2899b-75a0-47b6-93b9-e9f2e94a884c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:40.314135 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2899b-75a0-47b6-93b9-e9f2e94a884c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:40.314414 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2899b-75a0-47b6-93b9-e9f2e94a884c None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:40.315150 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2899b-75a0-47b6-93b9-e9f2e94a884c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:40.316535 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2899b-75a0-47b6-93b9-e9f2e94a884c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:40.323402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 477/928] 10.222.0.110 () {56 vars in 1092 bytes} [Thu May 26 16:29:40 2022] GET /identity/v3/services => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:29:40.354007 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a27e6-8c10-4f63-b440-5d48926755ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:40.354643 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a27e6-8c10-4f63-b440-5d48926755ee None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:40.354941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a27e6-8c10-4f63-b440-5d48926755ee None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:40.355219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a27e6-8c10-4f63-b440-5d48926755ee None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:40.356015 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a27e6-8c10-4f63-b440-5d48926755ee None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:40.356333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a27e6-8c10-4f63-b440-5d48926755ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:40.357942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a27e6-8c10-4f63-b440-5d48926755ee None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:40.364062 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 452/929] 10.222.0.110 () {56 vars in 1131 bytes} [Thu May 26 16:29:40 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:40.369899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2899b-75a0-47b6-93b9-e9f2e94a884c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:40.487347 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:40.491462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2899b-75a0-47b6-93b9-e9f2e94a884c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:40.533854 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae945a-a58c-4ffe-a2a0-ed5bb8a722eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:40.534529 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae945a-a58c-4ffe-a2a0-ed5bb8a722eb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:40.534853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae945a-a58c-4ffe-a2a0-ed5bb8a722eb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:40.535130 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae945a-a58c-4ffe-a2a0-ed5bb8a722eb None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:40.535837 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae945a-a58c-4ffe-a2a0-ed5bb8a722eb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:40.536144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae945a-a58c-4ffe-a2a0-ed5bb8a722eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:40.537514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae945a-a58c-4ffe-a2a0-ed5bb8a722eb None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:40.543056 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 478/930] 10.222.0.110 () {56 vars in 1131 bytes} [Thu May 26 16:29:40 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:40.549022 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a27e6-8c10-4f63-b440-5d48926755ee None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:40.594443 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:40.654727 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a27e6-8c10-4f63-b440-5d48926755ee None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:40.690850 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2f999-0218-40a0-b885-8bc0f67f3f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:40.691520 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2f999-0218-40a0-b885-8bc0f67f3f56 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:40.691807 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2f999-0218-40a0-b885-8bc0f67f3f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:40.692084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2f999-0218-40a0-b885-8bc0f67f3f56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:40.692845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2f999-0218-40a0-b885-8bc0f67f3f56 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:40.694215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2f999-0218-40a0-b885-8bc0f67f3f56 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:40.702536 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254aa007-8ffe-4f24-a5e0-37eae9adebe0 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:40.702871 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254aa007-8ffe-4f24-a5e0-37eae9adebe0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:40.703194 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254aa007-8ffe-4f24-a5e0-37eae9adebe0 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:40.704851 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 479/931] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:29:40.710824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97587137-d615-4f42-b8de-f327901d92d6 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:40.711119 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97587137-d615-4f42-b8de-f327901d92d6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:40.711401 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97587137-d615-4f42-b8de-f327901d92d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:40.713901 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 453/932] 10.222.0.110 () {60 vars in 1149 bytes} [Thu May 26 16:29:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:29:40.729617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-97587137-d615-4f42-b8de-f327901d92d6 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:40.730905 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-97587137-d615-4f42-b8de-f327901d92d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:40.824039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 480/933] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:40 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:29:40.848120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2f999-0218-40a0-b885-8bc0f67f3f56 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:40.959267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:40.963565 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2f999-0218-40a0-b885-8bc0f67f3f56 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:40.999335 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf9685-e07e-4836-a4cb-e8632d9b44c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:41.000835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf9685-e07e-4836-a4cb-e8632d9b44c3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:41.001338 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf9685-e07e-4836-a4cb-e8632d9b44c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:41.001635 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf9685-e07e-4836-a4cb-e8632d9b44c3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:41.012204 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf9685-e07e-4836-a4cb-e8632d9b44c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:41.020830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-19bf9685-e07e-4836-a4cb-e8632d9b44c3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:29:41.020830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:41.020830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:41.020830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:41.020830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:41.020830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:41.020830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:41.020830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:41.020830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:41.020830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:41.020830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:41.020830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:41.020830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:41.020830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:41.020830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:41.020830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:41.021731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:41.021731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:41.021731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:41.021731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:41.021731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:41.021731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:41.021731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:41.021731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:41.021731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:41.021731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:41.021731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:41.021731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:41.021731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:41.021731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:41.021731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:41.021731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:41.022539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:41.022539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:41.022539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:41.022539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:41.022539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:41.022539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:41.022539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:41.022539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:41.022539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:41.022539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:41.022539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:29:41.022539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:41.022539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 454/934] 10.222.0.110 () {56 vars in 1125 bytes} [Thu May 26 16:29:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:41.028131 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97587137-d615-4f42-b8de-f327901d92d6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:41.126437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:41.137748 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97587137-d615-4f42-b8de-f327901d92d6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:41.173995 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7249e-c7da-44e3-ba5c-93b1a1c70d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:41.174713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7249e-c7da-44e3-ba5c-93b1a1c70d11 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:41.175002 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7249e-c7da-44e3-ba5c-93b1a1c70d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:41.175282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7249e-c7da-44e3-ba5c-93b1a1c70d11 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:41.176042 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7249e-c7da-44e3-ba5c-93b1a1c70d11 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:41.176354 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7249e-c7da-44e3-ba5c-93b1a1c70d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:41.177727 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7249e-c7da-44e3-ba5c-93b1a1c70d11 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:41.190684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 481/935] 10.222.0.110 () {56 vars in 1120 bytes} [Thu May 26 16:29:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:41.192862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf9685-e07e-4836-a4cb-e8632d9b44c3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:41.298717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf9685-e07e-4836-a4cb-e8632d9b44c3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:41.333412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee7b87-f69d-440f-8bf4-9f22b5e41666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:41.334219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee7b87-f69d-440f-8bf4-9f22b5e41666 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:41.334496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee7b87-f69d-440f-8bf4-9f22b5e41666 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:41.334809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee7b87-f69d-440f-8bf4-9f22b5e41666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:41.345935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee7b87-f69d-440f-8bf4-9f22b5e41666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:41.347397 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee7b87-f69d-440f-8bf4-9f22b5e41666 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:41.365387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-deee7b87-f69d-440f-8bf4-9f22b5e41666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:41.365387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:41.365387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:41.365387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:41.365387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:41.365387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:41.365387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:41.365387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:41.365387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:41.365387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:41.365387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:41.365387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:41.365387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:41.365387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:41.365387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:41.366279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:41.366279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:41.366279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:41.366279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:41.366279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:41.366279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:41.366279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:41.366279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:41.366279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:41.366279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:41.366279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:41.366279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:41.366279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:41.366279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:41.366279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:41.366279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:41.366279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:41.367183 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:41.367183 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:41.367183 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:41.367183 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:41.367183 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 455/936] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:41.378849 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7249e-c7da-44e3-ba5c-93b1a1c70d11 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:41.486729 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7249e-c7da-44e3-ba5c-93b1a1c70d11 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:41.524543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e0b90-d10d-48dc-8822-21004b702a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:41.525679 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e0b90-d10d-48dc-8822-21004b702a99 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:41.526161 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e0b90-d10d-48dc-8822-21004b702a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:41.526665 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e0b90-d10d-48dc-8822-21004b702a99 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:41.527622 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e0b90-d10d-48dc-8822-21004b702a99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:41.528124 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e0b90-d10d-48dc-8822-21004b702a99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:41.529695 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e0b90-d10d-48dc-8822-21004b702a99 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:41.543381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 482/937] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:41.552024 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee7b87-f69d-440f-8bf4-9f22b5e41666 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:41.565805 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:41.656826 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee7b87-f69d-440f-8bf4-9f22b5e41666 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:41.692073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641344f-2b90-4bdf-af77-abefec769be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:41.692908 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641344f-2b90-4bdf-af77-abefec769be0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:41.693189 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641344f-2b90-4bdf-af77-abefec769be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:41.693463 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641344f-2b90-4bdf-af77-abefec769be0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:41.701151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641344f-2b90-4bdf-af77-abefec769be0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:41.702605 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641344f-2b90-4bdf-af77-abefec769be0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:41.717399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-9641344f-2b90-4bdf-af77-abefec769be0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:29:41.717399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:41.717399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:41.717399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:41.717399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:41.717399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:41.717399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:41.717399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:41.717399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:41.717399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:41.717399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:41.717399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:41.717399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:41.717399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:41.717399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:41.717399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:41.718983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:41.718983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:41.718983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:41.718983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:41.718983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:41.718983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:41.718983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:41.718983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:41.718983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:41.718983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:41.718983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:41.718983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:41.718983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:41.718983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:41.718983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:41.718983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:41.718983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:41.718983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:41.719940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:41.719940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:41.719940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:41.719940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:41.719940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:41.719940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:41.719940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:41.719940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:41.719940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:29:41.719940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:41.719940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 456/938] 10.222.0.110 () {56 vars in 1122 bytes} [Thu May 26 16:29:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:41.724817 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e0b90-d10d-48dc-8822-21004b702a99 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:41.739999 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:41.831613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e0b90-d10d-48dc-8822-21004b702a99 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:41.866031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded0f5e-d2a5-4137-92d2-6b9f17e15b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:41.866727 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded0f5e-d2a5-4137-92d2-6b9f17e15b18 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:41.867012 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded0f5e-d2a5-4137-92d2-6b9f17e15b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:41.867290 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded0f5e-d2a5-4137-92d2-6b9f17e15b18 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:41.868120 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded0f5e-d2a5-4137-92d2-6b9f17e15b18 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:41.868429 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded0f5e-d2a5-4137-92d2-6b9f17e15b18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:41.869857 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded0f5e-d2a5-4137-92d2-6b9f17e15b18 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:41.890544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 483/939] 10.222.0.110 () {56 vars in 1154 bytes} [Thu May 26 16:29:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:41.895907 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641344f-2b90-4bdf-af77-abefec769be0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:41.970246 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2da84-6de6-4f32-819d-e8598f74ace2 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:41.970900 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2da84-6de6-4f32-819d-e8598f74ace2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:41.971407 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2da84-6de6-4f32-819d-e8598f74ace2 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:41.972592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:41.973558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 484/940] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:41 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:41.979305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a1a54-b0e9-4c76-9d54-9842bc808449 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:41.979879 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a1a54-b0e9-4c76-9d54-9842bc808449 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:41.980363 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a1a54-b0e9-4c76-9d54-9842bc808449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.001433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fb2a1a54-b0e9-4c76-9d54-9842bc808449 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:42.003653 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fb2a1a54-b0e9-4c76-9d54-9842bc808449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:42.005334 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641344f-2b90-4bdf-af77-abefec769be0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:42.044479 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef5191-6c89-4e70-9ed2-4632d6443d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:42.045349 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef5191-6c89-4e70-9ed2-4632d6443d65 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.045617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef5191-6c89-4e70-9ed2-4632d6443d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.045910 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef5191-6c89-4e70-9ed2-4632d6443d65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.058284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef5191-6c89-4e70-9ed2-4632d6443d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:42.059842 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef5191-6c89-4e70-9ed2-4632d6443d65 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:42.080254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c1ef5191-6c89-4e70-9ed2-4632d6443d65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:42.080254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:42.080254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:42.080254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:42.080254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:42.080254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:42.080254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:42.080254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:42.080254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:42.080254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:42.080254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:42.080254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:42.080254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:42.080254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:42.080254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:42.081211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:42.081211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:42.081211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:42.081211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:42.081211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:42.081211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:42.081211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:42.081211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:42.081211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:42.081211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:42.081211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:42.081211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:42.081211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:42.081211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:42.081211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:42.081211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:42.081211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:42.082140 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:42.082140 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:42.082140 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:42.082140 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:42.082140 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 457/941] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:42.087309 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef5191-6c89-4e70-9ed2-4632d6443d65 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:42.088601 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:42.102982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 485/942] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:41 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:29:42.123839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a1a54-b0e9-4c76-9d54-9842bc808449 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:42.213049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef5191-6c89-4e70-9ed2-4632d6443d65 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:42.229784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a1a54-b0e9-4c76-9d54-9842bc808449 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:42.238891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:42.253237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bae47d-03ad-4151-8ff5-59188e52e897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:42.254332 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bae47d-03ad-4151-8ff5-59188e52e897 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.254946 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bae47d-03ad-4151-8ff5-59188e52e897 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.255428 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bae47d-03ad-4151-8ff5-59188e52e897 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.256346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bae47d-03ad-4151-8ff5-59188e52e897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:42.256973 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bae47d-03ad-4151-8ff5-59188e52e897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:42.258667 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bae47d-03ad-4151-8ff5-59188e52e897 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:42.266233 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a0a5d-18b6-45d8-afcf-d45bd04fa9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:42.266954 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a0a5d-18b6-45d8-afcf-d45bd04fa9d5 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.267911 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a0a5d-18b6-45d8-afcf-d45bd04fa9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.267911 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a0a5d-18b6-45d8-afcf-d45bd04fa9d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.269036 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a0a5d-18b6-45d8-afcf-d45bd04fa9d5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:42.270472 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a0a5d-18b6-45d8-afcf-d45bd04fa9d5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:42.272805 dv-cinder-836072-5-smb devstack@keystone.service[80420]: WARNING keystone.server.flask.common [None req-826a0a5d-18b6-45d8-afcf-d45bd04fa9d5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 16:29:42.274210 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 458/943] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:42.279623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bae47d-03ad-4151-8ff5-59188e52e897 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:42.291780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.sql.core [None req-826a0a5d-18b6-45d8-afcf-d45bd04fa9d5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 16:29:42.291780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 16:29:42.291780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [parameters: {'id': '34a78741b4c84e0d89847a3a134fbb2e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 16:29:42.291780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80420) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 16:29:42.300675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-826a0a5d-18b6-45d8-afcf-d45bd04fa9d5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 34a78741b4c84e0d89847a3a134fbb2e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 34a78741b4c84e0d89847a3a134fbb2e. May 26 16:29:42.300675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:42.300675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:29:42.300675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:29:42.300675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:29:42.300675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:29:42.300675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:29:42.300675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:29:42.300675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:29:42.300675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application conn.query(q) May 26 16:29:42.300675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:29:42.300675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:29:42.300675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:29:42.301548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result.read() May 26 16:29:42.301548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:29:42.301548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:29:42.301548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:29:42.301548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:29:42.301548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:29:42.301548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:29:42.301548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:29:42.301548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:29:42.301548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 16:29:42.301548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:42.301548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 16:29:42.301548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:42.301548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:42.301548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 16:29:42.301548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 16:29:42.301548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 16:29:42.301548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 16:29:42.302522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:29:42.302522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application next(self.gen) May 26 16:29:42.302522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 16:29:42.302522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application yield resource May 26 16:29:42.302522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:29:42.302522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application next(self.gen) May 26 16:29:42.302522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 16:29:42.302522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.session.rollback() May 26 16:29:42.302522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 16:29:42.302522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.force_reraise() May 26 16:29:42.302522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 16:29:42.302522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise self.value May 26 16:29:42.302522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 16:29:42.302522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 16:29:42.302522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 16:29:42.302522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application session.commit() May 26 16:29:42.302522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 16:29:42.303460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 16:29:42.303460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 16:29:42.303460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._prepare_impl() May 26 16:29:42.303460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 16:29:42.303460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.session.flush() May 26 16:29:42.303460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 16:29:42.303460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._flush(objects) May 26 16:29:42.303460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 16:29:42.303460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 16:29:42.303460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 16:29:42.303460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application compat.raise_( May 26 16:29:42.303460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:29:42.303460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception May 26 16:29:42.303460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 16:29:42.303460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application flush_context.execute() May 26 16:29:42.303460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 16:29:42.303460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rec.execute(self) May 26 16:29:42.304365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 16:29:42.304365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 16:29:42.304365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 16:29:42.304365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 16:29:42.304365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 16:29:42.304365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 16:29:42.304365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 16:29:42.304365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 16:29:42.304365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 16:29:42.304365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 16:29:42.304365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 16:29:42.304365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 16:29:42.304365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 16:29:42.304365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 16:29:42.304365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 16:29:42.305152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 16:29:42.305152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:29:42.305152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception May 26 16:29:42.305152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:29:42.305152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:29:42.305152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:29:42.305152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:29:42.305152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:29:42.305152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:29:42.305152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:29:42.305152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application conn.query(q) May 26 16:29:42.305152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:29:42.305152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:29:42.305152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:29:42.305152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result.read() May 26 16:29:42.305152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:29:42.305152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:29:42.306001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:29:42.306001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:29:42.306001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:29:42.306001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:29:42.306001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:29:42.306001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:29:42.306001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 16:29:42.306001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 16:29:42.306001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [parameters: {'id': '34a78741b4c84e0d89847a3a134fbb2e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 16:29:42.306001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 16:29:42.306001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:42.306001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:42.306001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:42.306001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:42.306001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 16:29:42.308215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 16:29:42.308215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 16:29:42.308215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 16:29:42.308215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 16:29:42.308215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:42.308215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:42.308215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:42.308215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:42.308215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:42.308215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:42.308215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:42.308215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:42.308215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:42.308215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:42.308215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:42.308215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:42.308215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:42.309952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:42.309952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 16:29:42.309952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 16:29:42.309952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:42.309952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:42.309952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 16:29:42.309952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 16:29:42.309952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 34a78741b4c84e0d89847a3a134fbb2e. May 26 16:29:42.309952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:42.309952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 486/944] 10.222.0.110 () {60 vars in 1145 bytes} [Thu May 26 16:29:42 2022] POST /identity/v3/projects => generated 262 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:42.309952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a0a5d-18b6-45d8-afcf-d45bd04fa9d5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:42.374252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:42.408510 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bae47d-03ad-4151-8ff5-59188e52e897 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:42.425320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a0a5d-18b6-45d8-afcf-d45bd04fa9d5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:42.447473 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e58db-f8a8-4987-8fe5-b7ced98c3772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:42.448590 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e58db-f8a8-4987-8fe5-b7ced98c3772 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.449087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e58db-f8a8-4987-8fe5-b7ced98c3772 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.449543 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e58db-f8a8-4987-8fe5-b7ced98c3772 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.458821 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e58db-f8a8-4987-8fe5-b7ced98c3772 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:42.460465 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e58db-f8a8-4987-8fe5-b7ced98c3772 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:42.462114 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a2a96-1be8-4e97-afdb-dd8f715c7da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:42.463184 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a2a96-1be8-4e97-afdb-dd8f715c7da8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.463849 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a2a96-1be8-4e97-afdb-dd8f715c7da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.464017 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a2a96-1be8-4e97-afdb-dd8f715c7da8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.472208 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a2a96-1be8-4e97-afdb-dd8f715c7da8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:42.474069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a2a96-1be8-4e97-afdb-dd8f715c7da8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:42.478113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-077e58db-f8a8-4987-8fe5-b7ced98c3772 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:42.478113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:42.478113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:42.478113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:42.478113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:42.478113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:42.478113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:42.478113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:42.478113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:42.478113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:42.478113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:42.478113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:42.478113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:42.478113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:42.478113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:42.479152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:42.479152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:42.479152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:42.479152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:42.479152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:42.479152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:42.479152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:42.479152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:42.479152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:42.479152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:42.479152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:42.479152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:42.479152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:42.479152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:42.479152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:42.479152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:42.479152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:42.480081 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:42.480081 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:42.480081 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:42.480081 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:42.480081 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:42.480081 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:42.480081 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:42.480081 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:42.482437 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 459/945] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:42.494632 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e58db-f8a8-4987-8fe5-b7ced98c3772 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:42.494835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-1a4a2a96-1be8-4e97-afdb-dd8f715c7da8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:42.494835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:42.494835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:42.494835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:42.494835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:42.494835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:42.494835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:42.494835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:42.494835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:42.494835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:42.494835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:42.494835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:42.494835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:42.494835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:42.494835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:42.495670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:42.495670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:42.495670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:42.495670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:42.495670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:42.495670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:42.495670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:42.495670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:42.495670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:42.495670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:42.495670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:42.495670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:42.495670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:42.495670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:42.495670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:42.495670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:42.495670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:42.496942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:42.496942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:42.496942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:42.496942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:42.496942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:42.496942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:42.496942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:42.496942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:42.501599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 487/946] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:42.502735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a2a96-1be8-4e97-afdb-dd8f715c7da8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:42.542887 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:42.614936 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e58db-f8a8-4987-8fe5-b7ced98c3772 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:42.632231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a2a96-1be8-4e97-afdb-dd8f715c7da8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:42.649992 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:42.662435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21305c8-2371-4b8d-8d99-0c67c47f8396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:42.663744 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21305c8-2371-4b8d-8d99-0c67c47f8396 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.664690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21305c8-2371-4b8d-8d99-0c67c47f8396 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.665439 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21305c8-2371-4b8d-8d99-0c67c47f8396 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.666720 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21305c8-2371-4b8d-8d99-0c67c47f8396 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:42.667654 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21305c8-2371-4b8d-8d99-0c67c47f8396 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:42.669664 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21305c8-2371-4b8d-8d99-0c67c47f8396 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:42.672691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc069ab8-4a77-477c-a14f-deea5d0db97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:42.673367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc069ab8-4a77-477c-a14f-deea5d0db97e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.673655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc069ab8-4a77-477c-a14f-deea5d0db97e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.673941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc069ab8-4a77-477c-a14f-deea5d0db97e None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.674743 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc069ab8-4a77-477c-a14f-deea5d0db97e None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:42.675056 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc069ab8-4a77-477c-a14f-deea5d0db97e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:42.676568 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc069ab8-4a77-477c-a14f-deea5d0db97e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:42.686096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 460/947] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:42.687851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23b2fd-df2f-4040-8ca2-b26d7bddde00 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.688872 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23b2fd-df2f-4040-8ca2-b26d7bddde00 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.689379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23b2fd-df2f-4040-8ca2-b26d7bddde00 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.691386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 461/948] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:42.692849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23b2fd-df2f-4040-8ca2-b26d7bddde00 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:42.699334 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 488/949] 10.222.0.110 () {56 vars in 1117 bytes} [Thu May 26 16:29:42 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:42.700781 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc9736-295e-491b-ab4b-3f4f9a4735f5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.701144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc9736-295e-491b-ab4b-3f4f9a4735f5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.701436 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc9736-295e-491b-ab4b-3f4f9a4735f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.721110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4fcc9736-295e-491b-ab4b-3f4f9a4735f5 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:42.723108 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4fcc9736-295e-491b-ab4b-3f4f9a4735f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:42.815972 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 489/950] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:42 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:42.839061 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc9736-295e-491b-ab4b-3f4f9a4735f5 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:42.839709 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23b2fd-df2f-4040-8ca2-b26d7bddde00 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:42.841376 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:42.893092 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bce71f-c115-4a00-a8f8-a03ebc481278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:42.895173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bce71f-c115-4a00-a8f8-a03ebc481278 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.895173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bce71f-c115-4a00-a8f8-a03ebc481278 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.895173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bce71f-c115-4a00-a8f8-a03ebc481278 None admin] PATH_INFO: `/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/ebf3257328b94092b544cb0dadb789c3/roles/46e323c1a7614208aaaa8a31c9186f4a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.898658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bce71f-c115-4a00-a8f8-a03ebc481278 None admin] RBAC: Authorizing `identity:create_grant(project_id=d33e1f400b3e46379d2a0abd05921181, user_id=ebf3257328b94092b544cb0dadb789c3, role_id=46e323c1a7614208aaaa8a31c9186f4a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:42.900118 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bce71f-c115-4a00-a8f8-a03ebc481278 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:42.919384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 462/951] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:29:42 2022] PUT /identity/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/ebf3257328b94092b544cb0dadb789c3/roles/46e323c1a7614208aaaa8a31c9186f4a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:29:42.970210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc9736-295e-491b-ab4b-3f4f9a4735f5 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:42.979870 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:43.016720 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394c039-7728-4d0c-9e0f-544ae2b4d995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:43.017554 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394c039-7728-4d0c-9e0f-544ae2b4d995 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:43.017844 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394c039-7728-4d0c-9e0f-544ae2b4d995 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:43.018123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394c039-7728-4d0c-9e0f-544ae2b4d995 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:43.018834 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394c039-7728-4d0c-9e0f-544ae2b4d995 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:43.020307 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394c039-7728-4d0c-9e0f-544ae2b4d995 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:43.033614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-6394c039-7728-4d0c-9e0f-544ae2b4d995 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:29:43.033614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:43.033614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:43.033614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:43.033614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:43.033614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:43.033614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:43.033614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:43.033614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:29:43.033614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:43.033614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:43.033614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:43.033614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:43.033614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:43.033614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:43.033614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:43.033614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:43.034996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:43.034996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:43.034996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:43.034996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:43.034996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:43.034996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:43.034996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:43.034996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:43.034996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:43.034996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:43.034996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:43.034996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:43.034996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:43.034996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:43.034996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:43.034996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:43.035878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:43.035878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:43.035878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:43.035878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:43.035878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:43.035878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:43.035878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:43.035878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:43.035878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:43.035878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:43.035878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:43.035878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:43.035878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:29:43.035878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:43.035878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 490/952] 10.222.0.110 () {56 vars in 1131 bytes} [Thu May 26 16:29:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:43.043617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bce71f-c115-4a00-a8f8-a03ebc481278 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:43.056520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31144660-6c6f-4aab-af27-36e36bf35c1a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:43.057273 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31144660-6c6f-4aab-af27-36e36bf35c1a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:43.057739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31144660-6c6f-4aab-af27-36e36bf35c1a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:43.059557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 491/953] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:29:43.065642 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7fafb-9be2-4b50-9530-9b789e48596e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:43.066164 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7fafb-9be2-4b50-9530-9b789e48596e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:43.066659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7fafb-9be2-4b50-9530-9b789e48596e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:43.085129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b5c7fafb-9be2-4b50-9530-9b789e48596e None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:43.086686 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b5c7fafb-9be2-4b50-9530-9b789e48596e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:43.160136 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 492/954] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:43 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:29:43.166592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bce71f-c115-4a00-a8f8-a03ebc481278 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:43.182027 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7fafb-9be2-4b50-9530-9b789e48596e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:43.197350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b46105-4ac7-4996-9a2d-e80f673d91d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:43.198053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b46105-4ac7-4996-9a2d-e80f673d91d8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:43.198345 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b46105-4ac7-4996-9a2d-e80f673d91d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:43.198655 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b46105-4ac7-4996-9a2d-e80f673d91d8 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:43.199362 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b46105-4ac7-4996-9a2d-e80f673d91d8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:43.199672 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b46105-4ac7-4996-9a2d-e80f673d91d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:43.201038 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b46105-4ac7-4996-9a2d-e80f673d91d8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:43.206530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 463/955] 10.222.0.110 () {56 vars in 1127 bytes} [Thu May 26 16:29:43 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:43.212565 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b46105-4ac7-4996-9a2d-e80f673d91d8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:43.251440 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:43.319598 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:43.323777 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7fafb-9be2-4b50-9530-9b789e48596e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:43.340509 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b46105-4ac7-4996-9a2d-e80f673d91d8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:43.365438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55f6fa-3a86-43ca-998c-0f3b7a6c2846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:43.371814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55f6fa-3a86-43ca-998c-0f3b7a6c2846 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:43.372653 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55f6fa-3a86-43ca-998c-0f3b7a6c2846 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:43.373327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55f6fa-3a86-43ca-998c-0f3b7a6c2846 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:43.374409 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55f6fa-3a86-43ca-998c-0f3b7a6c2846 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:43.378322 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55f6fa-3a86-43ca-998c-0f3b7a6c2846 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:43.378448 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023b66d-7124-4ed6-a7e9-bc33791a4f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:43.378448 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b66d-7124-4ed6-a7e9-bc33791a4f9c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:43.378448 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b66d-7124-4ed6-a7e9-bc33791a4f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:43.378852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b66d-7124-4ed6-a7e9-bc33791a4f9c None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:43.379463 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023b66d-7124-4ed6-a7e9-bc33791a4f9c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:43.379763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023b66d-7124-4ed6-a7e9-bc33791a4f9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:43.381130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023b66d-7124-4ed6-a7e9-bc33791a4f9c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:43.391272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 464/956] 10.222.0.110 () {56 vars in 1127 bytes} [Thu May 26 16:29:43 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:43.395475 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023b66d-7124-4ed6-a7e9-bc33791a4f9c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:43.396267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-0e55f6fa-3a86-43ca-998c-0f3b7a6c2846 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:29:43.396267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:43.396267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:43.396267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:43.396267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:43.396267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:43.396267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:43.396267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:43.396267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:29:43.396267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:43.396267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:43.396267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:43.396267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:43.396267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:43.396267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:43.396267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:43.396267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:43.397249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:43.397249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:43.397249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:43.397249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:43.397249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:43.397249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:43.397249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:43.397249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:43.397249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:43.397249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:43.397249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:43.397249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:43.397249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:43.397249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:43.397249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:43.397249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:43.398085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:43.398085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:43.398085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:43.398085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:43.398085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:43.398085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:43.398085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:43.398085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:43.398085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:43.398085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:43.398085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:43.398085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:43.398085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:29:43.398085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:43.402604 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 493/957] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:43.405195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55f6fa-3a86-43ca-998c-0f3b7a6c2846 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:43.515319 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:43.525607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023b66d-7124-4ed6-a7e9-bc33791a4f9c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:43.535862 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55f6fa-3a86-43ca-998c-0f3b7a6c2846 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:43.560962 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff3497-e602-40e2-9547-6605fa237b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:43.561627 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff3497-e602-40e2-9547-6605fa237b54 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:43.561913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff3497-e602-40e2-9547-6605fa237b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:43.562273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff3497-e602-40e2-9547-6605fa237b54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:43.563040 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff3497-e602-40e2-9547-6605fa237b54 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:43.564414 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff3497-e602-40e2-9547-6605fa237b54 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:43.580810 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089a332-d054-475a-a5d7-f8d517881eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:43.581822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089a332-d054-475a-a5d7-f8d517881eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:43.582305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089a332-d054-475a-a5d7-f8d517881eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:43.582854 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089a332-d054-475a-a5d7-f8d517881eb2 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:43.583784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089a332-d054-475a-a5d7-f8d517881eb2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:43.589592 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089a332-d054-475a-a5d7-f8d517881eb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:43.589770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 465/958] 10.222.0.110 () {60 vars in 1149 bytes} [Thu May 26 16:29:43 2022] POST /identity/v3/endpoints => generated 351 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:29:43.589883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089a332-d054-475a-a5d7-f8d517881eb2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:43.599052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 494/959] 10.222.0.110 () {56 vars in 1117 bytes} [Thu May 26 16:29:43 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:43.604882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff3497-e602-40e2-9547-6605fa237b54 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:43.735825 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff3497-e602-40e2-9547-6605fa237b54 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:43.775878 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821f8cf-3414-4925-9414-742b7a49729c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:43.776478 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821f8cf-3414-4925-9414-742b7a49729c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:43.776762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821f8cf-3414-4925-9414-742b7a49729c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:43.777038 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821f8cf-3414-4925-9414-742b7a49729c None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:43.777804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821f8cf-3414-4925-9414-742b7a49729c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:43.778117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821f8cf-3414-4925-9414-742b7a49729c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:43.779623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821f8cf-3414-4925-9414-742b7a49729c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:43.784539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 466/960] 10.222.0.110 () {56 vars in 1117 bytes} [Thu May 26 16:29:43 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:45.118081 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c1242-5066-4503-95d1-b656b018d5a9 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:45.118621 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c1242-5066-4503-95d1-b656b018d5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:45.118704 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c1242-5066-4503-95d1-b656b018d5a9 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:45.120682 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 495/961] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:45.127282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb9426-6d21-4c12-99c4-06f3cf1313e1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:45.127696 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb9426-6d21-4c12-99c4-06f3cf1313e1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:45.127868 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb9426-6d21-4c12-99c4-06f3cf1313e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:45.139173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:45.146408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-31eb9426-6d21-4c12-99c4-06f3cf1313e1 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:45.147814 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-31eb9426-6d21-4c12-99c4-06f3cf1313e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:45.150152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d7c7b-6276-4528-9691-56be12043885 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:45.150444 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d7c7b-6276-4528-9691-56be12043885 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:45.150750 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d7c7b-6276-4528-9691-56be12043885 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:45.152450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 496/962] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:45.159923 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c5389-54f4-41f8-8520-7cc5b89a30ce None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:45.160211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c5389-54f4-41f8-8520-7cc5b89a30ce None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:45.160489 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c5389-54f4-41f8-8520-7cc5b89a30ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:45.179755 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3b3c5389-54f4-41f8-8520-7cc5b89a30ce None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:45.181390 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3b3c5389-54f4-41f8-8520-7cc5b89a30ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:45.226971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:45.242588 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 467/963] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:45 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:45.258536 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 497/964] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:45 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:29:45.267264 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb9426-6d21-4c12-99c4-06f3cf1313e1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:45.283395 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c5389-54f4-41f8-8520-7cc5b89a30ce None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:45.402924 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb9426-6d21-4c12-99c4-06f3cf1313e1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:45.420535 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c5389-54f4-41f8-8520-7cc5b89a30ce None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:45.449075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae98cfe-9b47-48ef-8a0c-139979a1cdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:45.449766 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae98cfe-9b47-48ef-8a0c-139979a1cdc1 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:45.450057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae98cfe-9b47-48ef-8a0c-139979a1cdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:45.450337 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae98cfe-9b47-48ef-8a0c-139979a1cdc1 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:45.451084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae98cfe-9b47-48ef-8a0c-139979a1cdc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:45.452523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae98cfe-9b47-48ef-8a0c-139979a1cdc1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:45.453886 dv-cinder-836072-5-smb devstack@keystone.service[80419]: WARNING keystone.server.flask.common [None req-cae98cfe-9b47-48ef-8a0c-139979a1cdc1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 16:29:45.462215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:45.466830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.sql.core [None req-cae98cfe-9b47-48ef-8a0c-139979a1cdc1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 16:29:45.466830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 16:29:45.466830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [parameters: {'user_id': 'b5d24557191c450b8c5173b55945a829', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 16:29:45.466830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80419) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 16:29:45.467531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1bad3-6f0e-4f8c-b93d-60d71c6a04d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:45.469689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1bad3-6f0e-4f8c-b93d-60d71c6a04d8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:45.470297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1bad3-6f0e-4f8c-b93d-60d71c6a04d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:45.470744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1bad3-6f0e-4f8c-b93d-60d71c6a04d8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:45.483190 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1bad3-6f0e-4f8c-b93d-60d71c6a04d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:45.488641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-cae98cfe-9b47-48ef-8a0c-139979a1cdc1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 16:29:45.488641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:45.488641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:29:45.488641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:29:45.488641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:29:45.488641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:29:45.488641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:29:45.488641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:29:45.488641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:29:45.488641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application conn.query(q) May 26 16:29:45.488641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:29:45.488641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:29:45.488641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:29:45.488641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result.read() May 26 16:29:45.488641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:29:45.489647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:29:45.489647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:29:45.489647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:29:45.489647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:29:45.489647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:29:45.489647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:29:45.489647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:29:45.489647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 16:29:45.489647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:45.489647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 16:29:45.489647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:45.489647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:45.489647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 16:29:45.489647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 16:29:45.489647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 16:29:45.489647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 16:29:45.489647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:29:45.489647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application next(self.gen) May 26 16:29:45.490675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 16:29:45.490675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application yield resource May 26 16:29:45.490675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:29:45.490675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application next(self.gen) May 26 16:29:45.490675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 16:29:45.490675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.session.rollback() May 26 16:29:45.490675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 16:29:45.490675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.force_reraise() May 26 16:29:45.490675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 16:29:45.490675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise self.value May 26 16:29:45.490675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 16:29:45.490675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 16:29:45.490675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 16:29:45.490675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application session.commit() May 26 16:29:45.490675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 16:29:45.490675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 16:29:45.490675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 16:29:45.491573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._prepare_impl() May 26 16:29:45.491573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 16:29:45.491573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.session.flush() May 26 16:29:45.491573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 16:29:45.491573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._flush(objects) May 26 16:29:45.491573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 16:29:45.491573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 16:29:45.491573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 16:29:45.491573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application compat.raise_( May 26 16:29:45.491573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:29:45.491573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception May 26 16:29:45.491573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 16:29:45.491573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application flush_context.execute() May 26 16:29:45.491573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 16:29:45.491573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rec.execute(self) May 26 16:29:45.491573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 16:29:45.491573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 16:29:45.492456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 16:29:45.492456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 16:29:45.492456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 16:29:45.492456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 16:29:45.492456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 16:29:45.492456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 16:29:45.492456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 16:29:45.492456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 16:29:45.492456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 16:29:45.492456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 16:29:45.492456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 16:29:45.492456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 16:29:45.492456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 16:29:45.492456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 16:29:45.492456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:29:45.492456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception May 26 16:29:45.493301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:29:45.493301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:29:45.493301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:29:45.493301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:29:45.493301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:29:45.493301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:29:45.493301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:29:45.493301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application conn.query(q) May 26 16:29:45.493301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:29:45.493301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:29:45.493301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:29:45.493301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result.read() May 26 16:29:45.493301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:29:45.493301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:29:45.493301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:29:45.493301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:29:45.494132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:29:45.494132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:29:45.494132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:29:45.494132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:29:45.494132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 16:29:45.494132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 16:29:45.494132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b5d24557191c450b8c5173b55945a829', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 16:29:45.494132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 16:29:45.494132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:45.494132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:45.494132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:45.494132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:45.494132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:45.494132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:45.494132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:45.496242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:45.496242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:45.496242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:45.496242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:45.496242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:45.496242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:45.496242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:45.496242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 16:29:45.496242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 16:29:45.496242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:45.496242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:45.496242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:45.496242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:45.496242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:45.496242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:45.496242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 16:29:45.496242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 16:29:45.498349 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 16:29:45.498349 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 16:29:45.498349 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 16:29:45.498349 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 16:29:45.498349 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 16:29:45.498349 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:45.498349 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 468/965] 10.222.0.110 () {60 vars in 1136 bytes} [Thu May 26 16:29:45 2022] POST /identity/v3/users => generated 160 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:45.499189 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae98cfe-9b47-48ef-8a0c-139979a1cdc1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:45.503494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-87f1bad3-6f0e-4f8c-b93d-60d71c6a04d8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:29:45.503494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:45.503494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:45.503494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:45.503494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:45.503494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:45.503494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:45.503494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:45.503494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:45.503494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:45.503494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:45.503494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:45.503494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:45.503494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:45.503494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:45.503494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:45.504506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:45.504506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:45.504506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:45.504506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:45.504506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:45.504506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:45.504506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:45.504506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:45.504506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:45.504506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:45.504506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:45.504506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:45.504506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:45.504506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:45.504506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:45.504506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:45.505350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:45.505350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:45.505350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:45.505350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:45.505350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:45.505350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:45.505350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:45.505350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:45.505350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:45.505350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:45.505350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:29:45.505350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:45.508252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 498/966] 10.222.0.110 () {56 vars in 1125 bytes} [Thu May 26 16:29:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:45.514253 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1bad3-6f0e-4f8c-b93d-60d71c6a04d8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:45.535978 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:45.612913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae98cfe-9b47-48ef-8a0c-139979a1cdc1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:45.631635 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1bad3-6f0e-4f8c-b93d-60d71c6a04d8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:45.651432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a736db0-0de8-4f87-b1aa-cdd99eb203aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:45.652668 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a736db0-0de8-4f87-b1aa-cdd99eb203aa None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:45.653164 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a736db0-0de8-4f87-b1aa-cdd99eb203aa None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:45.653703 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a736db0-0de8-4f87-b1aa-cdd99eb203aa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:45.662283 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a736db0-0de8-4f87-b1aa-cdd99eb203aa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:45.664208 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a736db0-0de8-4f87-b1aa-cdd99eb203aa None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:45.669172 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fc182-6587-4b95-83fb-6d93ec287ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:45.669843 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fc182-6587-4b95-83fb-6d93ec287ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:45.670130 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fc182-6587-4b95-83fb-6d93ec287ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:45.670408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fc182-6587-4b95-83fb-6d93ec287ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:45.671206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298fc182-6587-4b95-83fb-6d93ec287ba0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:45.671641 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298fc182-6587-4b95-83fb-6d93ec287ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:45.673007 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298fc182-6587-4b95-83fb-6d93ec287ba0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:45.681534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3a736db0-0de8-4f87-b1aa-cdd99eb203aa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:29:45.681534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:45.681534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:45.681534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:45.681534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:45.681534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:45.681534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:45.681534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:45.681534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:45.681534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:45.681534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:45.681534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:45.681534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:45.681534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:45.681534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:45.681534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:45.682482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:45.682482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:45.682482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:45.682482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:45.682482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:45.682482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:45.682482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:45.682482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:45.682482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:45.682482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:45.682482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:45.682482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:45.682482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:45.682482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:45.682482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:45.682482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:45.682482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:45.682482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:45.683772 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:45.683772 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:45.683772 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:45.683772 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:45.683772 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:45.683772 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:45.683772 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:45.683772 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:45.683772 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:29:45.683772 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:45.686165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 499/967] 10.222.0.110 () {56 vars in 1120 bytes} [Thu May 26 16:29:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:45.691685 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fc182-6587-4b95-83fb-6d93ec287ba0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:45.691965 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 469/968] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:29:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:45.693334 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a736db0-0de8-4f87-b1aa-cdd99eb203aa None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:45.758834 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:45.782389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:45.805214 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fc182-6587-4b95-83fb-6d93ec287ba0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:45.806692 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a736db0-0de8-4f87-b1aa-cdd99eb203aa None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:45.846510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61806b30-6cd5-4140-96bb-e2609a763b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:45.847444 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61806b30-6cd5-4140-96bb-e2609a763b6c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:45.847729 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61806b30-6cd5-4140-96bb-e2609a763b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:45.848010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61806b30-6cd5-4140-96bb-e2609a763b6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:45.848431 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90678675-2494-430a-8b95-d233b49e2af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:45.849492 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90678675-2494-430a-8b95-d233b49e2af0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:45.849982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90678675-2494-430a-8b95-d233b49e2af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:45.850492 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90678675-2494-430a-8b95-d233b49e2af0 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:45.851551 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90678675-2494-430a-8b95-d233b49e2af0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:45.852063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90678675-2494-430a-8b95-d233b49e2af0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:45.853707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90678675-2494-430a-8b95-d233b49e2af0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:45.860951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61806b30-6cd5-4140-96bb-e2609a763b6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:45.862468 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61806b30-6cd5-4140-96bb-e2609a763b6c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:45.881263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-61806b30-6cd5-4140-96bb-e2609a763b6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:45.881263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:45.881263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:45.881263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:45.881263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:45.881263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:45.881263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:45.881263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:45.881263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:45.881263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:45.881263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:45.881263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:45.881263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:45.881263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:45.881263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:45.882277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:45.882277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:45.882277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:45.882277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:45.882277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:45.882277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:45.882277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:45.882277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:45.882277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:45.882277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:45.882277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:45.882277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:45.882277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:45.882277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:45.882277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:45.882277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:45.882277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:45.883718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:45.883718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:45.883718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:45.883718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:45.886854 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 500/969] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:45.887737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61806b30-6cd5-4140-96bb-e2609a763b6c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:45.906647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 470/970] 10.222.0.110 () {56 vars in 1106 bytes} [Thu May 26 16:29:45 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:45.922030 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422837ac-07f2-453f-ad6c-505f69397d34 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:45.922351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422837ac-07f2-453f-ad6c-505f69397d34 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:45.922627 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422837ac-07f2-453f-ad6c-505f69397d34 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:45.928430 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 471/971] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:45 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:29:45.929887 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a16e27-7a51-4d90-9282-629bdc69b14b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:45.930183 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a16e27-7a51-4d90-9282-629bdc69b14b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:45.930470 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a16e27-7a51-4d90-9282-629bdc69b14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:45.948417 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-21a16e27-7a51-4d90-9282-629bdc69b14b None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:45.950003 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-21a16e27-7a51-4d90-9282-629bdc69b14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:46.005396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61806b30-6cd5-4140-96bb-e2609a763b6c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:46.025716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 472/972] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:45 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:46.027142 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ce472-357e-4da9-a1b9-c5b089ba321e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:46.027437 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ce472-357e-4da9-a1b9-c5b089ba321e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:46.027717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ce472-357e-4da9-a1b9-c5b089ba321e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:46.029196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 473/973] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:46.035250 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cda7d-c870-4e4d-93a0-7637637f84ee None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:46.035543 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cda7d-c870-4e4d-93a0-7637637f84ee None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:46.035821 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cda7d-c870-4e4d-93a0-7637637f84ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:46.047144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:46.053315 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263b625-9830-4c02-81af-996e5bee1fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:46.054005 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263b625-9830-4c02-81af-996e5bee1fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:46.054293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263b625-9830-4c02-81af-996e5bee1fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:46.054633 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263b625-9830-4c02-81af-996e5bee1fe5 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:46.055344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263b625-9830-4c02-81af-996e5bee1fe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:46.055657 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263b625-9830-4c02-81af-996e5bee1fe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:46.055833 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c10cda7d-c870-4e4d-93a0-7637637f84ee None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:46.057042 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c10cda7d-c870-4e4d-93a0-7637637f84ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:46.057145 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263b625-9830-4c02-81af-996e5bee1fe5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:46.070623 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 501/974] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:46.071501 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263b625-9830-4c02-81af-996e5bee1fe5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:46.110690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:46.146433 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 474/975] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:46 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:29:46.147213 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cda7d-c870-4e4d-93a0-7637637f84ee None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:46.195217 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263b625-9830-4c02-81af-996e5bee1fe5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:46.235620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20c5cf-13d5-427d-9b87-1b88c8c8e4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:46.236435 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20c5cf-13d5-427d-9b87-1b88c8c8e4ab None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:46.236724 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20c5cf-13d5-427d-9b87-1b88c8c8e4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:46.237003 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20c5cf-13d5-427d-9b87-1b88c8c8e4ab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:46.237669 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20c5cf-13d5-427d-9b87-1b88c8c8e4ab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:46.239120 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20c5cf-13d5-427d-9b87-1b88c8c8e4ab None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:46.251882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-4a20c5cf-13d5-427d-9b87-1b88c8c8e4ab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:29:46.251882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:46.251882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:46.251882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:46.251882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:46.251882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:46.251882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:46.251882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:46.251882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:29:46.251882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:46.251882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:46.251882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:46.251882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:46.251882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:46.251882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:46.251882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:46.251882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:46.253034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:46.253034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:46.253034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:46.253034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:46.253034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:46.253034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:46.253034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:46.253034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:46.253034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:46.253034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:46.253034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:46.253034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:46.253034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:46.253034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:46.253034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:46.253034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:46.254087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:46.254087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:46.254087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:46.254087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:46.254087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:46.254087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:46.254087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:46.254087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:46.254087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:46.254087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:46.254087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:46.254087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:46.254087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:29:46.254087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:46.254087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 502/976] 10.222.0.110 () {56 vars in 1131 bytes} [Thu May 26 16:29:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:46.255054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20c5cf-13d5-427d-9b87-1b88c8c8e4ab None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:46.263937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cda7d-c870-4e4d-93a0-7637637f84ee None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:46.297754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c0a37-9920-47d1-a7fd-50dafea241df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:46.298587 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c0a37-9920-47d1-a7fd-50dafea241df None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:46.298887 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c0a37-9920-47d1-a7fd-50dafea241df None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:46.299164 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c0a37-9920-47d1-a7fd-50dafea241df None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:46.306163 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c0a37-9920-47d1-a7fd-50dafea241df None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:46.307634 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c0a37-9920-47d1-a7fd-50dafea241df None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:46.311291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:46.323621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d20c0a37-9920-47d1-a7fd-50dafea241df None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:29:46.323621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:46.323621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:46.323621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:46.323621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:46.323621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:46.323621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:46.323621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:46.323621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:46.323621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:46.323621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:46.323621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:46.323621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:46.323621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:46.323621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:46.323621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:46.324592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:46.324592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:46.324592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:46.324592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:46.324592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:46.324592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:46.324592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:46.324592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:46.324592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:46.324592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:46.324592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:46.324592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:46.324592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:46.324592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:46.324592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:46.324592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:46.324592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:46.324592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:46.325570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:46.325570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:46.325570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:46.325570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:46.325570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:46.325570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:46.325570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:46.325570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:46.325570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:29:46.325570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:46.325570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 475/977] 10.222.0.110 () {56 vars in 1122 bytes} [Thu May 26 16:29:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:46.325570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c0a37-9920-47d1-a7fd-50dafea241df None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:46.360415 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20c5cf-13d5-427d-9b87-1b88c8c8e4ab None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:46.371521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:46.396139 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e7972-086c-445e-9ece-f5ee2c911ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:46.396854 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e7972-086c-445e-9ece-f5ee2c911ff1 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:46.397083 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e7972-086c-445e-9ece-f5ee2c911ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:46.397434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e7972-086c-445e-9ece-f5ee2c911ff1 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:46.398106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e7972-086c-445e-9ece-f5ee2c911ff1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:46.399499 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e7972-086c-445e-9ece-f5ee2c911ff1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:46.426598 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 503/978] 10.222.0.110 () {60 vars in 1146 bytes} [Thu May 26 16:29:46 2022] POST /identity/v3/services => generated 243 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:29:46.426598 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e7972-086c-445e-9ece-f5ee2c911ff1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:46.443779 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c0a37-9920-47d1-a7fd-50dafea241df None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:46.491034 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4000f85-b3c1-45f5-8543-eac76c238f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:46.491728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4000f85-b3c1-45f5-8543-eac76c238f63 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:46.492013 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4000f85-b3c1-45f5-8543-eac76c238f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:46.492291 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4000f85-b3c1-45f5-8543-eac76c238f63 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:46.493081 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4000f85-b3c1-45f5-8543-eac76c238f63 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:46.493448 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4000f85-b3c1-45f5-8543-eac76c238f63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:46.494896 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4000f85-b3c1-45f5-8543-eac76c238f63 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:46.506333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 476/979] 10.222.0.110 () {56 vars in 1127 bytes} [Thu May 26 16:29:46 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:46.507327 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4000f85-b3c1-45f5-8543-eac76c238f63 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:46.528761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e7972-086c-445e-9ece-f5ee2c911ff1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:46.546843 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:46.571225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cce092-7d03-4ade-b0a4-b76c04c7d45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:46.572381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cce092-7d03-4ade-b0a4-b76c04c7d45e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:46.572678 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cce092-7d03-4ade-b0a4-b76c04c7d45e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:46.572954 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cce092-7d03-4ade-b0a4-b76c04c7d45e None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:46.573808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cce092-7d03-4ade-b0a4-b76c04c7d45e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:46.574123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cce092-7d03-4ade-b0a4-b76c04c7d45e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:46.575649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cce092-7d03-4ade-b0a4-b76c04c7d45e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:46.596599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 504/980] 10.222.0.110 () {56 vars in 1154 bytes} [Thu May 26 16:29:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:46.602358 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cce092-7d03-4ade-b0a4-b76c04c7d45e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:46.630865 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:46.638997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4000f85-b3c1-45f5-8543-eac76c238f63 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:46.677298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d38d9-2a94-4957-8a96-e6ae0b51c78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:46.677886 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d38d9-2a94-4957-8a96-e6ae0b51c78a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:46.678171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d38d9-2a94-4957-8a96-e6ae0b51c78a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:46.678449 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d38d9-2a94-4957-8a96-e6ae0b51c78a None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:46.679189 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d38d9-2a94-4957-8a96-e6ae0b51c78a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:46.679518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d38d9-2a94-4957-8a96-e6ae0b51c78a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:46.681065 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d38d9-2a94-4957-8a96-e6ae0b51c78a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:46.690660 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 477/981] 10.222.0.110 () {56 vars in 1127 bytes} [Thu May 26 16:29:46 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:46.692431 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d38d9-2a94-4957-8a96-e6ae0b51c78a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:46.716940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cce092-7d03-4ade-b0a4-b76c04c7d45e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:46.755466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986352d-8f03-4fb1-bcab-0c33dfb38b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:46.756113 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986352d-8f03-4fb1-bcab-0c33dfb38b07 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:46.756398 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986352d-8f03-4fb1-bcab-0c33dfb38b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:46.756675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986352d-8f03-4fb1-bcab-0c33dfb38b07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:46.796002 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d38d9-2a94-4957-8a96-e6ae0b51c78a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:46.800672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:46.826785 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986352d-8f03-4fb1-bcab-0c33dfb38b07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:46.828824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986352d-8f03-4fb1-bcab-0c33dfb38b07 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:46.831943 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1ba58-fa89-4df5-b16a-c62d88ea8fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:46.832613 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1ba58-fa89-4df5-b16a-c62d88ea8fbb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:46.832898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1ba58-fa89-4df5-b16a-c62d88ea8fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:46.833178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1ba58-fa89-4df5-b16a-c62d88ea8fbb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:46.833982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1ba58-fa89-4df5-b16a-c62d88ea8fbb None admin] RBAC: Adding query filter params (interface=admin, service_id=3cf5b33d942c44fca311da08c1509417, region_id=RegionOne) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:46.834324 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1ba58-fa89-4df5-b16a-c62d88ea8fbb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:46.835710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1ba58-fa89-4df5-b16a-c62d88ea8fbb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:46.846255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 478/982] 10.222.0.110 () {56 vars in 1254 bytes} [Thu May 26 16:29:46 2022] GET /identity/v3/endpoints?service_id=3cf5b33d942c44fca311da08c1509417&interface=admin®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:46.847142 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1ba58-fa89-4df5-b16a-c62d88ea8fbb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:46.872581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:46.939469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 505/983] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:29:46 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 16:29:46.944815 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986352d-8f03-4fb1-bcab-0c33dfb38b07 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:46.957247 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1ba58-fa89-4df5-b16a-c62d88ea8fbb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:46.993669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff4338-3891-421f-9e0b-c5907955257f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:46.994426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff4338-3891-421f-9e0b-c5907955257f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:46.994756 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff4338-3891-421f-9e0b-c5907955257f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:46.995167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff4338-3891-421f-9e0b-c5907955257f None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:46.995688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff4338-3891-421f-9e0b-c5907955257f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:46.997292 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff4338-3891-421f-9e0b-c5907955257f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:47.004284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 479/984] 10.222.0.110 () {56 vars in 1092 bytes} [Thu May 26 16:29:46 2022] GET /identity/v3/services => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:29:47.026175 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:47.055070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986352d-8f03-4fb1-bcab-0c33dfb38b07 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:47.093020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96ad51-bdff-4be5-a497-69313ee47dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:47.093824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96ad51-bdff-4be5-a497-69313ee47dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:47.094106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96ad51-bdff-4be5-a497-69313ee47dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:47.094380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96ad51-bdff-4be5-a497-69313ee47dc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:47.106274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96ad51-bdff-4be5-a497-69313ee47dc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:47.107820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96ad51-bdff-4be5-a497-69313ee47dc4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:47.129327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-0d96ad51-bdff-4be5-a497-69313ee47dc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:47.129327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:47.129327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:47.129327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:47.129327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:47.129327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:47.129327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:47.129327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:47.129327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:47.129327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:47.129327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:47.129327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:47.129327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:47.129327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:47.129327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:47.130318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:47.130318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:47.130318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:47.130318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:47.130318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:47.130318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:47.130318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:47.130318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:47.130318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:47.130318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:47.130318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:47.130318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:47.130318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:47.130318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:47.130318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:47.130318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:47.130318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:47.131848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:47.131848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:47.131848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:47.131848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:47.131848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 506/985] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:47.138890 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff4338-3891-421f-9e0b-c5907955257f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:47.236224 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:47.250081 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff4338-3891-421f-9e0b-c5907955257f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:47.286227 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cd845-1cfc-40e9-84e6-322ed3ce21b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:47.286928 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cd845-1cfc-40e9-84e6-322ed3ce21b5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:47.287217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cd845-1cfc-40e9-84e6-322ed3ce21b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:47.287495 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cd845-1cfc-40e9-84e6-322ed3ce21b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:47.288215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cd845-1cfc-40e9-84e6-322ed3ce21b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:47.288523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cd845-1cfc-40e9-84e6-322ed3ce21b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:47.289897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cd845-1cfc-40e9-84e6-322ed3ce21b5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:47.302455 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 480/986] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:47.308189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96ad51-bdff-4be5-a497-69313ee47dc4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:47.416493 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96ad51-bdff-4be5-a497-69313ee47dc4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:47.442858 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:47.453164 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19722488-e655-460b-9710-958cf7c304ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:47.453966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19722488-e655-460b-9710-958cf7c304ec None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:47.454249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19722488-e655-460b-9710-958cf7c304ec None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:47.454517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19722488-e655-460b-9710-958cf7c304ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:47.461650 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19722488-e655-460b-9710-958cf7c304ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:47.463145 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19722488-e655-460b-9710-958cf7c304ec None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:47.477344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-19722488-e655-460b-9710-958cf7c304ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:47.477344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:47.477344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:47.477344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:47.477344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:47.477344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:47.477344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:47.477344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:47.477344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:47.477344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:47.477344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:47.477344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:47.477344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:47.477344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:47.477344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:47.478224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:47.478224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:47.478224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:47.478224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:47.478224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:47.478224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:47.478224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:47.478224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:47.478224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:47.478224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:47.478224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:47.478224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:47.478224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:47.478224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:47.478224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:47.478224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:47.478224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:47.479449 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:47.479449 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:47.479449 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:47.479449 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:47.479449 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:47.479449 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:47.479449 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:47.479449 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:47.482637 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 507/987] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:47.484368 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cd845-1cfc-40e9-84e6-322ed3ce21b5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:47.590317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cd845-1cfc-40e9-84e6-322ed3ce21b5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:47.624484 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c777083-60c3-412b-8829-d2f67039c7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:47.625126 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c777083-60c3-412b-8829-d2f67039c7bc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:47.625411 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c777083-60c3-412b-8829-d2f67039c7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:47.625688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c777083-60c3-412b-8829-d2f67039c7bc None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:47.626468 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c777083-60c3-412b-8829-d2f67039c7bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:47.626804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c777083-60c3-412b-8829-d2f67039c7bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:47.628723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c777083-60c3-412b-8829-d2f67039c7bc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:47.641434 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 481/988] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:47.647223 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19722488-e655-460b-9710-958cf7c304ec None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:47.751163 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19722488-e655-460b-9710-958cf7c304ec None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:47.785101 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec14f7-06cb-4e9d-9111-43cc9f37a814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:47.785690 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec14f7-06cb-4e9d-9111-43cc9f37a814 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:47.785972 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec14f7-06cb-4e9d-9111-43cc9f37a814 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:47.786246 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec14f7-06cb-4e9d-9111-43cc9f37a814 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:47.787101 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec14f7-06cb-4e9d-9111-43cc9f37a814 None admin] RBAC: Adding query filter params (role.id=46e323c1a7614208aaaa8a31c9186f4a, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=ebf3257328b94092b544cb0dadb789c3) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:47.787415 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec14f7-06cb-4e9d-9111-43cc9f37a814 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:47.788832 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec14f7-06cb-4e9d-9111-43cc9f37a814 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:47.802615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 508/989] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:29:47 2022] GET /identity/v3/role_assignments?user.id=ebf3257328b94092b544cb0dadb789c3&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=46e323c1a7614208aaaa8a31c9186f4a => generated 610 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:48.700904 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49af62-865d-4fbb-a4c2-42fca191195e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:48.701401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49af62-865d-4fbb-a4c2-42fca191195e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:48.701401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49af62-865d-4fbb-a4c2-42fca191195e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:48.703003 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 482/990] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:48.708219 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f32e6-49fe-4d1b-b29e-1b1f03dc95da None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:48.708605 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f32e6-49fe-4d1b-b29e-1b1f03dc95da None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:48.708796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f32e6-49fe-4d1b-b29e-1b1f03dc95da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:48.726131 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-278f32e6-49fe-4d1b-b29e-1b1f03dc95da None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:48.727344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-278f32e6-49fe-4d1b-b29e-1b1f03dc95da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:48.786189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:48.809181 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 509/991] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:48 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:48.832138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49af62-865d-4fbb-a4c2-42fca191195e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:48.843293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:48.941615 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49af62-865d-4fbb-a4c2-42fca191195e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:48.976125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a090cca-f674-4318-a168-5c1dc5552fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:48.976849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a090cca-f674-4318-a168-5c1dc5552fdb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:48.977135 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a090cca-f674-4318-a168-5c1dc5552fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:48.977465 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a090cca-f674-4318-a168-5c1dc5552fdb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:48.978119 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a090cca-f674-4318-a168-5c1dc5552fdb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:48.979512 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a090cca-f674-4318-a168-5c1dc5552fdb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:48.991899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8a090cca-f674-4318-a168-5c1dc5552fdb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:29:48.991899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:48.991899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:48.991899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:48.991899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:48.991899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:48.991899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:48.991899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:48.991899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:29:48.991899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:48.991899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:48.991899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:48.991899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:48.991899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:48.991899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:48.991899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:48.991899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:48.992852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:48.992852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:48.992852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:48.992852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:48.992852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:48.992852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:48.992852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:48.992852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:48.992852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:48.992852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:48.992852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:48.992852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:48.992852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:48.992852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:48.992852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:48.992852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:48.998858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:48.998858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:48.998858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:48.998858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:48.998858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:48.998858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:48.998858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:48.998858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:48.998858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:48.998858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:48.998858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:48.998858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:48.998858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:29:48.998858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:48.998858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 483/992] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:49.001758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f32e6-49fe-4d1b-b29e-1b1f03dc95da None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:49.109821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f32e6-49fe-4d1b-b29e-1b1f03dc95da None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:49.146812 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251167f-3f82-400c-ab3d-b51c41188c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:49.147482 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251167f-3f82-400c-ab3d-b51c41188c4c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:49.147765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251167f-3f82-400c-ab3d-b51c41188c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:49.148040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251167f-3f82-400c-ab3d-b51c41188c4c None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:49.148740 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251167f-3f82-400c-ab3d-b51c41188c4c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:49.149046 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251167f-3f82-400c-ab3d-b51c41188c4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:49.150400 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251167f-3f82-400c-ab3d-b51c41188c4c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:49.158652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 510/993] 10.222.0.110 () {56 vars in 1117 bytes} [Thu May 26 16:29:49 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:49.161535 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a090cca-f674-4318-a168-5c1dc5552fdb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:49.232703 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76ddb8-3e84-44e9-a94d-ae7f63f216fd None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:49.233004 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76ddb8-3e84-44e9-a94d-ae7f63f216fd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:49.233283 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76ddb8-3e84-44e9-a94d-ae7f63f216fd None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:49.235023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 511/994] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:29:49.236410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:49.239868 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082c280-d4c1-4a9c-b4c8-3997fa1b1793 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:49.240256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082c280-d4c1-4a9c-b4c8-3997fa1b1793 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:49.240610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082c280-d4c1-4a9c-b4c8-3997fa1b1793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:49.257978 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6082c280-d4c1-4a9c-b4c8-3997fa1b1793 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:49.259287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6082c280-d4c1-4a9c-b4c8-3997fa1b1793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:49.269173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a090cca-f674-4318-a168-5c1dc5552fdb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:49.300940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:49.306192 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86e8f9-592f-4aae-affc-4a056a446088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:49.306905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86e8f9-592f-4aae-affc-4a056a446088 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:49.307193 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86e8f9-592f-4aae-affc-4a056a446088 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:49.307469 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86e8f9-592f-4aae-affc-4a056a446088 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:49.308181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86e8f9-592f-4aae-affc-4a056a446088 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:49.308489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86e8f9-592f-4aae-affc-4a056a446088 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:49.309842 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86e8f9-592f-4aae-affc-4a056a446088 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:49.314944 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 484/995] 10.222.0.110 () {56 vars in 1117 bytes} [Thu May 26 16:29:49 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:49.320591 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86e8f9-592f-4aae-affc-4a056a446088 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:49.330748 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 512/996] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:49 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:49.354158 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082c280-d4c1-4a9c-b4c8-3997fa1b1793 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:49.429038 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86e8f9-592f-4aae-affc-4a056a446088 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:49.466363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038afa0a-6597-4db8-a498-8753a3fa95f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:49.467067 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038afa0a-6597-4db8-a498-8753a3fa95f1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:49.467439 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038afa0a-6597-4db8-a498-8753a3fa95f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:49.467725 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038afa0a-6597-4db8-a498-8753a3fa95f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:49.469126 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038afa0a-6597-4db8-a498-8753a3fa95f1 None admin] RBAC: Adding query filter params (interface=public, service_id=0f082acf63bd45a89a8604a5c372366a, region_id=RegionOne) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:49.469442 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038afa0a-6597-4db8-a498-8753a3fa95f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:49.472670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082c280-d4c1-4a9c-b4c8-3997fa1b1793 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:49.473089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038afa0a-6597-4db8-a498-8753a3fa95f1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:49.475971 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:49.482803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 485/997] 10.222.0.110 () {56 vars in 1256 bytes} [Thu May 26 16:29:49 2022] GET /identity/v3/endpoints?service_id=0f082acf63bd45a89a8604a5c372366a&interface=public®ion_id=RegionOne => generated 195 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:49.485217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038afa0a-6597-4db8-a498-8753a3fa95f1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:49.513144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19fb32-6d84-4a00-b81f-da2d31a5684b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:49.513961 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19fb32-6d84-4a00-b81f-da2d31a5684b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:49.514335 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19fb32-6d84-4a00-b81f-da2d31a5684b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:49.514807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19fb32-6d84-4a00-b81f-da2d31a5684b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:49.515557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19fb32-6d84-4a00-b81f-da2d31a5684b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:49.517065 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19fb32-6d84-4a00-b81f-da2d31a5684b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:49.529366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-0c19fb32-6d84-4a00-b81f-da2d31a5684b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:29:49.529366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:49.529366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:49.529366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:49.529366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:49.529366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:49.529366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:49.529366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:49.529366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:29:49.529366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:49.529366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:49.529366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:49.529366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:49.529366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:49.529366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:49.529366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:49.529366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:49.530413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:49.530413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:49.530413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:49.530413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:49.530413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:49.530413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:49.530413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:49.530413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:49.530413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:49.530413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:49.530413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:49.530413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:49.530413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:49.530413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:49.530413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:49.530413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:49.531295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:49.531295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:49.531295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:49.531295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:49.531295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:49.531295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:49.531295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:49.531295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:49.531295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:49.531295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:49.531295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:49.531295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:49.531295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:29:49.531295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:49.531295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 513/998] 10.222.0.110 () {56 vars in 1131 bytes} [Thu May 26 16:29:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:49.536938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19fb32-6d84-4a00-b81f-da2d31a5684b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:49.582341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:49.596959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038afa0a-6597-4db8-a498-8753a3fa95f1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:49.636064 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f5073-487e-44c5-814e-e5a5c44dc9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:49.636740 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f5073-487e-44c5-814e-e5a5c44dc9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:49.637024 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f5073-487e-44c5-814e-e5a5c44dc9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:49.637299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f5073-487e-44c5-814e-e5a5c44dc9c8 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:49.637965 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f5073-487e-44c5-814e-e5a5c44dc9c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:49.639358 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f5073-487e-44c5-814e-e5a5c44dc9c8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:49.658596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 486/999] 10.222.0.110 () {56 vars in 1092 bytes} [Thu May 26 16:29:49 2022] GET /identity/v3/services => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:29:49.658852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19fb32-6d84-4a00-b81f-da2d31a5684b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:49.688890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95df4a-1ae8-408f-bc47-0a99d7a814fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:49.689592 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95df4a-1ae8-408f-bc47-0a99d7a814fc None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:49.689878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95df4a-1ae8-408f-bc47-0a99d7a814fc None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:49.690156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95df4a-1ae8-408f-bc47-0a99d7a814fc None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:49.690912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95df4a-1ae8-408f-bc47-0a99d7a814fc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:49.691229 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95df4a-1ae8-408f-bc47-0a99d7a814fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:49.692626 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95df4a-1ae8-408f-bc47-0a99d7a814fc None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:49.702677 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 514/1000] 10.222.0.110 () {56 vars in 1127 bytes} [Thu May 26 16:29:49 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:49.705204 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f5073-487e-44c5-814e-e5a5c44dc9c8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:49.775712 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:49.818309 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f5073-487e-44c5-814e-e5a5c44dc9c8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:49.859280 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9ef28-0a31-452c-aa96-207a3c5e8f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:49.859969 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9ef28-0a31-452c-aa96-207a3c5e8f18 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:49.860281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9ef28-0a31-452c-aa96-207a3c5e8f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:49.860529 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9ef28-0a31-452c-aa96-207a3c5e8f18 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:49.861245 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9ef28-0a31-452c-aa96-207a3c5e8f18 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:49.861550 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9ef28-0a31-452c-aa96-207a3c5e8f18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:49.862951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9ef28-0a31-452c-aa96-207a3c5e8f18 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:49.868597 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 487/1001] 10.222.0.110 () {56 vars in 1127 bytes} [Thu May 26 16:29:49 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:49.875068 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95df4a-1ae8-408f-bc47-0a99d7a814fc None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:49.980658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95df4a-1ae8-408f-bc47-0a99d7a814fc None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:49.982376 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:50.017461 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f1f67-799b-49cd-b578-1cc1ffc8f8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:50.018116 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f1f67-799b-49cd-b578-1cc1ffc8f8bc None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:50.018402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f1f67-799b-49cd-b578-1cc1ffc8f8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:50.018707 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f1f67-799b-49cd-b578-1cc1ffc8f8bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:50.019451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f1f67-799b-49cd-b578-1cc1ffc8f8bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:50.020836 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f1f67-799b-49cd-b578-1cc1ffc8f8bc None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:50.032657 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df158ed-35eb-4150-b53c-8a5c00d75bc9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:50.033163 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df158ed-35eb-4150-b53c-8a5c00d75bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:50.033497 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df158ed-35eb-4150-b53c-8a5c00d75bc9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:50.034947 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 488/1002] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:50 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:50.036727 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 515/1003] 10.222.0.110 () {60 vars in 1149 bytes} [Thu May 26 16:29:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:29:50.040363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5eef4-7028-482a-97e9-24b38c4daf36 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:50.040654 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5eef4-7028-482a-97e9-24b38c4daf36 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:50.040931 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5eef4-7028-482a-97e9-24b38c4daf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:50.059796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cfd5eef4-7028-482a-97e9-24b38c4daf36 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:50.061021 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cfd5eef4-7028-482a-97e9-24b38c4daf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:50.146226 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 489/1004] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:50 2022] POST /identity/v3/auth/tokens => generated 1710 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:50.168708 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f1f67-799b-49cd-b578-1cc1ffc8f8bc None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:50.278201 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f1f67-799b-49cd-b578-1cc1ffc8f8bc None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:50.312375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f9d75-92c4-4977-8bb8-6fd857dd6a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:50.313097 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f9d75-92c4-4977-8bb8-6fd857dd6a87 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:50.313380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f9d75-92c4-4977-8bb8-6fd857dd6a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:50.313660 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f9d75-92c4-4977-8bb8-6fd857dd6a87 None admin] PATH_INFO: `/v3/services/image` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:50.314315 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f9d75-92c4-4977-8bb8-6fd857dd6a87 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:50.315725 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f9d75-92c4-4977-8bb8-6fd857dd6a87 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:50.327563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-600f9d75-92c4-4977-8bb8-6fd857dd6a87 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:29:50.327563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:50.327563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:50.327563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:50.327563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:50.327563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:50.327563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:50.327563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:50.327563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:29:50.327563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:50.327563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:50.327563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:50.327563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:50.327563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:50.327563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:50.327563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:50.327563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:50.328809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:50.328809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:50.328809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:50.328809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:50.328809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:50.328809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:50.328809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:50.328809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:50.328809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:50.328809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:50.328809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:50.328809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:50.328809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:50.328809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:50.328809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:50.328809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:50.329659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:50.329659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:50.329659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:50.329659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:50.329659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:50.329659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:50.329659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:50.329659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:50.329659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:50.329659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:50.329659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:50.329659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:50.329659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:29:50.329659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:50.329659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 516/1005] 10.222.0.110 () {56 vars in 1110 bytes} [Thu May 26 16:29:50 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:50.335518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5eef4-7028-482a-97e9-24b38c4daf36 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:50.399458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:50.446806 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5eef4-7028-482a-97e9-24b38c4daf36 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:50.481534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf9738-354f-4e49-8935-446580ea9527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:50.482207 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9738-354f-4e49-8935-446580ea9527 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:50.482495 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9738-354f-4e49-8935-446580ea9527 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:50.482811 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9738-354f-4e49-8935-446580ea9527 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:50.484033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf9738-354f-4e49-8935-446580ea9527 None admin] RBAC: Adding query filter params (name=image) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:50.484345 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf9738-354f-4e49-8935-446580ea9527 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:50.485716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf9738-354f-4e49-8935-446580ea9527 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:50.495319 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 490/1006] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:50 2022] GET /identity/v3/services?name=image => generated 123 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:50.497074 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f9d75-92c4-4977-8bb8-6fd857dd6a87 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:50.526260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:50.602227 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f9d75-92c4-4977-8bb8-6fd857dd6a87 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:50.635802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e765eb-8a8b-4853-b513-79f67469e165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:50.636475 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e765eb-8a8b-4853-b513-79f67469e165 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:50.636762 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e765eb-8a8b-4853-b513-79f67469e165 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:50.637045 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e765eb-8a8b-4853-b513-79f67469e165 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:50.637744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e765eb-8a8b-4853-b513-79f67469e165 None admin] RBAC: Adding query filter params (type=image) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:50.638061 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e765eb-8a8b-4853-b513-79f67469e165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:50.639454 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e765eb-8a8b-4853-b513-79f67469e165 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:50.650903 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 517/1007] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:50 2022] GET /identity/v3/services?type=image => generated 123 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:51.882497 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2be533-83c3-4adf-a34a-b9e46722a98d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:51.883047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2be533-83c3-4adf-a34a-b9e46722a98d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:51.883126 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2be533-83c3-4adf-a34a-b9e46722a98d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:51.884606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 491/1008] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:51.890109 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86a6da-3b78-43ea-9987-40f7ebeaf687 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:51.890533 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86a6da-3b78-43ea-9987-40f7ebeaf687 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:51.890754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86a6da-3b78-43ea-9987-40f7ebeaf687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:51.907256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0b86a6da-3b78-43ea-9987-40f7ebeaf687 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:51.908426 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0b86a6da-3b78-43ea-9987-40f7ebeaf687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:51.975218 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 518/1009] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:51 2022] POST /identity/v3/auth/tokens => generated 1710 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:51.998260 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2be533-83c3-4adf-a34a-b9e46722a98d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:52.099359 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2be533-83c3-4adf-a34a-b9e46722a98d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:52.118813 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:52.140181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9302fd-e604-4a2f-96fc-d6c518bd80dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:52.140969 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9302fd-e604-4a2f-96fc-d6c518bd80dc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.141256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9302fd-e604-4a2f-96fc-d6c518bd80dc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.141530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9302fd-e604-4a2f-96fc-d6c518bd80dc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.142185 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9302fd-e604-4a2f-96fc-d6c518bd80dc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:52.143595 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9302fd-e604-4a2f-96fc-d6c518bd80dc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:52.156400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-cc9302fd-e604-4a2f-96fc-d6c518bd80dc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:29:52.156400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:52.156400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:52.156400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:52.156400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:52.156400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:52.156400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:52.156400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:52.156400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:29:52.156400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:52.156400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:52.156400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:52.156400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:52.156400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:52.156400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:52.156400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:52.156400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:52.157408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:52.157408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:52.157408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:52.157408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:52.157408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:52.157408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:52.157408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:52.157408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:52.157408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:52.157408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:52.157408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:52.157408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:52.157408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:52.157408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:52.157408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:52.157408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:52.158240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:52.158240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:52.158240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:52.158240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:52.158240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:52.158240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:52.158240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:52.158240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:52.158240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:52.158240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:52.158240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:52.158240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:52.158240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:29:52.158240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:52.159797 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 492/1010] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:52.163601 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86a6da-3b78-43ea-9987-40f7ebeaf687 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:52.184963 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:52.264131 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86a6da-3b78-43ea-9987-40f7ebeaf687 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:52.298712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e9ec1-b68f-4f3e-ac3f-113714394925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:52.299381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e9ec1-b68f-4f3e-ac3f-113714394925 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.299666 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e9ec1-b68f-4f3e-ac3f-113714394925 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.299942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e9ec1-b68f-4f3e-ac3f-113714394925 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.300646 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e9ec1-b68f-4f3e-ac3f-113714394925 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:52.300953 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e9ec1-b68f-4f3e-ac3f-113714394925 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:52.302322 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e9ec1-b68f-4f3e-ac3f-113714394925 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:52.312355 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 519/1011] 10.222.0.110 () {56 vars in 1117 bytes} [Thu May 26 16:29:52 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:52.312516 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebc272-df53-45b6-9ca3-165fb88718a0 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.312516 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebc272-df53-45b6-9ca3-165fb88718a0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.312516 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebc272-df53-45b6-9ca3-165fb88718a0 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.313644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 493/1012] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:52.314095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e9ec1-b68f-4f3e-ac3f-113714394925 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:52.318504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c3a32-a249-4356-8d07-a97db1a47de6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.318847 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c3a32-a249-4356-8d07-a97db1a47de6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.319129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c3a32-a249-4356-8d07-a97db1a47de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.337062 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8b2c3a32-a249-4356-8d07-a97db1a47de6 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:52.338446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8b2c3a32-a249-4356-8d07-a97db1a47de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:52.409169 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:52.417421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 494/1013] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:52 2022] POST /identity/v3/auth/tokens => generated 1710 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:29:52.431626 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e9ec1-b68f-4f3e-ac3f-113714394925 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:52.440696 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c3a32-a249-4356-8d07-a97db1a47de6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:52.475741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238462b8-3192-4ee1-aeb8-292f80666189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:52.477750 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238462b8-3192-4ee1-aeb8-292f80666189 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.478199 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238462b8-3192-4ee1-aeb8-292f80666189 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.478674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238462b8-3192-4ee1-aeb8-292f80666189 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.479535 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238462b8-3192-4ee1-aeb8-292f80666189 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:52.480015 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238462b8-3192-4ee1-aeb8-292f80666189 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:52.481546 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238462b8-3192-4ee1-aeb8-292f80666189 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:52.488757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 520/1014] 10.222.0.110 () {56 vars in 1117 bytes} [Thu May 26 16:29:52 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:52.494633 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238462b8-3192-4ee1-aeb8-292f80666189 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:52.551731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c3a32-a249-4356-8d07-a97db1a47de6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:52.566543 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:52.592817 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5702f0-8b6d-4588-9dfc-02e4b120481e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:52.593757 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5702f0-8b6d-4588-9dfc-02e4b120481e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.594108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5702f0-8b6d-4588-9dfc-02e4b120481e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.594389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5702f0-8b6d-4588-9dfc-02e4b120481e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.595582 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5702f0-8b6d-4588-9dfc-02e4b120481e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:52.597216 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5702f0-8b6d-4588-9dfc-02e4b120481e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:52.599522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238462b8-3192-4ee1-aeb8-292f80666189 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:52.602890 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 495/1015] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:52 2022] GET /identity/v3/domains/default => generated 200 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:52.604295 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5702f0-8b6d-4588-9dfc-02e4b120481e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:52.638416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4fd2a-91e3-42ad-8f3b-e6e929ac5ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:52.639212 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4fd2a-91e3-42ad-8f3b-e6e929ac5ed8 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.640144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4fd2a-91e3-42ad-8f3b-e6e929ac5ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.640428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4fd2a-91e3-42ad-8f3b-e6e929ac5ed8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.641188 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4fd2a-91e3-42ad-8f3b-e6e929ac5ed8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:52.642661 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4fd2a-91e3-42ad-8f3b-e6e929ac5ed8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:52.666051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 521/1016] 10.222.0.110 () {60 vars in 1149 bytes} [Thu May 26 16:29:52 2022] POST /identity/v3/endpoints => generated 336 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:29:52.720813 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5702f0-8b6d-4588-9dfc-02e4b120481e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:52.766813 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300cb9b-d8ef-4263-9b17-73d084de7e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:52.767507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300cb9b-d8ef-4263-9b17-73d084de7e76 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.767794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300cb9b-d8ef-4263-9b17-73d084de7e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.768075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300cb9b-d8ef-4263-9b17-73d084de7e76 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.768792 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300cb9b-d8ef-4263-9b17-73d084de7e76 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:52.770251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300cb9b-d8ef-4263-9b17-73d084de7e76 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:52.806668 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 496/1017] 10.222.0.110 () {60 vars in 1146 bytes} [Thu May 26 16:29:52 2022] POST /identity/v3/projects => generated 312 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:29:52.851604 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8901eb-94fe-4d55-8d81-4aaeed0c68c4 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.851885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8901eb-94fe-4d55-8d81-4aaeed0c68c4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.852172 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8901eb-94fe-4d55-8d81-4aaeed0c68c4 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.853804 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 522/1018] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:52.860072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d4c43-104f-4739-b320-05d6f80ff6fd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.860442 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d4c43-104f-4739-b320-05d6f80ff6fd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.860646 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d4c43-104f-4739-b320-05d6f80ff6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.879537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3e9d4c43-104f-4739-b320-05d6f80ff6fd None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:52.880824 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3e9d4c43-104f-4739-b320-05d6f80ff6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:52.909304 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:52.964000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 497/1019] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:52 2022] POST /identity/v3/auth/tokens => generated 1867 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:52.988180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8901eb-94fe-4d55-8d81-4aaeed0c68c4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:52.992367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:53.099660 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8901eb-94fe-4d55-8d81-4aaeed0c68c4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:53.135631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629ce3f-0800-4243-8889-8759872fb6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:53.136312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629ce3f-0800-4243-8889-8759872fb6d7 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:53.136602 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629ce3f-0800-4243-8889-8759872fb6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:53.136883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629ce3f-0800-4243-8889-8759872fb6d7 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:53.137612 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629ce3f-0800-4243-8889-8759872fb6d7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:53.139020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629ce3f-0800-4243-8889-8759872fb6d7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:53.153172 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 523/1020] 10.222.0.110 () {60 vars in 1146 bytes} [Thu May 26 16:29:52 2022] POST /identity/v3/services => generated 243 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:29:54.995891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb623262-8630-4f7a-9258-59eb12cea24b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:54.996729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb623262-8630-4f7a-9258-59eb12cea24b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:54.996729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb623262-8630-4f7a-9258-59eb12cea24b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:54.998267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 498/1021] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:29:55.003581 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd1c51-18a4-4e70-bee5-e77bb78a6b88 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:55.004020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd1c51-18a4-4e70-bee5-e77bb78a6b88 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:55.004193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd1c51-18a4-4e70-bee5-e77bb78a6b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.021454 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c1bd1c51-18a4-4e70-bee5-e77bb78a6b88 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:55.022651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c1bd1c51-18a4-4e70-bee5-e77bb78a6b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:55.082716 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:55.090955 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa268ce6-bdd8-4cf1-9721-461b0d76656b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:55.091251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa268ce6-bdd8-4cf1-9721-461b0d76656b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:55.091567 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa268ce6-bdd8-4cf1-9721-461b0d76656b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.093538 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 499/1022] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:29:55.098512 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e62a8-6108-41d2-a730-9098f7459dee None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:55.098827 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e62a8-6108-41d2-a730-9098f7459dee None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:55.099107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e62a8-6108-41d2-a730-9098f7459dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.103187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 524/1023] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:55 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:55.117649 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5c3e62a8-6108-41d2-a730-9098f7459dee None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:55.118865 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5c3e62a8-6108-41d2-a730-9098f7459dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:55.126987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd1c51-18a4-4e70-bee5-e77bb78a6b88 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:55.194617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 500/1024] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:55 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:55.218181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e62a8-6108-41d2-a730-9098f7459dee None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:55.235544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd1c51-18a4-4e70-bee5-e77bb78a6b88 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:55.276270 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa2787-c298-409c-b6e3-5edcb7c1c407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:55.277012 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa2787-c298-409c-b6e3-5edcb7c1c407 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:55.277301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa2787-c298-409c-b6e3-5edcb7c1c407 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:55.277580 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa2787-c298-409c-b6e3-5edcb7c1c407 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.289001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa2787-c298-409c-b6e3-5edcb7c1c407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:55.297287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-45aa2787-c298-409c-b6e3-5edcb7c1c407 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:29:55.297287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:55.297287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:55.297287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:55.297287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:55.297287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:55.297287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:55.297287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:55.297287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:55.297287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:55.297287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:55.297287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:55.297287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:55.297287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:55.297287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:55.297287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:55.298244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:55.298244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:55.298244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:55.298244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:55.298244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:55.298244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:55.298244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:55.298244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:55.298244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:55.298244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:55.298244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:55.298244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:55.298244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:55.298244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:55.298244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:55.298244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:55.300090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:55.300090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:55.300090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:55.300090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:55.300090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:55.300090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:55.300090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:55.300090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:55.300090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:55.300090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:55.300090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:29:55.300090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:55.300090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 525/1025] 10.222.0.110 () {56 vars in 1125 bytes} [Thu May 26 16:29:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:55.304310 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa2787-c298-409c-b6e3-5edcb7c1c407 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:55.313453 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:55.327407 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e62a8-6108-41d2-a730-9098f7459dee None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:55.358730 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:55.365436 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaab2ce-bb16-4861-b2d6-d7607190ae11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:55.366249 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab2ce-bb16-4861-b2d6-d7607190ae11 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:55.366534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab2ce-bb16-4861-b2d6-d7607190ae11 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:55.366841 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab2ce-bb16-4861-b2d6-d7607190ae11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.368026 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaab2ce-bb16-4861-b2d6-d7607190ae11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:55.369461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaab2ce-bb16-4861-b2d6-d7607190ae11 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:55.371690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 501/1026] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:55 2022] GET /identity/v3/domains/default => generated 200 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:55.372900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc91302-3eec-4077-9b2f-1c80079d0a4c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:55.373197 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc91302-3eec-4077-9b2f-1c80079d0a4c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:55.373992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc91302-3eec-4077-9b2f-1c80079d0a4c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.375264 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 502/1027] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:55.377401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc91302-3eec-4077-9b2f-1c80079d0a4c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:55.415430 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa2787-c298-409c-b6e3-5edcb7c1c407 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:55.450207 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268974b-d75c-486b-aa09-04cf543059d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:55.450919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268974b-d75c-486b-aa09-04cf543059d7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:55.451335 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268974b-d75c-486b-aa09-04cf543059d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:55.451862 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268974b-d75c-486b-aa09-04cf543059d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.452523 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268974b-d75c-486b-aa09-04cf543059d7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:55.452834 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268974b-d75c-486b-aa09-04cf543059d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:55.454210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268974b-d75c-486b-aa09-04cf543059d7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:55.462325 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 526/1028] 10.222.0.110 () {56 vars in 1120 bytes} [Thu May 26 16:29:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:55.463760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abd626-f4c4-4d98-a0c1-9c788ba7a11f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:55.464057 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abd626-f4c4-4d98-a0c1-9c788ba7a11f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:55.464338 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abd626-f4c4-4d98-a0c1-9c788ba7a11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.481689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c3abd626-f4c4-4d98-a0c1-9c788ba7a11f None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:55.483034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c3abd626-f4c4-4d98-a0c1-9c788ba7a11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:55.484452 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc91302-3eec-4077-9b2f-1c80079d0a4c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:55.521172 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460919ac-b7ad-4237-9414-52552e741815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:55.521845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460919ac-b7ad-4237-9414-52552e741815 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:55.522132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460919ac-b7ad-4237-9414-52552e741815 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:55.522409 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460919ac-b7ad-4237-9414-52552e741815 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.523148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460919ac-b7ad-4237-9414-52552e741815 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:55.524563 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460919ac-b7ad-4237-9414-52552e741815 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:55.544163 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 503/1029] 10.222.0.110 () {60 vars in 1137 bytes} [Thu May 26 16:29:55 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:29:55.545166 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460919ac-b7ad-4237-9414-52552e741815 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:55.562293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 527/1030] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:55 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:55.563281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:55.586370 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abd626-f4c4-4d98-a0c1-9c788ba7a11f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:55.638393 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:55.669949 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460919ac-b7ad-4237-9414-52552e741815 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:55.703810 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abd626-f4c4-4d98-a0c1-9c788ba7a11f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:55.708203 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0929b-09ba-4333-83b8-82997b407ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:55.709076 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0929b-09ba-4333-83b8-82997b407ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:55.709366 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0929b-09ba-4333-83b8-82997b407ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:55.709645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0929b-09ba-4333-83b8-82997b407ab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.722007 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0929b-09ba-4333-83b8-82997b407ab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:55.723511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0929b-09ba-4333-83b8-82997b407ab4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:55.743082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca657e2-a22b-4fe7-a3f1-6d0314323219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:55.743885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca657e2-a22b-4fe7-a3f1-6d0314323219 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:55.744014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-86d0929b-09ba-4333-83b8-82997b407ab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:55.744014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:55.744014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:55.744014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:55.744014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:55.744014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:55.744014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:55.744014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:55.744014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:55.744014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:55.744014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:55.744014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:55.744014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:55.744014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:55.744014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:55.744832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:55.744832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:55.744832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:55.744832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:55.744832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:55.744832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:55.744832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:55.744832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:55.744832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:55.744832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:55.744832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:55.744832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:55.744832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:55.744832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:55.744832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:55.744832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:55.744832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:55.745723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:55.745723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:55.745723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:55.745723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:55.745942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca657e2-a22b-4fe7-a3f1-6d0314323219 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:55.745942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca657e2-a22b-4fe7-a3f1-6d0314323219 None admin] PATH_INFO: `/v3/services/image` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.745942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca657e2-a22b-4fe7-a3f1-6d0314323219 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:55.746138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 504/1031] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:55.747339 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca657e2-a22b-4fe7-a3f1-6d0314323219 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:55.751981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0929b-09ba-4333-83b8-82997b407ab4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:55.763129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-1ca657e2-a22b-4fe7-a3f1-6d0314323219 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:29:55.763129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:55.763129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:55.763129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:55.763129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:55.763129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:55.763129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:55.763129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:55.763129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:29:55.763129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:55.763129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:55.763129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:55.763129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:55.763129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:55.763129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:55.763129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:55.763129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:55.764162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:55.764162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:55.764162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:55.764162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:55.764162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:55.764162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:55.764162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:55.764162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:55.764162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:55.764162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:55.764162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:55.764162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:55.764162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:55.764162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:55.764162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:55.764162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:55.765001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:55.765001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:55.765001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:55.765001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:55.765001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:55.765001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:55.765001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:55.765001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:55.765001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:55.765001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:55.765001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:55.765001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:55.765001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:29:55.765001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:55.765001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 528/1032] 10.222.0.110 () {56 vars in 1110 bytes} [Thu May 26 16:29:55 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:55.771517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca657e2-a22b-4fe7-a3f1-6d0314323219 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:55.824866 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:55.864575 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0929b-09ba-4333-83b8-82997b407ab4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:55.890336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca657e2-a22b-4fe7-a3f1-6d0314323219 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:55.898138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:55.899314 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c9355-0d56-4f6e-b9b9-f8e915c7ac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:55.899999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c9355-0d56-4f6e-b9b9-f8e915c7ac88 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:55.900485 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c9355-0d56-4f6e-b9b9-f8e915c7ac88 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:55.900607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c9355-0d56-4f6e-b9b9-f8e915c7ac88 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.901324 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c9355-0d56-4f6e-b9b9-f8e915c7ac88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:55.901672 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c9355-0d56-4f6e-b9b9-f8e915c7ac88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:55.903169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c9355-0d56-4f6e-b9b9-f8e915c7ac88 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:55.916547 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 505/1033] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:55.922426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c9355-0d56-4f6e-b9b9-f8e915c7ac88 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:55.931260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414f1fd-7892-4394-aef1-e37279350880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:55.931941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414f1fd-7892-4394-aef1-e37279350880 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:55.932231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414f1fd-7892-4394-aef1-e37279350880 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:55.932515 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414f1fd-7892-4394-aef1-e37279350880 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.933224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414f1fd-7892-4394-aef1-e37279350880 None admin] RBAC: Adding query filter params (name=image) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:55.933547 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414f1fd-7892-4394-aef1-e37279350880 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:55.934938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414f1fd-7892-4394-aef1-e37279350880 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:55.945805 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 529/1034] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:55 2022] GET /identity/v3/services?name=image => generated 123 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:55.946852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414f1fd-7892-4394-aef1-e37279350880 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:56.034806 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c9355-0d56-4f6e-b9b9-f8e915c7ac88 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:56.054532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414f1fd-7892-4394-aef1-e37279350880 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:56.059595 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:56.071143 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d34830-a296-4597-806d-a270e4624ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:56.071947 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d34830-a296-4597-806d-a270e4624ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:56.072225 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d34830-a296-4597-806d-a270e4624ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:56.072501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d34830-a296-4597-806d-a270e4624ea9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:56.079939 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d34830-a296-4597-806d-a270e4624ea9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:56.081319 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d34830-a296-4597-806d-a270e4624ea9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:56.094696 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08692f41-9741-4ab7-b23a-0013c6047439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:56.095374 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08692f41-9741-4ab7-b23a-0013c6047439 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:56.095663 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08692f41-9741-4ab7-b23a-0013c6047439 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:56.095944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08692f41-9741-4ab7-b23a-0013c6047439 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:56.096656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08692f41-9741-4ab7-b23a-0013c6047439 None admin] RBAC: Adding query filter params (type=image) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:56.096966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08692f41-9741-4ab7-b23a-0013c6047439 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:56.098331 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08692f41-9741-4ab7-b23a-0013c6047439 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:56.099783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c4d34830-a296-4597-806d-a270e4624ea9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:56.099783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:56.099783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:56.099783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:56.099783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:56.099783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:56.099783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:56.099783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:56.099783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:56.099783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:56.099783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:56.099783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:56.099783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:56.099783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:56.099783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:56.099783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:56.100717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:56.100717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:56.100717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:56.100717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:56.100717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:56.100717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:56.100717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:56.100717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:56.100717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:56.100717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:56.100717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:56.100717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:56.100717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:56.100717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:56.100717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:56.100717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:56.100717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:56.100717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:56.101676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:56.101676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:56.101676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:56.101676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:56.101676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:56.101676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:56.101676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:56.101676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:56.101676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:56.101676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:56.101676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 506/1035] 10.222.0.110 () {56 vars in 1098 bytes} [Thu May 26 16:29:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:56.106610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 530/1036] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:55 2022] GET /identity/v3/services?type=image => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:56.106914 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d34830-a296-4597-806d-a270e4624ea9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:56.111797 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08692f41-9741-4ab7-b23a-0013c6047439 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:56.149587 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:56.223138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d34830-a296-4597-806d-a270e4624ea9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:56.223384 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08692f41-9741-4ab7-b23a-0013c6047439 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:56.260510 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816b0e7-1026-450f-9aa5-14e810b3be8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:56.260714 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691373a-43eb-426c-ae0b-5454e09d9751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:56.261185 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691373a-43eb-426c-ae0b-5454e09d9751 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:56.261293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816b0e7-1026-450f-9aa5-14e810b3be8d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:56.261475 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816b0e7-1026-450f-9aa5-14e810b3be8d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:56.261571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691373a-43eb-426c-ae0b-5454e09d9751 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:56.261741 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816b0e7-1026-450f-9aa5-14e810b3be8d None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:56.261841 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691373a-43eb-426c-ae0b-5454e09d9751 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:56.262526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691373a-43eb-426c-ae0b-5454e09d9751 None admin] RBAC: Adding query filter params (interface=public, service_id=57c010b619654f8699b5b4d6da6554c7, region_id=RegionOne) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:56.262663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816b0e7-1026-450f-9aa5-14e810b3be8d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:56.262879 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691373a-43eb-426c-ae0b-5454e09d9751 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:56.262978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816b0e7-1026-450f-9aa5-14e810b3be8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:56.264373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691373a-43eb-426c-ae0b-5454e09d9751 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:56.264483 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816b0e7-1026-450f-9aa5-14e810b3be8d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:56.275172 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 531/1037] 10.222.0.110 () {56 vars in 1256 bytes} [Thu May 26 16:29:56 2022] GET /identity/v3/endpoints?service_id=57c010b619654f8699b5b4d6da6554c7&interface=public®ion_id=RegionOne => generated 195 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:56.276088 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691373a-43eb-426c-ae0b-5454e09d9751 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:56.282703 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 507/1038] 10.222.0.110 () {56 vars in 1138 bytes} [Thu May 26 16:29:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:56.288454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816b0e7-1026-450f-9aa5-14e810b3be8d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:56.333126 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:56.395327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:56.399690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816b0e7-1026-450f-9aa5-14e810b3be8d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:56.399843 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691373a-43eb-426c-ae0b-5454e09d9751 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:56.435760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944c627-732d-4966-9cc2-032aef081124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:56.436480 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944c627-732d-4966-9cc2-032aef081124 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:56.436770 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944c627-732d-4966-9cc2-032aef081124 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:56.437052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944c627-732d-4966-9cc2-032aef081124 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:56.437740 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944c627-732d-4966-9cc2-032aef081124 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:56.439062 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a876c7-cb6a-452e-9b7d-361c530721d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:56.439198 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944c627-732d-4966-9cc2-032aef081124 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:56.439727 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a876c7-cb6a-452e-9b7d-361c530721d2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:56.440020 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a876c7-cb6a-452e-9b7d-361c530721d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:56.440457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a876c7-cb6a-452e-9b7d-361c530721d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:56.454838 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 532/1039] 10.222.0.110 () {56 vars in 1092 bytes} [Thu May 26 16:29:56 2022] GET /identity/v3/services => generated 1966 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:29:56.523496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a876c7-cb6a-452e-9b7d-361c530721d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:56.524985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a876c7-cb6a-452e-9b7d-361c530721d2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:56.570596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:56.637105 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 508/1040] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:29:56 2022] GET /identity/v3/auth/tokens => generated 1963 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 16:29:56.644356 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944c627-732d-4966-9cc2-032aef081124 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:56.748952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944c627-732d-4966-9cc2-032aef081124 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:56.784101 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39590882-87ce-4ce1-86bc-5a8b74f1782a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:56.785190 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39590882-87ce-4ce1-86bc-5a8b74f1782a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:56.785624 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39590882-87ce-4ce1-86bc-5a8b74f1782a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:56.786047 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39590882-87ce-4ce1-86bc-5a8b74f1782a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:56.797129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39590882-87ce-4ce1-86bc-5a8b74f1782a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:56.798794 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39590882-87ce-4ce1-86bc-5a8b74f1782a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:56.816796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-39590882-87ce-4ce1-86bc-5a8b74f1782a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:56.816796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:56.816796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:56.816796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:56.816796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:56.816796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:56.816796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:56.816796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:56.816796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:56.816796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:56.816796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:56.816796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:56.816796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:56.816796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:56.816796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:56.817802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:56.817802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:56.817802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:56.817802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:56.817802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:56.817802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:56.817802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:56.817802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:56.817802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:56.817802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:56.817802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:56.817802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:56.817802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:56.817802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:56.817802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:56.817802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:56.817802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:56.818742 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:56.818742 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:56.818742 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:56.818742 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:56.818966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 533/1041] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:56.824887 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a876c7-cb6a-452e-9b7d-361c530721d2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:56.925863 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a876c7-cb6a-452e-9b7d-361c530721d2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:56.962966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f337ea-2f43-48d1-9171-db2102249a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:56.963931 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f337ea-2f43-48d1-9171-db2102249a8f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:56.964399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f337ea-2f43-48d1-9171-db2102249a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:56.964883 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f337ea-2f43-48d1-9171-db2102249a8f None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:56.965781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f337ea-2f43-48d1-9171-db2102249a8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:56.966269 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f337ea-2f43-48d1-9171-db2102249a8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:56.968435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f337ea-2f43-48d1-9171-db2102249a8f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:56.980538 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 509/1042] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:29:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:56.987016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39590882-87ce-4ce1-86bc-5a8b74f1782a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:57.004277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:57.091955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39590882-87ce-4ce1-86bc-5a8b74f1782a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:57.127058 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958f05d-14ab-4146-94a4-0b00f5996c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:57.127853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958f05d-14ab-4146-94a4-0b00f5996c42 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:57.128137 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958f05d-14ab-4146-94a4-0b00f5996c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:57.128411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958f05d-14ab-4146-94a4-0b00f5996c42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:57.135362 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958f05d-14ab-4146-94a4-0b00f5996c42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:57.136967 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958f05d-14ab-4146-94a4-0b00f5996c42 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:57.152976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-3958f05d-14ab-4146-94a4-0b00f5996c42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:57.152976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:57.152976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:57.152976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:57.152976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:57.152976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:57.152976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:57.152976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:57.152976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:57.152976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:57.152976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:57.152976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:57.152976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:57.152976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:57.152976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:57.153931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:57.153931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:57.153931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:57.153931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:57.153931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:57.153931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:57.153931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:57.153931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:57.153931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:29:57.153931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:57.153931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:57.153931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:57.153931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:57.153931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:57.153931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:57.153931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:57.153931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:57.155000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:57.155000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:57.155000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:57.155000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:57.155000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:57.155000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:57.155000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:57.155000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:29:57.158629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 534/1043] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:29:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:57.160561 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f337ea-2f43-48d1-9171-db2102249a8f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:57.163592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:57.263270 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f337ea-2f43-48d1-9171-db2102249a8f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:57.297926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac745ca-51c6-4040-822b-0e4b8cab3fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:57.298615 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac745ca-51c6-4040-822b-0e4b8cab3fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:57.298900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac745ca-51c6-4040-822b-0e4b8cab3fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:57.299173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac745ca-51c6-4040-822b-0e4b8cab3fb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:57.299946 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac745ca-51c6-4040-822b-0e4b8cab3fb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:57.300253 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac745ca-51c6-4040-822b-0e4b8cab3fb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:57.301670 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac745ca-51c6-4040-822b-0e4b8cab3fb2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:57.314002 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 510/1044] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:29:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:57.319840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958f05d-14ab-4146-94a4-0b00f5996c42 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:57.404301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:57.430735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958f05d-14ab-4146-94a4-0b00f5996c42 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:57.467210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d33fc-4078-49cb-ad52-f03e3b6d9719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:57.467863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d33fc-4078-49cb-ad52-f03e3b6d9719 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:57.468145 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d33fc-4078-49cb-ad52-f03e3b6d9719 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:57.468418 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d33fc-4078-49cb-ad52-f03e3b6d9719 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:57.469239 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d33fc-4078-49cb-ad52-f03e3b6d9719 None admin] RBAC: Adding query filter params (role.id=46e323c1a7614208aaaa8a31c9186f4a, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=0043a7d5877f41de905afe6bef355867) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:57.469547 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d33fc-4078-49cb-ad52-f03e3b6d9719 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:57.471001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d33fc-4078-49cb-ad52-f03e3b6d9719 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:57.482617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 535/1045] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:29:57 2022] GET /identity/v3/role_assignments?user.id=0043a7d5877f41de905afe6bef355867&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=46e323c1a7614208aaaa8a31c9186f4a => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:57.843870 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f452e2-2c93-4f5c-82d4-1f18b75f27d7 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:57.844195 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f452e2-2c93-4f5c-82d4-1f18b75f27d7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:57.844445 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f452e2-2c93-4f5c-82d4-1f18b75f27d7 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:57.845962 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 511/1046] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:57.851106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d7733-e81a-427b-88de-86eab691b949 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:57.851407 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d7733-e81a-427b-88de-86eab691b949 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:57.851690 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d7733-e81a-427b-88de-86eab691b949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:57.868724 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d04d7733-e81a-427b-88de-86eab691b949 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:57.869905 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d04d7733-e81a-427b-88de-86eab691b949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:57.936825 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 536/1047] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:57 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:57.960444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f452e2-2c93-4f5c-82d4-1f18b75f27d7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:58.024465 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:58.065720 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f452e2-2c93-4f5c-82d4-1f18b75f27d7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:58.099269 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae04c3-8ae9-4b47-8b2f-17a555f3f980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:58.100002 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae04c3-8ae9-4b47-8b2f-17a555f3f980 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:58.100291 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae04c3-8ae9-4b47-8b2f-17a555f3f980 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:58.100569 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae04c3-8ae9-4b47-8b2f-17a555f3f980 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:58.111306 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae04c3-8ae9-4b47-8b2f-17a555f3f980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:58.119079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-63ae04c3-8ae9-4b47-8b2f-17a555f3f980 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:58.119079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:58.119079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:58.119079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:58.119079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:58.119079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:58.119079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:58.119079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:58.119079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:58.119079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:58.119079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:58.119079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:58.119079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:58.119079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:58.119079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:58.119079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:58.120017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:58.120017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:58.120017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:58.120017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:58.120017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:58.120017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:58.120017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:58.120017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:58.120017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:58.120017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:58.120017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:58.120017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:58.120017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:58.120017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:58.120017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:58.120017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:58.120884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:58.120884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:58.120884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:58.120884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:58.120884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:58.120884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:58.120884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:58.120884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:58.120884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:58.120884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:58.120884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:58.120884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:58.123060 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 512/1048] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:29:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:58.126547 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d7733-e81a-427b-88de-86eab691b949 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:58.194600 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:58.229012 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d7733-e81a-427b-88de-86eab691b949 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:58.263684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf542bc-591e-4f3c-825e-40e160546819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:58.264388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf542bc-591e-4f3c-825e-40e160546819 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:58.264681 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf542bc-591e-4f3c-825e-40e160546819 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:58.264964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf542bc-591e-4f3c-825e-40e160546819 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:58.265710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf542bc-591e-4f3c-825e-40e160546819 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:58.266024 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf542bc-591e-4f3c-825e-40e160546819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:58.267418 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf542bc-591e-4f3c-825e-40e160546819 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:58.275857 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 537/1049] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:29:58 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:58.282081 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae04c3-8ae9-4b47-8b2f-17a555f3f980 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:58.390664 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae04c3-8ae9-4b47-8b2f-17a555f3f980 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:58.413916 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:58.426233 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca3465-0e7a-4e0f-82be-ea3e0caf4b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:58.427144 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca3465-0e7a-4e0f-82be-ea3e0caf4b1b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:58.427491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca3465-0e7a-4e0f-82be-ea3e0caf4b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:58.427773 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca3465-0e7a-4e0f-82be-ea3e0caf4b1b None admin] PATH_INFO: `/v3/users/e20903a1ab9541ada2bd6b65e3bfc46d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:58.442030 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca3465-0e7a-4e0f-82be-ea3e0caf4b1b None admin] RBAC: Authorizing `identity:get_user(user_id=e20903a1ab9541ada2bd6b65e3bfc46d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:58.443513 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca3465-0e7a-4e0f-82be-ea3e0caf4b1b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:58.449779 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 513/1050] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:29:58 2022] GET /identity/v3/users/e20903a1ab9541ada2bd6b65e3bfc46d => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:58.451026 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf542bc-591e-4f3c-825e-40e160546819 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:58.559485 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf542bc-591e-4f3c-825e-40e160546819 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:58.590079 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:58.597488 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60b4d0-8fa3-4548-b988-a567009e6db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:58.598160 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60b4d0-8fa3-4548-b988-a567009e6db8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:58.598438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60b4d0-8fa3-4548-b988-a567009e6db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:58.598750 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60b4d0-8fa3-4548-b988-a567009e6db8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:58.664046 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e471618-b331-4d13-8e93-08cb59d0bf94 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:58.664317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e471618-b331-4d13-8e93-08cb59d0bf94 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:58.664537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e471618-b331-4d13-8e93-08cb59d0bf94 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:58.666061 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 514/1051] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:29:58.668612 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60b4d0-8fa3-4548-b988-a567009e6db8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:58.670273 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60b4d0-8fa3-4548-b988-a567009e6db8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:58.670794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08b591-e64c-4076-aaba-d1f08bd37f0b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:58.671081 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08b591-e64c-4076-aaba-d1f08bd37f0b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:58.671360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08b591-e64c-4076-aaba-d1f08bd37f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:58.687366 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ed08b591-e64c-4076-aaba-d1f08bd37f0b None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:58.688562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ed08b591-e64c-4076-aaba-d1f08bd37f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:58.758043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 515/1052] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:58 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:29:58.778514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 538/1053] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:29:58 2022] GET /identity/v3/auth/tokens => generated 1963 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:29:58.784692 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08b591-e64c-4076-aaba-d1f08bd37f0b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:58.784841 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60b4d0-8fa3-4548-b988-a567009e6db8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:58.815652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:58.885674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08b591-e64c-4076-aaba-d1f08bd37f0b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:58.893157 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60b4d0-8fa3-4548-b988-a567009e6db8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:58.897033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:58.922480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c905171-5305-4705-95f8-fd09278e075e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:58.923250 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c905171-5305-4705-95f8-fd09278e075e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:58.923536 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c905171-5305-4705-95f8-fd09278e075e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:58.923813 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c905171-5305-4705-95f8-fd09278e075e None admin] PATH_INFO: `/v3/services/image` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:58.924460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c905171-5305-4705-95f8-fd09278e075e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:58.925820 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c905171-5305-4705-95f8-fd09278e075e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:58.932681 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48170e8-d78a-4773-ae1d-4ff45f22b057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:58.933746 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48170e8-d78a-4773-ae1d-4ff45f22b057 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:58.934234 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48170e8-d78a-4773-ae1d-4ff45f22b057 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:58.934719 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48170e8-d78a-4773-ae1d-4ff45f22b057 None admin] PATH_INFO: `/v3/projects/bc7aa7f88b1a4e59930d87f717ff7395` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:58.936671 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48170e8-d78a-4773-ae1d-4ff45f22b057 None admin] RBAC: Authorizing `identity:get_project(project_id=bc7aa7f88b1a4e59930d87f717ff7395)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:58.937906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5c905171-5305-4705-95f8-fd09278e075e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:29:58.937906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:58.937906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:58.937906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:58.937906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:58.937906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:58.937906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:58.937906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:58.937906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:29:58.937906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:58.937906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:58.937906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:58.937906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:58.937906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:58.937906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:58.937906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:58.937906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:58.938951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:58.938951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:58.938951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:58.938951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:58.938951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:58.938951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:58.938951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:58.938951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:58.938951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:58.938951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:58.938951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:58.938951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:58.938951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:58.938951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:58.938951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:58.938951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:58.939796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:58.939796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:58.939796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:58.939796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:58.939796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:58.939796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:58.939796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:58.939796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:58.939796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:58.939796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:58.939796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:58.939796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:58.939796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:29:58.939796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:58.939796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 516/1054] 10.222.0.110 () {56 vars in 1110 bytes} [Thu May 26 16:29:58 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:58.940588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48170e8-d78a-4773-ae1d-4ff45f22b057 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:58.946546 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 539/1055] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:29:58 2022] GET /identity/v3/projects/bc7aa7f88b1a4e59930d87f717ff7395 => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:58.947302 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c905171-5305-4705-95f8-fd09278e075e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:58.947426 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48170e8-d78a-4773-ae1d-4ff45f22b057 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:59.055708 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c905171-5305-4705-95f8-fd09278e075e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:59.057094 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:59.061935 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48170e8-d78a-4773-ae1d-4ff45f22b057 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:59.091192 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed65696-be62-48e9-908d-25246e3479a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:59.091858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed65696-be62-48e9-908d-25246e3479a2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:59.092661 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed65696-be62-48e9-908d-25246e3479a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:59.092938 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed65696-be62-48e9-908d-25246e3479a2 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:59.093634 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed65696-be62-48e9-908d-25246e3479a2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:59.093940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed65696-be62-48e9-908d-25246e3479a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:59.095317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed65696-be62-48e9-908d-25246e3479a2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:59.099425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb280ef-7146-4723-a683-f6641c0bb54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:59.100080 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb280ef-7146-4723-a683-f6641c0bb54a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:59.105079 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb280ef-7146-4723-a683-f6641c0bb54a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:59.105215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 517/1056] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:58 2022] GET /identity/v3/services?name=image => generated 123 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:59.105329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb280ef-7146-4723-a683-f6641c0bb54a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:59.105329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb280ef-7146-4723-a683-f6641c0bb54a None admin] RBAC: Adding query filter params (role.id=1393d128d39b4649b6cd71b6609846cb, scope.project.id=bc7aa7f88b1a4e59930d87f717ff7395, user.id=e20903a1ab9541ada2bd6b65e3bfc46d) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:59.105329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb280ef-7146-4723-a683-f6641c0bb54a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:59.105329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb280ef-7146-4723-a683-f6641c0bb54a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:59.105885 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed65696-be62-48e9-908d-25246e3479a2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:59.115212 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 540/1057] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:29:58 2022] GET /identity/v3/role_assignments?user.id=e20903a1ab9541ada2bd6b65e3bfc46d&scope.project.id=bc7aa7f88b1a4e59930d87f717ff7395&role.id=1393d128d39b4649b6cd71b6609846cb => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:59.152716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:59.222434 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed65696-be62-48e9-908d-25246e3479a2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:59.259762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf9dab-74b6-4b40-87bf-35f4ae12d942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:59.260474 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf9dab-74b6-4b40-87bf-35f4ae12d942 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:59.260756 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf9dab-74b6-4b40-87bf-35f4ae12d942 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:59.261033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf9dab-74b6-4b40-87bf-35f4ae12d942 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:59.261746 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf9dab-74b6-4b40-87bf-35f4ae12d942 None admin] RBAC: Adding query filter params (type=image) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:59.262052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf9dab-74b6-4b40-87bf-35f4ae12d942 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:59.263488 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf9dab-74b6-4b40-87bf-35f4ae12d942 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:59.274606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 518/1058] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:29:59 2022] GET /identity/v3/services?type=image => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:59.275570 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb280ef-7146-4723-a683-f6641c0bb54a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:59.392996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb280ef-7146-4723-a683-f6641c0bb54a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:59.427207 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bb2c4-7430-4c46-a251-038e011a8ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:59.427866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bb2c4-7430-4c46-a251-038e011a8ad0 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:59.428150 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bb2c4-7430-4c46-a251-038e011a8ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:59.428429 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bb2c4-7430-4c46-a251-038e011a8ad0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:59.429177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bb2c4-7430-4c46-a251-038e011a8ad0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:59.430547 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bb2c4-7430-4c46-a251-038e011a8ad0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:59.450124 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 541/1059] 10.222.0.110 () {60 vars in 1149 bytes} [Thu May 26 16:29:59 2022] POST /identity/v3/endpoints => generated 329 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:29:59.704709 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31246acb-024e-4aa3-8ea2-f8d8f8c96b84 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:59.705251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31246acb-024e-4aa3-8ea2-f8d8f8c96b84 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:59.705251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31246acb-024e-4aa3-8ea2-f8d8f8c96b84 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:59.706830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 519/1060] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:29:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:59.712242 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45f88f-47c2-4ce5-84ca-0b635a25b098 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:59.712537 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45f88f-47c2-4ce5-84ca-0b635a25b098 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:59.712819 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45f88f-47c2-4ce5-84ca-0b635a25b098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:59.730799 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fd45f88f-47c2-4ce5-84ca-0b635a25b098 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:59.731977 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fd45f88f-47c2-4ce5-84ca-0b635a25b098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:59.745192 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:59.807224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 542/1061] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:29:59 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:59.830851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31246acb-024e-4aa3-8ea2-f8d8f8c96b84 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:59.933648 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31246acb-024e-4aa3-8ea2-f8d8f8c96b84 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:59.935311 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:59.972658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734fa11-a26a-4bab-85be-09aeb07cf2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:59.973465 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734fa11-a26a-4bab-85be-09aeb07cf2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:59.973758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734fa11-a26a-4bab-85be-09aeb07cf2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:59.974038 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734fa11-a26a-4bab-85be-09aeb07cf2f1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:59.986323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734fa11-a26a-4bab-85be-09aeb07cf2f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:59.994735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-6734fa11-a26a-4bab-85be-09aeb07cf2f1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:29:59.994735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:59.994735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:59.994735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:59.994735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:59.994735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:59.994735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:59.994735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:59.994735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:59.994735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:59.994735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:59.994735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:59.994735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:59.994735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:59.994735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:59.994735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:59.995683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:59.995683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:59.995683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:59.995683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:59.995683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:59.995683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:59.995683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:59.995683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:59.995683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:59.995683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:59.995683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:59.995683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:29:59.995683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:59.995683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:59.995683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:59.995683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:59.996801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:59.996801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:59.996801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:59.996801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:59.996801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:59.996801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:59.996801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:59.996801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:59.996801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:59.996801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:59.996801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:29:59.996801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:29:59.996801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 520/1062] 10.222.0.110 () {56 vars in 1125 bytes} [Thu May 26 16:29:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:00.002793 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45f88f-47c2-4ce5-84ca-0b635a25b098 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:00.102322 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45f88f-47c2-4ce5-84ca-0b635a25b098 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:00.137293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee724ef-6faa-4ea3-8abd-ba19253a8f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:00.137971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee724ef-6faa-4ea3-8abd-ba19253a8f54 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:00.138404 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee724ef-6faa-4ea3-8abd-ba19253a8f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:00.139249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee724ef-6faa-4ea3-8abd-ba19253a8f54 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:00.139996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee724ef-6faa-4ea3-8abd-ba19253a8f54 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:00.140307 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee724ef-6faa-4ea3-8abd-ba19253a8f54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:00.141674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee724ef-6faa-4ea3-8abd-ba19253a8f54 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:00.154438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 543/1063] 10.222.0.110 () {56 vars in 1120 bytes} [Thu May 26 16:30:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:00.156352 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734fa11-a26a-4bab-85be-09aeb07cf2f1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:00.259992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734fa11-a26a-4bab-85be-09aeb07cf2f1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:00.294376 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e9072-77db-42a9-ac2d-42d22d2336bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:00.295269 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e9072-77db-42a9-ac2d-42d22d2336bc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:00.295556 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e9072-77db-42a9-ac2d-42d22d2336bc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:00.295832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e9072-77db-42a9-ac2d-42d22d2336bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:00.306719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e9072-77db-42a9-ac2d-42d22d2336bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:00.308176 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e9072-77db-42a9-ac2d-42d22d2336bc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:00.325343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5c2e9072-77db-42a9-ac2d-42d22d2336bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:00.325343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:00.325343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:00.325343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:00.325343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:00.325343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:00.325343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:00.325343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:00.325343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:00.325343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:00.325343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:00.325343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:00.325343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:00.325343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:00.325343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:00.327057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:00.327057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:00.327057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:00.327057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:00.327057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:00.327057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:00.327057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:00.327057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:00.327057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:30:00.327057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:00.327057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:00.327057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:00.327057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:00.327057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:00.327057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:00.327057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:00.327057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:00.332860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:00.332860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:00.332860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:00.332860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:30:00.332860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 521/1064] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:00.333151 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee724ef-6faa-4ea3-8abd-ba19253a8f54 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:00.343178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:00.442229 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee724ef-6faa-4ea3-8abd-ba19253a8f54 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:00.475509 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2133e1-5364-42a6-8692-433899c45836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:00.476169 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2133e1-5364-42a6-8692-433899c45836 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:00.476455 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2133e1-5364-42a6-8692-433899c45836 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:00.476733 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2133e1-5364-42a6-8692-433899c45836 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:00.477446 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2133e1-5364-42a6-8692-433899c45836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:00.477757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2133e1-5364-42a6-8692-433899c45836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:00.479151 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2133e1-5364-42a6-8692-433899c45836 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:00.495761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 544/1065] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:30:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:00.497429 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e9072-77db-42a9-ac2d-42d22d2336bc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:00.514712 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:00.601302 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e9072-77db-42a9-ac2d-42d22d2336bc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:00.635712 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688ad5b-2212-4efe-8891-8b2112178664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:00.636517 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688ad5b-2212-4efe-8891-8b2112178664 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:00.636803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688ad5b-2212-4efe-8891-8b2112178664 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:00.637080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688ad5b-2212-4efe-8891-8b2112178664 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:00.645804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688ad5b-2212-4efe-8891-8b2112178664 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:00.647290 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688ad5b-2212-4efe-8891-8b2112178664 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:00.661518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e688ad5b-2212-4efe-8891-8b2112178664 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:30:00.661518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:00.661518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:00.661518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:00.661518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:00.661518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:00.661518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:00.661518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:00.661518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:00.661518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:00.661518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:00.661518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:00.661518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:30:00.661518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:30:00.661518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:30:00.661518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:30:00.662496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:00.662496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:00.662496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:30:00.662496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:00.662496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:30:00.662496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:00.662496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:00.662496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:00.662496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:00.662496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:00.662496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:00.662496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:30:00.662496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:00.662496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:00.662496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:00.662496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:00.662496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:00.662496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:00.668501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:00.668501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:00.668501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:30:00.668501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:30:00.668501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:30:00.668501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:30:00.668501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:30:00.668501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:30:00.668501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:30:00.668501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:30:00.668501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 522/1066] 10.222.0.110 () {56 vars in 1098 bytes} [Thu May 26 16:30:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:00.669096 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2133e1-5364-42a6-8692-433899c45836 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:00.735189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:00.772369 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2133e1-5364-42a6-8692-433899c45836 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:00.805778 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb45a5-fcb6-4bac-ad52-7ec96ca9a481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:00.806448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb45a5-fcb6-4bac-ad52-7ec96ca9a481 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:00.806764 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb45a5-fcb6-4bac-ad52-7ec96ca9a481 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:00.807042 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb45a5-fcb6-4bac-ad52-7ec96ca9a481 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:00.807904 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb45a5-fcb6-4bac-ad52-7ec96ca9a481 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:00.808214 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb45a5-fcb6-4bac-ad52-7ec96ca9a481 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:00.809638 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb45a5-fcb6-4bac-ad52-7ec96ca9a481 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:00.830639 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 545/1067] 10.222.0.110 () {56 vars in 1138 bytes} [Thu May 26 16:30:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:00.833547 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688ad5b-2212-4efe-8891-8b2112178664 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:00.912472 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:00.937544 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688ad5b-2212-4efe-8891-8b2112178664 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:00.972258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a9883-2b8b-471c-83a9-517dab8d8385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:00.973064 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a9883-2b8b-471c-83a9-517dab8d8385 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:00.973349 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a9883-2b8b-471c-83a9-517dab8d8385 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:00.973625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a9883-2b8b-471c-83a9-517dab8d8385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:00.984263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a9883-2b8b-471c-83a9-517dab8d8385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:00.985688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a9883-2b8b-471c-83a9-517dab8d8385 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:01.003137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ce6a9883-2b8b-471c-83a9-517dab8d8385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:01.003137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:01.003137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:01.003137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:01.003137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:01.003137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:01.003137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:01.003137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:01.003137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:01.003137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:01.003137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:01.003137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:01.003137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:01.003137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:01.003137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:01.004085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:01.004085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:01.004085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:01.004085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:01.004085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:01.004085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:01.004085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:01.004085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:01.004085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:30:01.004085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:01.004085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:01.004085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:01.004085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:01.004085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:01.004085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:01.004085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:01.004085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:01.004985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:01.004985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:01.004985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:01.004985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:30:01.004985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 523/1068] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:01.011159 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb45a5-fcb6-4bac-ad52-7ec96ca9a481 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:01.118233 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb45a5-fcb6-4bac-ad52-7ec96ca9a481 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:01.146365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:01.158853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dbafb-7c27-41d7-963a-7f32d2048d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:01.159525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dbafb-7c27-41d7-963a-7f32d2048d7b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:01.159812 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dbafb-7c27-41d7-963a-7f32d2048d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:01.160096 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dbafb-7c27-41d7-963a-7f32d2048d7b None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:01.160822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824dbafb-7c27-41d7-963a-7f32d2048d7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:01.161136 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824dbafb-7c27-41d7-963a-7f32d2048d7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:01.162509 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824dbafb-7c27-41d7-963a-7f32d2048d7b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:01.179645 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 546/1069] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:30:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:01.180689 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a9883-2b8b-471c-83a9-517dab8d8385 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:01.284344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a9883-2b8b-471c-83a9-517dab8d8385 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:01.301524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859cea6-6157-4557-86e8-0d0336403004 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:01.301815 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859cea6-6157-4557-86e8-0d0336403004 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:01.302097 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859cea6-6157-4557-86e8-0d0336403004 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:01.303628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 547/1070] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:30:01.308324 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccdb59-14bf-4a8b-a1f5-7b0373eb0683 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:01.308598 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccdb59-14bf-4a8b-a1f5-7b0373eb0683 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:01.308878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccdb59-14bf-4a8b-a1f5-7b0373eb0683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:01.311931 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:01.321719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebd2e2-20f1-4ad9-9af3-e5a37289d151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:01.322528 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebd2e2-20f1-4ad9-9af3-e5a37289d151 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:01.322848 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebd2e2-20f1-4ad9-9af3-e5a37289d151 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:01.323134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebd2e2-20f1-4ad9-9af3-e5a37289d151 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:01.326885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f4ccdb59-14bf-4a8b-a1f5-7b0373eb0683 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:01.328069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f4ccdb59-14bf-4a8b-a1f5-7b0373eb0683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:01.330809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebd2e2-20f1-4ad9-9af3-e5a37289d151 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:01.332282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebd2e2-20f1-4ad9-9af3-e5a37289d151 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:01.347351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-cbebd2e2-20f1-4ad9-9af3-e5a37289d151 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:01.347351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:01.347351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:01.347351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:01.347351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:01.347351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:01.347351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:01.347351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:01.347351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:01.347351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:01.347351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:01.347351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:01.347351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:30:01.347351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:30:01.347351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:30:01.348300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:30:01.348300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:01.348300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:01.348300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:01.348300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:01.348300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:01.348300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:01.348300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:01.348300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:30:01.348300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:01.348300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:01.348300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:01.348300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:01.348300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:01.348300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:01.348300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:01.348300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:01.353963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:30:01.353963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:30:01.353963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:01.353963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:01.353963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:01.353963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:01.353963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:01.353963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:30:01.353963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 524/1071] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:30:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:01.354456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebd2e2-20f1-4ad9-9af3-e5a37289d151 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:01.414629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 548/1072] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:01 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:30:01.437433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccdb59-14bf-4a8b-a1f5-7b0373eb0683 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:01.471711 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebd2e2-20f1-4ad9-9af3-e5a37289d151 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:01.506782 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614b641-e403-4e15-bb4d-ea16a74979fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:01.507453 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614b641-e403-4e15-bb4d-ea16a74979fd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:01.507745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614b641-e403-4e15-bb4d-ea16a74979fd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:01.508026 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614b641-e403-4e15-bb4d-ea16a74979fd None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:01.508828 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614b641-e403-4e15-bb4d-ea16a74979fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:01.509124 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614b641-e403-4e15-bb4d-ea16a74979fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:01.510554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614b641-e403-4e15-bb4d-ea16a74979fd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:01.523091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 525/1073] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:30:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:01.528702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614b641-e403-4e15-bb4d-ea16a74979fd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:01.547869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccdb59-14bf-4a8b-a1f5-7b0373eb0683 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:01.567532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:01.583899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:01.592056 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9949ae-7d02-4ef8-b502-2be8e02b4265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:01.593368 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9949ae-7d02-4ef8-b502-2be8e02b4265 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:01.593648 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9949ae-7d02-4ef8-b502-2be8e02b4265 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:01.594003 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9949ae-7d02-4ef8-b502-2be8e02b4265 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:01.605292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9949ae-7d02-4ef8-b502-2be8e02b4265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:01.613117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-5d9949ae-7d02-4ef8-b502-2be8e02b4265 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:01.613117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:01.613117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:01.613117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:01.613117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:01.613117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:01.613117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:01.613117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:01.613117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:01.613117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:01.613117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:01.613117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:01.613117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:01.613117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:01.613117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:01.613117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:01.614140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:01.614140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:01.614140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:01.614140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:01.614140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:01.614140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:01.614140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:01.614140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:01.614140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:01.614140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:01.614140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:01.614140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:30:01.614140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:01.614140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:01.614140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:01.614140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:01.620195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:01.620195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:01.620195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:01.620195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:01.620195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:01.620195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:01.620195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:01.620195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:01.620195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:01.620195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:01.620195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:01.620195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:30:01.620195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 549/1074] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:30:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:01.620195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9949ae-7d02-4ef8-b502-2be8e02b4265 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:01.647951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614b641-e403-4e15-bb4d-ea16a74979fd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:01.685851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04763b2-eff8-4056-a550-493f6251a44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:01.686782 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04763b2-eff8-4056-a550-493f6251a44f None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:01.687069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04763b2-eff8-4056-a550-493f6251a44f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:01.687345 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04763b2-eff8-4056-a550-493f6251a44f None admin] PATH_INFO: `/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/0043a7d5877f41de905afe6bef355867/roles/46e323c1a7614208aaaa8a31c9186f4a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:01.689555 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04763b2-eff8-4056-a550-493f6251a44f None admin] RBAC: Authorizing `identity:create_grant(project_id=d33e1f400b3e46379d2a0abd05921181, user_id=0043a7d5877f41de905afe6bef355867, role_id=46e323c1a7614208aaaa8a31c9186f4a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:01.691024 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04763b2-eff8-4056-a550-493f6251a44f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:01.706803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 526/1075] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:30:01 2022] PUT /identity/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/0043a7d5877f41de905afe6bef355867/roles/46e323c1a7614208aaaa8a31c9186f4a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:30:01.738023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9949ae-7d02-4ef8-b502-2be8e02b4265 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:01.738857 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca53f6-30a2-4516-8872-2cf4d2c6d9f1 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:01.739155 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca53f6-30a2-4516-8872-2cf4d2c6d9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:01.739446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca53f6-30a2-4516-8872-2cf4d2c6d9f1 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:01.740872 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 527/1076] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:30:01.746896 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe2025-a794-4ea3-9704-5b1815b35ea3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:01.747185 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe2025-a794-4ea3-9704-5b1815b35ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:01.747535 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe2025-a794-4ea3-9704-5b1815b35ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:01.767133 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-28fe2025-a794-4ea3-9704-5b1815b35ea3 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:01.768393 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-28fe2025-a794-4ea3-9704-5b1815b35ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:01.780867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09053dc-ce17-47e5-a90c-631fba2b6965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:01.781557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09053dc-ce17-47e5-a90c-631fba2b6965 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:01.781848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09053dc-ce17-47e5-a90c-631fba2b6965 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:01.782129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09053dc-ce17-47e5-a90c-631fba2b6965 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:01.783038 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09053dc-ce17-47e5-a90c-631fba2b6965 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:01.783261 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09053dc-ce17-47e5-a90c-631fba2b6965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:01.784631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09053dc-ce17-47e5-a90c-631fba2b6965 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:01.797821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 550/1077] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:30:01 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:01.804018 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09053dc-ce17-47e5-a90c-631fba2b6965 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:01.840768 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:01.853182 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 528/1078] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:01 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:30:01.876466 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe2025-a794-4ea3-9704-5b1815b35ea3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:01.918284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:01.922101 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09053dc-ce17-47e5-a90c-631fba2b6965 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:01.959733 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9a874-d147-47c5-af64-440eafd31ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:01.960611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9a874-d147-47c5-af64-440eafd31ece None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:01.960896 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9a874-d147-47c5-af64-440eafd31ece None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:01.961174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9a874-d147-47c5-af64-440eafd31ece None admin] PATH_INFO: `/v3/users/e20903a1ab9541ada2bd6b65e3bfc46d` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:01.962384 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9a874-d147-47c5-af64-440eafd31ece None admin] RBAC: Authorizing `identity:get_user(user_id=e20903a1ab9541ada2bd6b65e3bfc46d)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:01.963861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9a874-d147-47c5-af64-440eafd31ece None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:01.965665 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 551/1079] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:30:01 2022] GET /identity/v3/users/e20903a1ab9541ada2bd6b65e3bfc46d => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:01.971691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9a874-d147-47c5-af64-440eafd31ece None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:01.989715 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe2025-a794-4ea3-9704-5b1815b35ea3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:02.028125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ceaa6c-7185-44ef-b379-12ad5b20b8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:02.028810 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ceaa6c-7185-44ef-b379-12ad5b20b8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:02.029124 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ceaa6c-7185-44ef-b379-12ad5b20b8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:02.029416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ceaa6c-7185-44ef-b379-12ad5b20b8d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:02.079013 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9a874-d147-47c5-af64-440eafd31ece None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:02.082389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:02.101604 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ceaa6c-7185-44ef-b379-12ad5b20b8d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:02.103170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ceaa6c-7185-44ef-b379-12ad5b20b8d3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:02.122622 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13059ed9-baba-4f56-9c27-f62d6855a24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:02.124293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13059ed9-baba-4f56-9c27-f62d6855a24c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:02.125192 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13059ed9-baba-4f56-9c27-f62d6855a24c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:02.125846 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13059ed9-baba-4f56-9c27-f62d6855a24c None admin] PATH_INFO: `/v3/projects/bc7aa7f88b1a4e59930d87f717ff7395` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:02.128017 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13059ed9-baba-4f56-9c27-f62d6855a24c None admin] RBAC: Authorizing `identity:get_project(project_id=bc7aa7f88b1a4e59930d87f717ff7395)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:02.130251 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13059ed9-baba-4f56-9c27-f62d6855a24c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:02.132928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 552/1080] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:30:01 2022] GET /identity/v3/projects/bc7aa7f88b1a4e59930d87f717ff7395 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:02.139135 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13059ed9-baba-4f56-9c27-f62d6855a24c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:02.140371 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:02.211554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 529/1081] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:30:01 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 16:30:02.217816 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ceaa6c-7185-44ef-b379-12ad5b20b8d3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:02.248710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13059ed9-baba-4f56-9c27-f62d6855a24c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:02.286379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f16af-c307-4ca3-9284-df95abe0bb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:02.287349 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f16af-c307-4ca3-9284-df95abe0bb1d None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:02.287683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f16af-c307-4ca3-9284-df95abe0bb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:02.287900 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f16af-c307-4ca3-9284-df95abe0bb1d None admin] PATH_INFO: `/v3/projects/bc7aa7f88b1a4e59930d87f717ff7395/users/e20903a1ab9541ada2bd6b65e3bfc46d/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:02.289931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f16af-c307-4ca3-9284-df95abe0bb1d None admin] RBAC: Authorizing `identity:create_grant(project_id=bc7aa7f88b1a4e59930d87f717ff7395, user_id=e20903a1ab9541ada2bd6b65e3bfc46d, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:02.291530 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f16af-c307-4ca3-9284-df95abe0bb1d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:02.307009 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 553/1082] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:30:02 2022] PUT /identity/v3/projects/bc7aa7f88b1a4e59930d87f717ff7395/users/e20903a1ab9541ada2bd6b65e3bfc46d/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:30:02.341363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ceaa6c-7185-44ef-b379-12ad5b20b8d3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:02.384715 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1665c2-93a6-4985-8499-2d2231947912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:02.385542 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1665c2-93a6-4985-8499-2d2231947912 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:02.385830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1665c2-93a6-4985-8499-2d2231947912 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:02.386163 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1665c2-93a6-4985-8499-2d2231947912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:02.390313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:02.400380 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1665c2-93a6-4985-8499-2d2231947912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:02.401859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1665c2-93a6-4985-8499-2d2231947912 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:02.422108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ce1665c2-93a6-4985-8499-2d2231947912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:02.422108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:02.422108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:02.422108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:02.422108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:02.422108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:02.422108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:02.422108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:02.422108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:02.422108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:02.422108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:02.422108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:02.422108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:02.422108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:02.422108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:02.423375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:02.423375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:02.423375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:02.423375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:02.423375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:02.423375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:02.423375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:02.423375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:02.423375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:30:02.423375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:02.423375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:02.423375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:02.423375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:02.423375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:02.423375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:02.423375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:02.423375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:02.424282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:02.424282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:02.424282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:02.424282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:30:02.425165 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 530/1083] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:02.429522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f16af-c307-4ca3-9284-df95abe0bb1d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:02.465421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:02.543135 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f16af-c307-4ca3-9284-df95abe0bb1d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:02.579375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541e146-b659-4c24-9a3c-24454bc3cf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:02.580150 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541e146-b659-4c24-9a3c-24454bc3cf69 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:02.580451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541e146-b659-4c24-9a3c-24454bc3cf69 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:02.580733 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541e146-b659-4c24-9a3c-24454bc3cf69 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:02.581505 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541e146-b659-4c24-9a3c-24454bc3cf69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:02.581827 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541e146-b659-4c24-9a3c-24454bc3cf69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:02.583230 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541e146-b659-4c24-9a3c-24454bc3cf69 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:02.595018 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 554/1084] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:30:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:03.907617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e761e98-a565-4d23-97ae-7764b01e503d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:03.908202 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e761e98-a565-4d23-97ae-7764b01e503d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:03.908202 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e761e98-a565-4d23-97ae-7764b01e503d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:03.909546 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 531/1085] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:03.914781 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd151f86-eb57-438d-acfb-cb858c60d298 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:03.915199 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd151f86-eb57-438d-acfb-cb858c60d298 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:03.915342 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd151f86-eb57-438d-acfb-cb858c60d298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:03.931907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-dd151f86-eb57-438d-acfb-cb858c60d298 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:03.933089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dd151f86-eb57-438d-acfb-cb858c60d298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:03.999639 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 555/1086] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:03 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:04.022884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e761e98-a565-4d23-97ae-7764b01e503d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:04.124044 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e761e98-a565-4d23-97ae-7764b01e503d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:04.158335 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9d2ca-1d81-45a9-b0b1-3b0667090df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:04.159092 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9d2ca-1d81-45a9-b0b1-3b0667090df7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:04.159381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9d2ca-1d81-45a9-b0b1-3b0667090df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:04.159658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9d2ca-1d81-45a9-b0b1-3b0667090df7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:04.169846 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9d2ca-1d81-45a9-b0b1-3b0667090df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:04.178028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-96b9d2ca-1d81-45a9-b0b1-3b0667090df7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:30:04.178028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:04.178028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:04.178028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:04.178028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:04.178028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:04.178028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:04.178028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:04.178028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:04.178028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:04.178028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:04.178028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:04.178028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:04.178028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:04.178028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:04.178028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:04.179129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:04.179129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:04.179129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:04.179129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:04.179129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:04.179129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:04.179129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:04.179129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:04.179129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:04.179129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:04.179129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:04.179129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:30:04.179129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:04.179129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:04.179129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:04.179129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:04.180079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:04.180079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:04.180079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:04.180079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:04.180079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:04.180079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:04.180079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:04.180079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:04.180079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:04.180079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:04.180079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:30:04.180079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:30:04.180079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 532/1087] 10.222.0.110 () {56 vars in 1125 bytes} [Thu May 26 16:30:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:04.185113 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd151f86-eb57-438d-acfb-cb858c60d298 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:04.209761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:04.286150 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd151f86-eb57-438d-acfb-cb858c60d298 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:04.319405 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cb24d-7f73-4a1d-8219-1cfdacefb650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:04.320068 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cb24d-7f73-4a1d-8219-1cfdacefb650 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:04.320353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cb24d-7f73-4a1d-8219-1cfdacefb650 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:04.320625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cb24d-7f73-4a1d-8219-1cfdacefb650 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:04.321355 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cb24d-7f73-4a1d-8219-1cfdacefb650 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:04.321658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cb24d-7f73-4a1d-8219-1cfdacefb650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:04.323041 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cb24d-7f73-4a1d-8219-1cfdacefb650 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:04.331352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 556/1088] 10.222.0.110 () {56 vars in 1120 bytes} [Thu May 26 16:30:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:04.337007 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9d2ca-1d81-45a9-b0b1-3b0667090df7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:04.392190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:04.442419 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9d2ca-1d81-45a9-b0b1-3b0667090df7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:04.474618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4306f28-aa74-41af-981c-8228071a803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:04.475408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4306f28-aa74-41af-981c-8228071a803d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:04.475690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4306f28-aa74-41af-981c-8228071a803d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:04.475963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4306f28-aa74-41af-981c-8228071a803d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:04.486157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4306f28-aa74-41af-981c-8228071a803d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:04.487621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4306f28-aa74-41af-981c-8228071a803d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:04.505001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c4306f28-aa74-41af-981c-8228071a803d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:04.505001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:04.505001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:04.505001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:04.505001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:04.505001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:04.505001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:04.505001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:04.505001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:04.505001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:04.505001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:04.505001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:04.505001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:04.505001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:04.505001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:04.506069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:04.506069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:04.506069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:04.506069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:04.506069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:04.506069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:04.506069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:04.506069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:04.506069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:30:04.506069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:04.506069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:04.506069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:04.506069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:04.506069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:04.506069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:04.506069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:04.506069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:04.507013 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:04.507013 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:04.507013 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:04.507013 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:30:04.507013 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 533/1089] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:04.511763 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cb24d-7f73-4a1d-8219-1cfdacefb650 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:04.535517 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d36f-ffcc-40c2-819d-27c9704a15b9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:04.535811 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d36f-ffcc-40c2-819d-27c9704a15b9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:04.536093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d36f-ffcc-40c2-819d-27c9704a15b9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:04.537449 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 534/1090] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:30:04.542450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89795d-1921-49b3-9e0a-0443575c40f3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:04.542773 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89795d-1921-49b3-9e0a-0443575c40f3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:04.543059 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89795d-1921-49b3-9e0a-0443575c40f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:04.559997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cc89795d-1921-49b3-9e0a-0443575c40f3 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:04.561737 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cc89795d-1921-49b3-9e0a-0443575c40f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:04.597129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:04.613698 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cb24d-7f73-4a1d-8219-1cfdacefb650 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:04.629059 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 535/1091] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:04 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:30:04.646760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f93382-406a-45ec-b6b6-6452d4ec2a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:04.647428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f93382-406a-45ec-b6b6-6452d4ec2a4e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:04.647711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f93382-406a-45ec-b6b6-6452d4ec2a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:04.647989 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f93382-406a-45ec-b6b6-6452d4ec2a4e None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:04.648712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f93382-406a-45ec-b6b6-6452d4ec2a4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:04.649025 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f93382-406a-45ec-b6b6-6452d4ec2a4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:04.650384 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f93382-406a-45ec-b6b6-6452d4ec2a4e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:04.652130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89795d-1921-49b3-9e0a-0443575c40f3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:04.664154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 557/1092] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:30:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:04.670113 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f93382-406a-45ec-b6b6-6452d4ec2a4e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:04.686454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:04.754471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89795d-1921-49b3-9e0a-0443575c40f3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:04.771171 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f93382-406a-45ec-b6b6-6452d4ec2a4e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:04.786980 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa751b-54ce-48f8-9541-14bbfa4ec486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:04.787781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa751b-54ce-48f8-9541-14bbfa4ec486 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:04.788122 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa751b-54ce-48f8-9541-14bbfa4ec486 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:04.788407 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa751b-54ce-48f8-9541-14bbfa4ec486 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:04.798904 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa751b-54ce-48f8-9541-14bbfa4ec486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:04.805041 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533efaa-076e-49ce-a50c-c1464c5c9910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:04.805828 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533efaa-076e-49ce-a50c-c1464c5c9910 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:04.806120 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533efaa-076e-49ce-a50c-c1464c5c9910 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:04.806400 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533efaa-076e-49ce-a50c-c1464c5c9910 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:04.806674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a9aa751b-54ce-48f8-9541-14bbfa4ec486 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:04.806674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:04.806674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:04.806674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:04.806674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:04.806674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:04.806674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:04.806674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:04.806674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:04.806674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:04.806674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:04.806674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:04.806674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:04.806674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:04.806674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:04.806674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:04.807607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:04.807607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:04.807607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:04.807607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:04.807607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:04.807607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:04.807607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:04.807607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:04.807607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:04.807607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:04.807607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:04.807607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:30:04.807607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:04.807607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:04.807607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:04.807607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:04.808460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:04.808460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:04.808460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:04.808460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:04.808460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:04.808460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:04.808460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:04.808460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:04.808460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:04.808460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:04.808460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:04.808460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:30:04.808460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 536/1093] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:30:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:04.813936 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa751b-54ce-48f8-9541-14bbfa4ec486 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:04.816139 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533efaa-076e-49ce-a50c-c1464c5c9910 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:04.817584 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533efaa-076e-49ce-a50c-c1464c5c9910 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:04.832814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-4533efaa-076e-49ce-a50c-c1464c5c9910 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:30:04.832814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:04.832814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:04.832814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:04.832814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:04.832814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:04.832814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:04.832814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:04.832814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:04.832814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:04.832814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:04.832814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:04.832814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:30:04.832814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:30:04.832814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:30:04.832814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:30:04.833922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:04.833922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:04.833922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:30:04.833922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:04.833922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:30:04.833922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:04.833922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:04.833922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:04.833922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:04.833922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:04.833922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:04.833922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:30:04.833922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:04.833922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:04.833922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:04.833922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:04.833922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:04.833922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:04.834949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:04.834949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:04.834949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:30:04.834949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:30:04.834949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:30:04.834949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:30:04.834949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:30:04.834949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:30:04.834949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:30:04.834949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:30:04.834949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 558/1094] 10.222.0.110 () {56 vars in 1098 bytes} [Thu May 26 16:30:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:04.839645 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533efaa-076e-49ce-a50c-c1464c5c9910 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:04.843261 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:04.911637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:04.921946 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa751b-54ce-48f8-9541-14bbfa4ec486 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:04.938260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533efaa-076e-49ce-a50c-c1464c5c9910 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:04.956208 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc3663-3efd-48e6-9bb6-98ec47ba9147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:04.956884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc3663-3efd-48e6-9bb6-98ec47ba9147 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:04.957171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc3663-3efd-48e6-9bb6-98ec47ba9147 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:04.957459 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc3663-3efd-48e6-9bb6-98ec47ba9147 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:04.958201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc3663-3efd-48e6-9bb6-98ec47ba9147 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:04.958511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc3663-3efd-48e6-9bb6-98ec47ba9147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:04.959897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc3663-3efd-48e6-9bb6-98ec47ba9147 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:04.968051 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 537/1095] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:30:04 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:04.973624 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc3663-3efd-48e6-9bb6-98ec47ba9147 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:04.974885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc24717-19d7-4b65-9380-d2eb48d29e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:04.975561 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc24717-19d7-4b65-9380-d2eb48d29e1a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:04.975858 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc24717-19d7-4b65-9380-d2eb48d29e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:04.976130 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc24717-19d7-4b65-9380-d2eb48d29e1a None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:04.976970 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc24717-19d7-4b65-9380-d2eb48d29e1a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:04.977284 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc24717-19d7-4b65-9380-d2eb48d29e1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:04.978737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc24717-19d7-4b65-9380-d2eb48d29e1a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:05.009806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 559/1096] 10.222.0.110 () {56 vars in 1138 bytes} [Thu May 26 16:30:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:05.010842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc24717-19d7-4b65-9380-d2eb48d29e1a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:05.071208 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:05.075128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc3663-3efd-48e6-9bb6-98ec47ba9147 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:05.108770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8f57f-e99e-4356-9cb0-53c3951c88ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:05.109656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8f57f-e99e-4356-9cb0-53c3951c88ed None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:05.109772 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc24717-19d7-4b65-9380-d2eb48d29e1a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:05.109945 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8f57f-e99e-4356-9cb0-53c3951c88ed None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:05.110226 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8f57f-e99e-4356-9cb0-53c3951c88ed None admin] PATH_INFO: `/v3/users/e20903a1ab9541ada2bd6b65e3bfc46d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:05.111468 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8f57f-e99e-4356-9cb0-53c3951c88ed None admin] RBAC: Authorizing `identity:get_user(user_id=e20903a1ab9541ada2bd6b65e3bfc46d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:05.112899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8f57f-e99e-4356-9cb0-53c3951c88ed None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:05.114538 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 538/1097] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:30:04 2022] GET /identity/v3/users/e20903a1ab9541ada2bd6b65e3bfc46d => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:05.120194 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8f57f-e99e-4356-9cb0-53c3951c88ed None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:05.142650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:05.146008 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e21af-7730-4616-8237-f484d2cbf640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:05.146706 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e21af-7730-4616-8237-f484d2cbf640 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:05.146994 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e21af-7730-4616-8237-f484d2cbf640 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:05.147272 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e21af-7730-4616-8237-f484d2cbf640 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:05.215194 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e21af-7730-4616-8237-f484d2cbf640 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:05.217165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e21af-7730-4616-8237-f484d2cbf640 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:05.219894 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8f57f-e99e-4356-9cb0-53c3951c88ed None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:05.253210 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13eeb7e-2193-407e-9f21-0b201f2cdce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:05.253855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13eeb7e-2193-407e-9f21-0b201f2cdce6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:05.254143 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13eeb7e-2193-407e-9f21-0b201f2cdce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:05.254423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13eeb7e-2193-407e-9f21-0b201f2cdce6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:05.277693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:05.316973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 560/1098] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:30:05 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 16:30:05.321487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13eeb7e-2193-407e-9f21-0b201f2cdce6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:05.322760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e21af-7730-4616-8237-f484d2cbf640 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:05.323035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13eeb7e-2193-407e-9f21-0b201f2cdce6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:05.344443 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:05.423401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 539/1099] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:30:05 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 16:30:05.426596 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e21af-7730-4616-8237-f484d2cbf640 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:05.429274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13eeb7e-2193-407e-9f21-0b201f2cdce6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:05.461625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f93e68-510a-48fb-ba65-57d38e720518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:05.462424 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f93e68-510a-48fb-ba65-57d38e720518 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:05.462748 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f93e68-510a-48fb-ba65-57d38e720518 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:05.463034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f93e68-510a-48fb-ba65-57d38e720518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:05.473307 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f93e68-510a-48fb-ba65-57d38e720518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:05.474785 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f93e68-510a-48fb-ba65-57d38e720518 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:05.492526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-18f93e68-510a-48fb-ba65-57d38e720518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:05.492526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:05.492526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:05.492526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:05.492526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:05.492526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:05.492526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:05.492526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:05.492526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:05.492526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:05.492526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:05.492526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:05.492526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:05.492526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:05.492526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:05.493467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:05.493467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:05.493467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:05.493467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:05.493467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:05.493467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:05.493467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:05.493467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:05.493467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:30:05.493467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:05.493467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:05.493467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:05.493467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:05.493467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:05.493467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:05.493467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:05.493467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:05.494622 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:05.494622 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:05.494622 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:05.494622 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:30:05.494622 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 561/1100] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:05.500468 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f93e68-510a-48fb-ba65-57d38e720518 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:05.515167 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:05.530917 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13eeb7e-2193-407e-9f21-0b201f2cdce6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:05.551528 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:05.567290 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae0fcd-cc9b-435c-9419-d2d70650b507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:05.568170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae0fcd-cc9b-435c-9419-d2d70650b507 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:05.568448 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae0fcd-cc9b-435c-9419-d2d70650b507 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:05.568725 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae0fcd-cc9b-435c-9419-d2d70650b507 None admin] PATH_INFO: `/v3/projects/bc7aa7f88b1a4e59930d87f717ff7395` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:05.569891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae0fcd-cc9b-435c-9419-d2d70650b507 None admin] RBAC: Authorizing `identity:get_project(project_id=bc7aa7f88b1a4e59930d87f717ff7395)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:05.571343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae0fcd-cc9b-435c-9419-d2d70650b507 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:05.573041 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 540/1101] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:30:05 2022] GET /identity/v3/projects/bc7aa7f88b1a4e59930d87f717ff7395 => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:05.579083 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae0fcd-cc9b-435c-9419-d2d70650b507 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:05.600892 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f93e68-510a-48fb-ba65-57d38e720518 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:05.634787 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8df68-b551-4f7e-9f9e-bc43af0c726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:05.635453 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8df68-b551-4f7e-9f9e-bc43af0c726e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:05.635738 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8df68-b551-4f7e-9f9e-bc43af0c726e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:05.636018 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8df68-b551-4f7e-9f9e-bc43af0c726e None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:05.636738 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8df68-b551-4f7e-9f9e-bc43af0c726e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:05.637048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8df68-b551-4f7e-9f9e-bc43af0c726e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:05.639153 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8df68-b551-4f7e-9f9e-bc43af0c726e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:05.650417 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 562/1102] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:30:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:05.656023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8df68-b551-4f7e-9f9e-bc43af0c726e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:05.677825 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae0fcd-cc9b-435c-9419-d2d70650b507 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:05.710712 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77884cb6-d10c-428c-9d8e-95563c4212bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:05.711483 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77884cb6-d10c-428c-9d8e-95563c4212bb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:05.711900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77884cb6-d10c-428c-9d8e-95563c4212bb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:05.712180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77884cb6-d10c-428c-9d8e-95563c4212bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:05.712990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77884cb6-d10c-428c-9d8e-95563c4212bb None admin] RBAC: Adding query filter params (role.id=1393d128d39b4649b6cd71b6609846cb, scope.project.id=bc7aa7f88b1a4e59930d87f717ff7395, user.id=e20903a1ab9541ada2bd6b65e3bfc46d) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:05.713299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77884cb6-d10c-428c-9d8e-95563c4212bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:05.714726 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77884cb6-d10c-428c-9d8e-95563c4212bb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:05.721225 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 541/1103] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:30:05 2022] GET /identity/v3/role_assignments?user.id=e20903a1ab9541ada2bd6b65e3bfc46d&scope.project.id=bc7aa7f88b1a4e59930d87f717ff7395&role.id=1393d128d39b4649b6cd71b6609846cb => generated 610 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:05.732741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:05.761086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8df68-b551-4f7e-9f9e-bc43af0c726e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:05.799079 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb3a7f-6429-41ed-bb33-e13234f36c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:05.799810 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb3a7f-6429-41ed-bb33-e13234f36c2a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:05.800099 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb3a7f-6429-41ed-bb33-e13234f36c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:05.800373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb3a7f-6429-41ed-bb33-e13234f36c2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:05.808479 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb3a7f-6429-41ed-bb33-e13234f36c2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:05.809949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb3a7f-6429-41ed-bb33-e13234f36c2a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:05.826518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-37eb3a7f-6429-41ed-bb33-e13234f36c2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:05.826518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:05.826518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:05.826518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:05.826518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:05.826518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:05.826518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:05.826518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:05.826518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:05.826518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:05.826518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:05.826518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:05.826518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:30:05.826518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:30:05.826518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:30:05.827683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:30:05.827683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:05.827683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:05.827683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:05.827683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:05.827683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:05.827683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:05.827683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:05.827683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:30:05.827683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:05.827683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:05.827683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:05.827683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:05.827683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:05.827683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:05.827683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:05.827683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:05.828599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:30:05.828599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:30:05.828599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:05.828599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:05.828599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:05.828599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:05.828599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:05.828599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:30:05.828599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 563/1104] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:30:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:05.833987 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77884cb6-d10c-428c-9d8e-95563c4212bb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:05.889243 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:05.940243 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77884cb6-d10c-428c-9d8e-95563c4212bb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:05.973245 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2689c5-ffae-40ad-b47b-9c674451e077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:05.973910 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2689c5-ffae-40ad-b47b-9c674451e077 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:05.974194 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2689c5-ffae-40ad-b47b-9c674451e077 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:05.974471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2689c5-ffae-40ad-b47b-9c674451e077 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:05.975274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2689c5-ffae-40ad-b47b-9c674451e077 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:05.975584 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2689c5-ffae-40ad-b47b-9c674451e077 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:05.976991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2689c5-ffae-40ad-b47b-9c674451e077 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:05.998799 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 542/1105] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:30:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:06.000474 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb3a7f-6429-41ed-bb33-e13234f36c2a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:06.149049 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb3a7f-6429-41ed-bb33-e13234f36c2a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:06.186304 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf017f4c-776f-46d9-a572-d2c5430d80af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:06.187015 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf017f4c-776f-46d9-a572-d2c5430d80af None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:06.187293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf017f4c-776f-46d9-a572-d2c5430d80af None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:06.187569 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf017f4c-776f-46d9-a572-d2c5430d80af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:06.188402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf017f4c-776f-46d9-a572-d2c5430d80af None admin] RBAC: Adding query filter params (role.id=46e323c1a7614208aaaa8a31c9186f4a, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=0043a7d5877f41de905afe6bef355867) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:06.188712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf017f4c-776f-46d9-a572-d2c5430d80af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:06.190138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf017f4c-776f-46d9-a572-d2c5430d80af None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:06.192948 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:06.202964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 564/1106] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:30:05 2022] GET /identity/v3/role_assignments?user.id=0043a7d5877f41de905afe6bef355867&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=46e323c1a7614208aaaa8a31c9186f4a => generated 610 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:07.977964 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb553702-a216-43e2-9ea1-b3edf484419a None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:07.978490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb553702-a216-43e2-9ea1-b3edf484419a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:07.978627 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb553702-a216-43e2-9ea1-b3edf484419a None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:07.979930 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 543/1107] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:07.985285 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf246442-0338-4572-a5e1-0ac49a2363ba None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:07.985713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf246442-0338-4572-a5e1-0ac49a2363ba None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:07.985849 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf246442-0338-4572-a5e1-0ac49a2363ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:08.003228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-bf246442-0338-4572-a5e1-0ac49a2363ba None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:08.004414 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bf246442-0338-4572-a5e1-0ac49a2363ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:08.069712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 565/1108] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:07 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:08.094679 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb553702-a216-43e2-9ea1-b3edf484419a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:08.192030 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb553702-a216-43e2-9ea1-b3edf484419a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:08.205128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:08.225995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7889c7d-ba08-4c8f-b9d6-630f4e01ed39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:08.226815 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7889c7d-ba08-4c8f-b9d6-630f4e01ed39 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:08.227100 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7889c7d-ba08-4c8f-b9d6-630f4e01ed39 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:08.227372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7889c7d-ba08-4c8f-b9d6-630f4e01ed39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:08.228604 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7889c7d-ba08-4c8f-b9d6-630f4e01ed39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:08.229973 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7889c7d-ba08-4c8f-b9d6-630f4e01ed39 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:08.231613 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 544/1109] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:30:08 2022] GET /identity/v3/domains/default => generated 200 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:08.237899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf246442-0338-4572-a5e1-0ac49a2363ba None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:08.334324 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf246442-0338-4572-a5e1-0ac49a2363ba None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:08.360329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:08.368408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be18c9-a27c-4aa7-889a-b83fbce799de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:08.369086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be18c9-a27c-4aa7-889a-b83fbce799de None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:08.369371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be18c9-a27c-4aa7-889a-b83fbce799de None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:08.369655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be18c9-a27c-4aa7-889a-b83fbce799de None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:08.370375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be18c9-a27c-4aa7-889a-b83fbce799de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:08.372095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be18c9-a27c-4aa7-889a-b83fbce799de None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:08.392341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 566/1110] 10.222.0.110 () {60 vars in 1137 bytes} [Thu May 26 16:30:08 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:30:10.609361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5460b6-ee6f-4d9f-98a9-46de2c869e5b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:10.609910 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5460b6-ee6f-4d9f-98a9-46de2c869e5b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:10.609910 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5460b6-ee6f-4d9f-98a9-46de2c869e5b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:10.611335 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 545/1111] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:10.616638 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb9b51-6d48-4895-b62d-b1d0ab03575d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:10.617058 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb9b51-6d48-4895-b62d-b1d0ab03575d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:10.617204 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb9b51-6d48-4895-b62d-b1d0ab03575d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:10.634092 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-dccb9b51-6d48-4895-b62d-b1d0ab03575d None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:10.635245 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dccb9b51-6d48-4895-b62d-b1d0ab03575d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:10.699363 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 567/1112] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:10 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:10.723415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5460b6-ee6f-4d9f-98a9-46de2c869e5b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:10.821833 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5460b6-ee6f-4d9f-98a9-46de2c869e5b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:10.854847 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d3069-1dba-4da9-ae75-61d4d17baa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:10.855699 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d3069-1dba-4da9-ae75-61d4d17baa0d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:10.855987 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d3069-1dba-4da9-ae75-61d4d17baa0d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:10.856258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d3069-1dba-4da9-ae75-61d4d17baa0d None admin] PATH_INFO: `/v3/roles/634cfaacf2e444359b518d8dc7ed122b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:10.858251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d3069-1dba-4da9-ae75-61d4d17baa0d None admin] RBAC: Authorizing `identity:get_role(role_id=634cfaacf2e444359b518d8dc7ed122b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:10.859637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d3069-1dba-4da9-ae75-61d4d17baa0d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:10.860992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 546/1113] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:30:10 2022] GET /identity/v3/roles/634cfaacf2e444359b518d8dc7ed122b => generated 224 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:10.866687 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb9b51-6d48-4895-b62d-b1d0ab03575d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:10.962868 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb9b51-6d48-4895-b62d-b1d0ab03575d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:10.976854 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:10.998214 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8432d-7609-4f7c-bd9a-796c738a7c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:10.999125 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8432d-7609-4f7c-bd9a-796c738a7c3b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:10.999409 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8432d-7609-4f7c-bd9a-796c738a7c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:10.999689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8432d-7609-4f7c-bd9a-796c738a7c3b None admin] PATH_INFO: `/v3/users/04351825f7084fcaa5774c1353744ae7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:11.012559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8432d-7609-4f7c-bd9a-796c738a7c3b None admin] RBAC: Authorizing `identity:get_user(user_id=04351825f7084fcaa5774c1353744ae7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:11.014015 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8432d-7609-4f7c-bd9a-796c738a7c3b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:11.015692 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 568/1114] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:30:10 2022] GET /identity/v3/users/04351825f7084fcaa5774c1353744ae7 => generated 287 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:11.021496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d3069-1dba-4da9-ae75-61d4d17baa0d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:11.069922 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:11.121735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d3069-1dba-4da9-ae75-61d4d17baa0d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:11.158100 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d612e9-3c49-4597-a006-37124888d724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:11.158802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d612e9-3c49-4597-a006-37124888d724 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:11.159096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d612e9-3c49-4597-a006-37124888d724 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:11.159377 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d612e9-3c49-4597-a006-37124888d724 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:11.238102 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d612e9-3c49-4597-a006-37124888d724 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:11.239572 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d612e9-3c49-4597-a006-37124888d724 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:11.285445 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:11.336570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 547/1115] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:30:11 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:11.342513 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8432d-7609-4f7c-bd9a-796c738a7c3b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:11.449212 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8432d-7609-4f7c-bd9a-796c738a7c3b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:11.485089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24ba97-e95f-4e28-bbec-890f85ba646d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:11.485958 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24ba97-e95f-4e28-bbec-890f85ba646d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:11.486247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24ba97-e95f-4e28-bbec-890f85ba646d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:11.486726 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24ba97-e95f-4e28-bbec-890f85ba646d None admin] PATH_INFO: `/v3/projects/bc7aa7f88b1a4e59930d87f717ff7395` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:11.488540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24ba97-e95f-4e28-bbec-890f85ba646d None admin] RBAC: Authorizing `identity:get_project(project_id=bc7aa7f88b1a4e59930d87f717ff7395)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:11.490004 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24ba97-e95f-4e28-bbec-890f85ba646d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:11.491953 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 569/1116] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:30:11 2022] GET /identity/v3/projects/bc7aa7f88b1a4e59930d87f717ff7395 => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:11.498699 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d612e9-3c49-4597-a006-37124888d724 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:11.601618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d612e9-3c49-4597-a006-37124888d724 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:11.644365 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e8087-98d7-4d8a-abd8-b5867ed991e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:11.645476 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e8087-98d7-4d8a-abd8-b5867ed991e0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:11.645959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e8087-98d7-4d8a-abd8-b5867ed991e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:11.646428 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e8087-98d7-4d8a-abd8-b5867ed991e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:11.648026 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e8087-98d7-4d8a-abd8-b5867ed991e0 None admin] RBAC: Adding query filter params (role.id=634cfaacf2e444359b518d8dc7ed122b, scope.project.id=bc7aa7f88b1a4e59930d87f717ff7395, user.id=04351825f7084fcaa5774c1353744ae7) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:11.648587 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e8087-98d7-4d8a-abd8-b5867ed991e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:11.651171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e8087-98d7-4d8a-abd8-b5867ed991e0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:11.660737 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 548/1117] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:30:11 2022] GET /identity/v3/role_assignments?user.id=04351825f7084fcaa5774c1353744ae7&scope.project.id=bc7aa7f88b1a4e59930d87f717ff7395&role.id=634cfaacf2e444359b518d8dc7ed122b => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:13.911614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5c107-097b-4d18-b425-28e388d6534a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:13.912135 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5c107-097b-4d18-b425-28e388d6534a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:13.912256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5c107-097b-4d18-b425-28e388d6534a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:13.913537 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 570/1118] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:13.918869 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7307a4-4667-4345-9829-a75465bc5480 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:13.919299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7307a4-4667-4345-9829-a75465bc5480 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:13.919430 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7307a4-4667-4345-9829-a75465bc5480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:13.936249 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4d7307a4-4667-4345-9829-a75465bc5480 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:13.937420 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4d7307a4-4667-4345-9829-a75465bc5480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:13.944559 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:14.002538 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 549/1119] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:13 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:14.025131 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5c107-097b-4d18-b425-28e388d6534a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:14.067858 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:14.127426 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5c107-097b-4d18-b425-28e388d6534a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:14.160431 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2d6d2-3601-40b5-b148-02b680784a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:14.161278 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2d6d2-3601-40b5-b148-02b680784a44 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:14.161562 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2d6d2-3601-40b5-b148-02b680784a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:14.161888 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2d6d2-3601-40b5-b148-02b680784a44 None admin] PATH_INFO: `/v3/roles/634cfaacf2e444359b518d8dc7ed122b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:14.163326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2d6d2-3601-40b5-b148-02b680784a44 None admin] RBAC: Authorizing `identity:get_role(role_id=634cfaacf2e444359b518d8dc7ed122b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:14.164694 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2d6d2-3601-40b5-b148-02b680784a44 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:14.166064 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 571/1120] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:30:14 2022] GET /identity/v3/roles/634cfaacf2e444359b518d8dc7ed122b => generated 224 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:14.172511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7307a4-4667-4345-9829-a75465bc5480 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:14.269737 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7307a4-4667-4345-9829-a75465bc5480 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:14.302596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f36b0-a745-4b94-9e11-6af74680eabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:14.303482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f36b0-a745-4b94-9e11-6af74680eabe None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:14.303768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f36b0-a745-4b94-9e11-6af74680eabe None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:14.304050 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f36b0-a745-4b94-9e11-6af74680eabe None admin] PATH_INFO: `/v3/users/04351825f7084fcaa5774c1353744ae7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:14.305222 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f36b0-a745-4b94-9e11-6af74680eabe None admin] RBAC: Authorizing `identity:get_user(user_id=04351825f7084fcaa5774c1353744ae7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:14.306686 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f36b0-a745-4b94-9e11-6af74680eabe None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:14.308589 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 550/1121] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:30:14 2022] GET /identity/v3/users/04351825f7084fcaa5774c1353744ae7 => generated 287 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:14.314751 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2d6d2-3601-40b5-b148-02b680784a44 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:14.410123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2d6d2-3601-40b5-b148-02b680784a44 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:14.420093 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:14.445134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55c1a3-9b4a-4425-86a8-acb0206d63ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:14.445990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55c1a3-9b4a-4425-86a8-acb0206d63ba None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:14.446271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55c1a3-9b4a-4425-86a8-acb0206d63ba None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:14.446544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55c1a3-9b4a-4425-86a8-acb0206d63ba None admin] PATH_INFO: `/v3/projects/bc7aa7f88b1a4e59930d87f717ff7395` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:14.447726 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55c1a3-9b4a-4425-86a8-acb0206d63ba None admin] RBAC: Authorizing `identity:get_project(project_id=bc7aa7f88b1a4e59930d87f717ff7395)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:14.449137 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55c1a3-9b4a-4425-86a8-acb0206d63ba None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:14.450888 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 572/1122] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:30:14 2022] GET /identity/v3/projects/bc7aa7f88b1a4e59930d87f717ff7395 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:14.456865 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f36b0-a745-4b94-9e11-6af74680eabe None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:14.468881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:14.554208 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f36b0-a745-4b94-9e11-6af74680eabe None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:14.586885 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba63ef-7ed1-4977-93ae-08f817e60954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:14.587769 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba63ef-7ed1-4977-93ae-08f817e60954 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:14.588062 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba63ef-7ed1-4977-93ae-08f817e60954 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:14.588343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba63ef-7ed1-4977-93ae-08f817e60954 None admin] PATH_INFO: `/v3/projects/bc7aa7f88b1a4e59930d87f717ff7395/users/04351825f7084fcaa5774c1353744ae7/roles/634cfaacf2e444359b518d8dc7ed122b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:14.590606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba63ef-7ed1-4977-93ae-08f817e60954 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc7aa7f88b1a4e59930d87f717ff7395, user_id=04351825f7084fcaa5774c1353744ae7, role_id=634cfaacf2e444359b518d8dc7ed122b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:14.592029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba63ef-7ed1-4977-93ae-08f817e60954 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:14.605106 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 551/1123] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:30:14 2022] PUT /identity/v3/projects/bc7aa7f88b1a4e59930d87f717ff7395/users/04351825f7084fcaa5774c1353744ae7/roles/634cfaacf2e444359b518d8dc7ed122b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:30:16.786736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc488cd-16b3-4355-a94e-5f7ce986ef51 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:16.787273 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc488cd-16b3-4355-a94e-5f7ce986ef51 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:16.787273 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc488cd-16b3-4355-a94e-5f7ce986ef51 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:16.788654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 573/1124] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:16.794026 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f01d2-0d95-4d8d-918f-7a815d506c88 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:16.794438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f01d2-0d95-4d8d-918f-7a815d506c88 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:16.794731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f01d2-0d95-4d8d-918f-7a815d506c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:16.810906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-387f01d2-0d95-4d8d-918f-7a815d506c88 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:16.812084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-387f01d2-0d95-4d8d-918f-7a815d506c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:16.873669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:16.879463 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 552/1125] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:16 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:16.903190 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc488cd-16b3-4355-a94e-5f7ce986ef51 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:17.003712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc488cd-16b3-4355-a94e-5f7ce986ef51 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:17.036818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d199a6-d123-4d6d-b258-ec5cd298c297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:17.037612 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d199a6-d123-4d6d-b258-ec5cd298c297 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:17.037914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d199a6-d123-4d6d-b258-ec5cd298c297 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:17.038175 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d199a6-d123-4d6d-b258-ec5cd298c297 None admin] PATH_INFO: `/v3/roles/634cfaacf2e444359b518d8dc7ed122b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:17.039686 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d199a6-d123-4d6d-b258-ec5cd298c297 None admin] RBAC: Authorizing `identity:get_role(role_id=634cfaacf2e444359b518d8dc7ed122b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:17.041049 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d199a6-d123-4d6d-b258-ec5cd298c297 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:17.042420 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 574/1126] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:30:16 2022] GET /identity/v3/roles/634cfaacf2e444359b518d8dc7ed122b => generated 224 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:17.048265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f01d2-0d95-4d8d-918f-7a815d506c88 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:17.147526 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f01d2-0d95-4d8d-918f-7a815d506c88 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:17.181827 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8babb2c-d35e-4863-9d1b-500435c1691c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:17.182729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8babb2c-d35e-4863-9d1b-500435c1691c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:17.183015 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8babb2c-d35e-4863-9d1b-500435c1691c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:17.183289 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8babb2c-d35e-4863-9d1b-500435c1691c None admin] PATH_INFO: `/v3/users/04351825f7084fcaa5774c1353744ae7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:17.184982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8babb2c-d35e-4863-9d1b-500435c1691c None admin] RBAC: Authorizing `identity:get_user(user_id=04351825f7084fcaa5774c1353744ae7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:17.186400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8babb2c-d35e-4863-9d1b-500435c1691c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:17.188082 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 553/1127] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:30:17 2022] GET /identity/v3/users/04351825f7084fcaa5774c1353744ae7 => generated 287 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:17.194000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d199a6-d123-4d6d-b258-ec5cd298c297 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:17.239421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:17.296642 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d199a6-d123-4d6d-b258-ec5cd298c297 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:17.329612 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640bf94-72e6-4fe2-bef7-3896cfdead7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:17.330330 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640bf94-72e6-4fe2-bef7-3896cfdead7b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:17.330645 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640bf94-72e6-4fe2-bef7-3896cfdead7b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:17.330926 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640bf94-72e6-4fe2-bef7-3896cfdead7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:17.402055 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640bf94-72e6-4fe2-bef7-3896cfdead7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:17.404479 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640bf94-72e6-4fe2-bef7-3896cfdead7b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:17.447420 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:17.503966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 575/1128] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:30:17 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:17.510039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8babb2c-d35e-4863-9d1b-500435c1691c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:17.580181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:17.613892 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8babb2c-d35e-4863-9d1b-500435c1691c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:17.647729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66d764-3014-4d7f-8e50-886397606bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:17.648591 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66d764-3014-4d7f-8e50-886397606bfc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:17.648875 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66d764-3014-4d7f-8e50-886397606bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:17.649147 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66d764-3014-4d7f-8e50-886397606bfc None admin] PATH_INFO: `/v3/projects/bc7aa7f88b1a4e59930d87f717ff7395` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:17.650302 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66d764-3014-4d7f-8e50-886397606bfc None admin] RBAC: Authorizing `identity:get_project(project_id=bc7aa7f88b1a4e59930d87f717ff7395)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:17.651752 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66d764-3014-4d7f-8e50-886397606bfc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:17.654089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 554/1129] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:30:17 2022] GET /identity/v3/projects/bc7aa7f88b1a4e59930d87f717ff7395 => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:17.660242 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640bf94-72e6-4fe2-bef7-3896cfdead7b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:17.760670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640bf94-72e6-4fe2-bef7-3896cfdead7b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:17.794493 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90921d-d5fb-4659-abca-bfa3dbfb079b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:17.795159 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90921d-d5fb-4659-abca-bfa3dbfb079b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:17.795448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90921d-d5fb-4659-abca-bfa3dbfb079b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:17.795730 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90921d-d5fb-4659-abca-bfa3dbfb079b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:17.796556 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90921d-d5fb-4659-abca-bfa3dbfb079b None admin] RBAC: Adding query filter params (role.id=634cfaacf2e444359b518d8dc7ed122b, scope.project.id=bc7aa7f88b1a4e59930d87f717ff7395, user.id=04351825f7084fcaa5774c1353744ae7) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:17.796873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90921d-d5fb-4659-abca-bfa3dbfb079b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:17.798295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90921d-d5fb-4659-abca-bfa3dbfb079b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:17.804179 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 576/1130] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:30:17 2022] GET /identity/v3/role_assignments?user.id=04351825f7084fcaa5774c1353744ae7&scope.project.id=bc7aa7f88b1a4e59930d87f717ff7395&role.id=634cfaacf2e444359b518d8dc7ed122b => generated 610 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:20.022114 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495972a-5392-4bc7-b768-ad8af2a32f18 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:20.022666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495972a-5392-4bc7-b768-ad8af2a32f18 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:20.022763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495972a-5392-4bc7-b768-ad8af2a32f18 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:20.024084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 555/1131] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:20.029365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b2e1d-64cd-4d91-ad09-f65931872cf6 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:20.029785 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b2e1d-64cd-4d91-ad09-f65931872cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:20.029928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b2e1d-64cd-4d91-ad09-f65931872cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:20.046437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1e3b2e1d-64cd-4d91-ad09-f65931872cf6 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:20.047670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1e3b2e1d-64cd-4d91-ad09-f65931872cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:20.049715 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:20.113825 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 577/1132] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:20 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:20.138359 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495972a-5392-4bc7-b768-ad8af2a32f18 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:20.238536 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495972a-5392-4bc7-b768-ad8af2a32f18 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:20.272540 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5bccb-686c-452c-89e1-86f85654f8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:20.273271 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5bccb-686c-452c-89e1-86f85654f8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:20.273556 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5bccb-686c-452c-89e1-86f85654f8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:20.273832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5bccb-686c-452c-89e1-86f85654f8f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:20.275031 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5bccb-686c-452c-89e1-86f85654f8f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:20.276474 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5bccb-686c-452c-89e1-86f85654f8f1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:20.278132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 556/1133] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:30:20 2022] GET /identity/v3/domains/default => generated 200 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:20.283981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b2e1d-64cd-4d91-ad09-f65931872cf6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:20.385757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b2e1d-64cd-4d91-ad09-f65931872cf6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:20.419200 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531098bf-b498-44bc-8833-6872b2bf1dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:20.419855 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531098bf-b498-44bc-8833-6872b2bf1dc4 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:20.420144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531098bf-b498-44bc-8833-6872b2bf1dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:20.420424 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531098bf-b498-44bc-8833-6872b2bf1dc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:20.421140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531098bf-b498-44bc-8833-6872b2bf1dc4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:20.422562 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531098bf-b498-44bc-8833-6872b2bf1dc4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:20.430286 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:20.447709 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 578/1134] 10.222.0.110 () {60 vars in 1146 bytes} [Thu May 26 16:30:20 2022] POST /identity/v3/projects => generated 312 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:30:22.655931 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19466d6d-95d5-41ed-b9cb-f8ee3925f833 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:22.656442 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19466d6d-95d5-41ed-b9cb-f8ee3925f833 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:22.656442 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19466d6d-95d5-41ed-b9cb-f8ee3925f833 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:22.657820 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 557/1135] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:22.662929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855901b-2e40-4506-bb17-af1c66fd21c2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:22.663323 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855901b-2e40-4506-bb17-af1c66fd21c2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:22.663497 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855901b-2e40-4506-bb17-af1c66fd21c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:22.680631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8855901b-2e40-4506-bb17-af1c66fd21c2 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:22.681816 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8855901b-2e40-4506-bb17-af1c66fd21c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:22.748094 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 579/1136] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:22 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:22.772556 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19466d6d-95d5-41ed-b9cb-f8ee3925f833 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:22.776367 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:22.874249 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19466d6d-95d5-41ed-b9cb-f8ee3925f833 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:22.907924 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cafa4-27fb-4bcf-8cf2-e1de4eed33b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:22.908668 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cafa4-27fb-4bcf-8cf2-e1de4eed33b6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:22.908954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cafa4-27fb-4bcf-8cf2-e1de4eed33b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:22.909240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cafa4-27fb-4bcf-8cf2-e1de4eed33b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:22.910419 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cafa4-27fb-4bcf-8cf2-e1de4eed33b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:22.911877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cafa4-27fb-4bcf-8cf2-e1de4eed33b6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:22.913489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 558/1137] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:30:22 2022] GET /identity/v3/domains/default => generated 200 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:22.919862 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855901b-2e40-4506-bb17-af1c66fd21c2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:23.016789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855901b-2e40-4506-bb17-af1c66fd21c2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:23.036896 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:23.052272 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9144179-4787-4dfc-8ce6-a466786fe3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:23.052935 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9144179-4787-4dfc-8ce6-a466786fe3fc None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:23.053218 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9144179-4787-4dfc-8ce6-a466786fe3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:23.053553 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9144179-4787-4dfc-8ce6-a466786fe3fc None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:23.054383 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9144179-4787-4dfc-8ce6-a466786fe3fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:23.056120 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9144179-4787-4dfc-8ce6-a466786fe3fc None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:23.079155 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 580/1138] 10.222.0.110 () {60 vars in 1137 bytes} [Thu May 26 16:30:22 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:30:25.306264 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67832aaa-4641-4a98-bdb8-f596cf46dc7d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:25.306877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67832aaa-4641-4a98-bdb8-f596cf46dc7d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:25.306877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67832aaa-4641-4a98-bdb8-f596cf46dc7d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:25.308783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 559/1139] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:25.313925 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a624a4e-9bf1-4060-a896-36f9d0528f9e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:25.314350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a624a4e-9bf1-4060-a896-36f9d0528f9e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:25.314495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a624a4e-9bf1-4060-a896-36f9d0528f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:25.331444 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7a624a4e-9bf1-4060-a896-36f9d0528f9e None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:25.332626 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7a624a4e-9bf1-4060-a896-36f9d0528f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:25.399927 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 581/1140] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:25 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:25.422845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67832aaa-4641-4a98-bdb8-f596cf46dc7d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:25.491905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:25.522109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67832aaa-4641-4a98-bdb8-f596cf46dc7d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:25.554771 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d95137-1dc1-4671-a11b-e1dc7ca5eda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:25.555572 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d95137-1dc1-4671-a11b-e1dc7ca5eda5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:25.555861 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d95137-1dc1-4671-a11b-e1dc7ca5eda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:25.556142 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d95137-1dc1-4671-a11b-e1dc7ca5eda5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:25.566915 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d95137-1dc1-4671-a11b-e1dc7ca5eda5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:25.574630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-05d95137-1dc1-4671-a11b-e1dc7ca5eda5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:25.574630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:25.574630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:25.574630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:25.574630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:25.574630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:25.574630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:25.574630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:25.574630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:25.574630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:25.574630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:25.574630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:25.574630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:25.574630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:25.574630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:25.574630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:25.575623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:25.575623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:25.575623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:25.575623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:25.575623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:25.575623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:25.575623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:25.575623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:25.575623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:25.575623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:25.575623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:25.575623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:30:25.575623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:25.575623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:25.575623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:25.575623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:25.576633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:25.576633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:25.576633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:25.576633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:25.576633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:25.576633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:25.576633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:25.576633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:25.576633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:25.576633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:25.576633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:25.576633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:30:25.576633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 560/1141] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:30:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:25.581774 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a624a4e-9bf1-4060-a896-36f9d0528f9e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:25.678982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a624a4e-9bf1-4060-a896-36f9d0528f9e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:25.686997 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:25.713959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f070768-d279-4c57-82f9-de9fc2929ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:25.715271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f070768-d279-4c57-82f9-de9fc2929ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:25.715563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f070768-d279-4c57-82f9-de9fc2929ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:25.715845 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f070768-d279-4c57-82f9-de9fc2929ac2 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:25.716592 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f070768-d279-4c57-82f9-de9fc2929ac2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:25.716905 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f070768-d279-4c57-82f9-de9fc2929ac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:25.718274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f070768-d279-4c57-82f9-de9fc2929ac2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:25.726113 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 582/1142] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:30:25 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:25.732006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d95137-1dc1-4671-a11b-e1dc7ca5eda5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:25.830291 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d95137-1dc1-4671-a11b-e1dc7ca5eda5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:25.858945 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:25.863982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04bd14-f1aa-4d85-bef8-42714eb4513d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:25.864854 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04bd14-f1aa-4d85-bef8-42714eb4513d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:25.865141 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04bd14-f1aa-4d85-bef8-42714eb4513d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:25.865427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04bd14-f1aa-4d85-bef8-42714eb4513d None admin] PATH_INFO: `/v3/users/2edb64a372c244a390b75c2eec505886` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:25.878870 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04bd14-f1aa-4d85-bef8-42714eb4513d None admin] RBAC: Authorizing `identity:get_user(user_id=2edb64a372c244a390b75c2eec505886)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:25.880311 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04bd14-f1aa-4d85-bef8-42714eb4513d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:25.881976 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 561/1143] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:30:25 2022] GET /identity/v3/users/2edb64a372c244a390b75c2eec505886 => generated 287 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:25.888392 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f070768-d279-4c57-82f9-de9fc2929ac2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:25.986388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f070768-d279-4c57-82f9-de9fc2929ac2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:26.019128 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9374161-fa64-4f4e-8027-cfe8b046ebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:26.019771 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9374161-fa64-4f4e-8027-cfe8b046ebf6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:26.020056 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9374161-fa64-4f4e-8027-cfe8b046ebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:26.020335 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9374161-fa64-4f4e-8027-cfe8b046ebf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:26.053627 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:26.084697 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9374161-fa64-4f4e-8027-cfe8b046ebf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:26.086077 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9374161-fa64-4f4e-8027-cfe8b046ebf6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:26.180754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 583/1144] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:30:25 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:26.187347 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04bd14-f1aa-4d85-bef8-42714eb4513d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:26.284501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04bd14-f1aa-4d85-bef8-42714eb4513d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:26.317762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486256a6-97c8-4df4-ba9c-89bbb48efd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:26.318660 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486256a6-97c8-4df4-ba9c-89bbb48efd0d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:26.318943 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486256a6-97c8-4df4-ba9c-89bbb48efd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:26.319218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486256a6-97c8-4df4-ba9c-89bbb48efd0d None admin] PATH_INFO: `/v3/projects/92cba7e4f41942688f9fc254bfbaa2a7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:26.320376 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486256a6-97c8-4df4-ba9c-89bbb48efd0d None admin] RBAC: Authorizing `identity:get_project(project_id=92cba7e4f41942688f9fc254bfbaa2a7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:26.321794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486256a6-97c8-4df4-ba9c-89bbb48efd0d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:26.323513 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 562/1145] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:30:26 2022] GET /identity/v3/projects/92cba7e4f41942688f9fc254bfbaa2a7 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:26.330113 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9374161-fa64-4f4e-8027-cfe8b046ebf6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:26.394739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:26.430485 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9374161-fa64-4f4e-8027-cfe8b046ebf6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:26.463165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae0533-b3e6-4a05-88b4-49ba95f68d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:26.463819 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae0533-b3e6-4a05-88b4-49ba95f68d3e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:26.464105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae0533-b3e6-4a05-88b4-49ba95f68d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:26.464424 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae0533-b3e6-4a05-88b4-49ba95f68d3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:26.465247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae0533-b3e6-4a05-88b4-49ba95f68d3e None admin] RBAC: Adding query filter params (role.id=1393d128d39b4649b6cd71b6609846cb, scope.project.id=92cba7e4f41942688f9fc254bfbaa2a7, user.id=2edb64a372c244a390b75c2eec505886) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:26.465561 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae0533-b3e6-4a05-88b4-49ba95f68d3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:26.467008 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae0533-b3e6-4a05-88b4-49ba95f68d3e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:26.472304 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 584/1146] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:30:26 2022] GET /identity/v3/role_assignments?user.id=2edb64a372c244a390b75c2eec505886&scope.project.id=92cba7e4f41942688f9fc254bfbaa2a7&role.id=1393d128d39b4649b6cd71b6609846cb => generated 260 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:28.627944 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb906b-1148-43dc-bc49-2b39426160da None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:28.628466 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb906b-1148-43dc-bc49-2b39426160da None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:28.628466 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb906b-1148-43dc-bc49-2b39426160da None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:28.629797 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 563/1147] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:28.635198 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454ff98-8e95-40a2-b571-a0c3980328bf None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:28.635625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454ff98-8e95-40a2-b571-a0c3980328bf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:28.635852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454ff98-8e95-40a2-b571-a0c3980328bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:28.652475 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d454ff98-8e95-40a2-b571-a0c3980328bf None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:28.653663 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d454ff98-8e95-40a2-b571-a0c3980328bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:28.719036 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 585/1148] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:28 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:28.741463 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb906b-1148-43dc-bc49-2b39426160da None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:28.799575 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:28.843688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb906b-1148-43dc-bc49-2b39426160da None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:28.876575 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc78a2-06b7-452c-aae2-f2ace821d5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:28.877369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc78a2-06b7-452c-aae2-f2ace821d5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:28.877651 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc78a2-06b7-452c-aae2-f2ace821d5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:28.877924 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc78a2-06b7-452c-aae2-f2ace821d5d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:28.888194 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc78a2-06b7-452c-aae2-f2ace821d5d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:28.895783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-89cc78a2-06b7-452c-aae2-f2ace821d5d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:28.895783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:28.895783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:28.895783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:28.895783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:28.895783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:28.895783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:28.895783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:28.895783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:28.895783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:28.895783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:28.895783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:28.895783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:28.895783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:28.895783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:28.895783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:28.896873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:28.896873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:28.896873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:28.896873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:28.896873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:28.896873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:28.896873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:28.896873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:28.896873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:28.896873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:28.896873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:28.896873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:30:28.896873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:28.896873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:28.896873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:28.896873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:28.897876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:28.897876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:28.897876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:28.897876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:28.897876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:28.897876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:28.897876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:28.897876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:28.897876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:28.897876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:28.897876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:28.897876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:30:28.897876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 564/1149] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:30:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:28.903714 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454ff98-8e95-40a2-b571-a0c3980328bf None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:28.962710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:29.001856 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454ff98-8e95-40a2-b571-a0c3980328bf None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:29.035511 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44092ed9-0809-4c5f-aeb4-d15b9099fca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:29.036171 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44092ed9-0809-4c5f-aeb4-d15b9099fca3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:29.036460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44092ed9-0809-4c5f-aeb4-d15b9099fca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:29.036740 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44092ed9-0809-4c5f-aeb4-d15b9099fca3 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:29.037479 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44092ed9-0809-4c5f-aeb4-d15b9099fca3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:29.037792 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44092ed9-0809-4c5f-aeb4-d15b9099fca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:29.039188 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44092ed9-0809-4c5f-aeb4-d15b9099fca3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:29.047670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 586/1150] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:30:28 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:29.053533 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc78a2-06b7-452c-aae2-f2ace821d5d3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:29.149257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc78a2-06b7-452c-aae2-f2ace821d5d3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:29.166112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:29.183527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17346a-042b-4746-b90a-0ef086f76521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:29.184410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17346a-042b-4746-b90a-0ef086f76521 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:29.184700 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17346a-042b-4746-b90a-0ef086f76521 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:29.184982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17346a-042b-4746-b90a-0ef086f76521 None admin] PATH_INFO: `/v3/users/2edb64a372c244a390b75c2eec505886` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:29.186160 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17346a-042b-4746-b90a-0ef086f76521 None admin] RBAC: Authorizing `identity:get_user(user_id=2edb64a372c244a390b75c2eec505886)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:29.187680 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17346a-042b-4746-b90a-0ef086f76521 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:29.189304 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 565/1151] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:30:29 2022] GET /identity/v3/users/2edb64a372c244a390b75c2eec505886 => generated 287 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:29.195092 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44092ed9-0809-4c5f-aeb4-d15b9099fca3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:29.293960 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44092ed9-0809-4c5f-aeb4-d15b9099fca3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:29.316707 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:29.327477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80640b15-879d-4282-8e7c-f3a6c162c949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:29.328331 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80640b15-879d-4282-8e7c-f3a6c162c949 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:29.328612 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80640b15-879d-4282-8e7c-f3a6c162c949 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:29.328884 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80640b15-879d-4282-8e7c-f3a6c162c949 None admin] PATH_INFO: `/v3/projects/92cba7e4f41942688f9fc254bfbaa2a7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:29.330039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80640b15-879d-4282-8e7c-f3a6c162c949 None admin] RBAC: Authorizing `identity:get_project(project_id=92cba7e4f41942688f9fc254bfbaa2a7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:29.331505 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80640b15-879d-4282-8e7c-f3a6c162c949 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:29.333201 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 587/1152] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:30:29 2022] GET /identity/v3/projects/92cba7e4f41942688f9fc254bfbaa2a7 => generated 312 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:29.339387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17346a-042b-4746-b90a-0ef086f76521 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:29.439041 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17346a-042b-4746-b90a-0ef086f76521 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:29.471498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f8f0f-ac8a-4927-b599-79cda2acb61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:29.472385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f8f0f-ac8a-4927-b599-79cda2acb61e None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:29.472671 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f8f0f-ac8a-4927-b599-79cda2acb61e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:29.472947 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f8f0f-ac8a-4927-b599-79cda2acb61e None admin] PATH_INFO: `/v3/projects/92cba7e4f41942688f9fc254bfbaa2a7/users/2edb64a372c244a390b75c2eec505886/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:29.474924 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f8f0f-ac8a-4927-b599-79cda2acb61e None admin] RBAC: Authorizing `identity:create_grant(project_id=92cba7e4f41942688f9fc254bfbaa2a7, user_id=2edb64a372c244a390b75c2eec505886, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:29.476351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f8f0f-ac8a-4927-b599-79cda2acb61e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:29.489820 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 566/1153] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:30:29 2022] PUT /identity/v3/projects/92cba7e4f41942688f9fc254bfbaa2a7/users/2edb64a372c244a390b75c2eec505886/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:30:31.648849 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bf5a5-b7c8-4996-b511-fe4523ce6ba1 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:31.649391 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bf5a5-b7c8-4996-b511-fe4523ce6ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:31.649391 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bf5a5-b7c8-4996-b511-fe4523ce6ba1 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:31.650748 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 588/1154] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:31.656699 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf40d0-6d0b-4eab-ac8a-47cdc492cd79 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:31.657142 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf40d0-6d0b-4eab-ac8a-47cdc492cd79 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:31.657383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf40d0-6d0b-4eab-ac8a-47cdc492cd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:31.674901 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4caf40d0-6d0b-4eab-ac8a-47cdc492cd79 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:31.676467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4caf40d0-6d0b-4eab-ac8a-47cdc492cd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:31.717709 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:31.743009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 567/1155] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:31 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:31.766766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bf5a5-b7c8-4996-b511-fe4523ce6ba1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:31.865284 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bf5a5-b7c8-4996-b511-fe4523ce6ba1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:31.898333 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e468a2d-5255-4015-8f89-bd0420d4f6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:31.899204 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e468a2d-5255-4015-8f89-bd0420d4f6df None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:31.899442 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e468a2d-5255-4015-8f89-bd0420d4f6df None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:31.899718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e468a2d-5255-4015-8f89-bd0420d4f6df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:31.910595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e468a2d-5255-4015-8f89-bd0420d4f6df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:31.918259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-1e468a2d-5255-4015-8f89-bd0420d4f6df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:31.918259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:31.918259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:31.918259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:31.918259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:31.918259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:31.918259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:31.918259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:31.918259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:31.918259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:31.918259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:31.918259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:31.918259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:31.918259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:31.918259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:31.918259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:31.919387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:31.919387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:31.919387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:31.919387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:31.919387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:31.919387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:31.919387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:31.919387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:31.919387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:31.919387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:31.919387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:31.919387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:30:31.919387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:31.919387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:31.919387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:31.919387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:31.920241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:31.920241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:31.920241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:31.920241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:31.920241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:31.920241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:31.920241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:31.920241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:31.920241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:31.920241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:31.920241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:31.920241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:30:31.920241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 589/1156] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:30:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:31.925515 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf40d0-6d0b-4eab-ac8a-47cdc492cd79 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:32.022380 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf40d0-6d0b-4eab-ac8a-47cdc492cd79 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:32.055586 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78d00e-bed4-4ac5-8c7c-61d7ccfd2135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:32.056268 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78d00e-bed4-4ac5-8c7c-61d7ccfd2135 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:32.056558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78d00e-bed4-4ac5-8c7c-61d7ccfd2135 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:32.056838 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78d00e-bed4-4ac5-8c7c-61d7ccfd2135 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:32.058093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78d00e-bed4-4ac5-8c7c-61d7ccfd2135 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:32.058407 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78d00e-bed4-4ac5-8c7c-61d7ccfd2135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:32.059810 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78d00e-bed4-4ac5-8c7c-61d7ccfd2135 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:32.067848 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 568/1157] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:30:31 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:32.074333 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e468a2d-5255-4015-8f89-bd0420d4f6df None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:32.125776 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:32.173757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e468a2d-5255-4015-8f89-bd0420d4f6df None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:32.206681 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37c397-9651-4855-8dc4-b66ea7112456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:32.207546 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37c397-9651-4855-8dc4-b66ea7112456 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:32.207830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37c397-9651-4855-8dc4-b66ea7112456 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:32.208104 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37c397-9651-4855-8dc4-b66ea7112456 None admin] PATH_INFO: `/v3/users/2edb64a372c244a390b75c2eec505886` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:32.209268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37c397-9651-4855-8dc4-b66ea7112456 None admin] RBAC: Authorizing `identity:get_user(user_id=2edb64a372c244a390b75c2eec505886)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:32.210716 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37c397-9651-4855-8dc4-b66ea7112456 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:32.212319 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 590/1158] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:30:32 2022] GET /identity/v3/users/2edb64a372c244a390b75c2eec505886 => generated 287 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:32.218218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78d00e-bed4-4ac5-8c7c-61d7ccfd2135 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:32.258434 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:32.316667 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78d00e-bed4-4ac5-8c7c-61d7ccfd2135 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:32.348900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df6f47-2a92-43f6-b90b-edc924fc6821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:32.349554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df6f47-2a92-43f6-b90b-edc924fc6821 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:32.349836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df6f47-2a92-43f6-b90b-edc924fc6821 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:32.350110 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df6f47-2a92-43f6-b90b-edc924fc6821 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:32.418109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df6f47-2a92-43f6-b90b-edc924fc6821 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:32.419574 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df6f47-2a92-43f6-b90b-edc924fc6821 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:32.455875 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:32.516038 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 569/1159] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:30:32 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:32.521943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37c397-9651-4855-8dc4-b66ea7112456 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:32.625290 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37c397-9651-4855-8dc4-b66ea7112456 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:32.645039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:32.659833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24550a09-3ab9-49b9-bb5d-6f2c57e8e440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:32.660688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24550a09-3ab9-49b9-bb5d-6f2c57e8e440 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:32.660969 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24550a09-3ab9-49b9-bb5d-6f2c57e8e440 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:32.661243 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24550a09-3ab9-49b9-bb5d-6f2c57e8e440 None admin] PATH_INFO: `/v3/projects/92cba7e4f41942688f9fc254bfbaa2a7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:32.662405 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24550a09-3ab9-49b9-bb5d-6f2c57e8e440 None admin] RBAC: Authorizing `identity:get_project(project_id=92cba7e4f41942688f9fc254bfbaa2a7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:32.663906 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24550a09-3ab9-49b9-bb5d-6f2c57e8e440 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:32.665594 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 591/1160] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:30:32 2022] GET /identity/v3/projects/92cba7e4f41942688f9fc254bfbaa2a7 => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:32.671895 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df6f47-2a92-43f6-b90b-edc924fc6821 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:32.782450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df6f47-2a92-43f6-b90b-edc924fc6821 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:32.816863 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cca07-168d-4553-87c4-162c6bd63da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:32.817524 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cca07-168d-4553-87c4-162c6bd63da6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:32.817811 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cca07-168d-4553-87c4-162c6bd63da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:32.818090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cca07-168d-4553-87c4-162c6bd63da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:32.818958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cca07-168d-4553-87c4-162c6bd63da6 None admin] RBAC: Adding query filter params (role.id=1393d128d39b4649b6cd71b6609846cb, scope.project.id=92cba7e4f41942688f9fc254bfbaa2a7, user.id=2edb64a372c244a390b75c2eec505886) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:32.819272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cca07-168d-4553-87c4-162c6bd63da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:32.820725 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cca07-168d-4553-87c4-162c6bd63da6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:32.827518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 570/1161] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:30:32 2022] GET /identity/v3/role_assignments?user.id=2edb64a372c244a390b75c2eec505886&scope.project.id=92cba7e4f41942688f9fc254bfbaa2a7&role.id=1393d128d39b4649b6cd71b6609846cb => generated 610 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:35.064313 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca677a31-33c5-4ff1-9cab-42b7513539ff None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:35.064827 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca677a31-33c5-4ff1-9cab-42b7513539ff None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:35.064940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca677a31-33c5-4ff1-9cab-42b7513539ff None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:35.066234 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 592/1162] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:35.071718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde5261-fa9d-46ab-a40d-bf01d03a8924 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:35.072145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde5261-fa9d-46ab-a40d-bf01d03a8924 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:35.072283 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde5261-fa9d-46ab-a40d-bf01d03a8924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:35.077573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:35.091374 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4fde5261-fa9d-46ab-a40d-bf01d03a8924 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:35.092597 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4fde5261-fa9d-46ab-a40d-bf01d03a8924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:35.162287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 571/1163] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:35 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:35.185585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca677a31-33c5-4ff1-9cab-42b7513539ff None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:35.290222 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca677a31-33c5-4ff1-9cab-42b7513539ff None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:35.325310 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd0f91-3fc3-493a-8c09-aa4946f50acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:35.325882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd0f91-3fc3-493a-8c09-aa4946f50acc None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:35.326167 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd0f91-3fc3-493a-8c09-aa4946f50acc None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:35.326444 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd0f91-3fc3-493a-8c09-aa4946f50acc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:35.392995 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:35.405549 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd0f91-3fc3-493a-8c09-aa4946f50acc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:35.407066 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd0f91-3fc3-493a-8c09-aa4946f50acc None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:35.509530 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 593/1164] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:30:35 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:35.515734 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde5261-fa9d-46ab-a40d-bf01d03a8924 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:35.618538 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde5261-fa9d-46ab-a40d-bf01d03a8924 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:35.648848 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:35.655266 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0ffd7-2ff1-4956-b586-a539aedf5056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:35.656086 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0ffd7-2ff1-4956-b586-a539aedf5056 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:35.656374 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0ffd7-2ff1-4956-b586-a539aedf5056 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:35.656654 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0ffd7-2ff1-4956-b586-a539aedf5056 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:35.664890 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0ffd7-2ff1-4956-b586-a539aedf5056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:35.666340 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0ffd7-2ff1-4956-b586-a539aedf5056 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:35.680763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-71a0ffd7-2ff1-4956-b586-a539aedf5056 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 16:30:35.680763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:35.680763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 16:30:35.680763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 16:30:35.680763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:35.680763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:35.680763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:35.680763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:35.680763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 16:30:35.680763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:30:35.680763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:35.680763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:30:35.680763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:35.680763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:35.680763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:35.680763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:35.680763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:35.681859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:35.681859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:35.681859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:35.681859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:35.681859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:35.681859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:35.681859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:35.681859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:35.681859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:35.681859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:35.681859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:35.681859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:35.681859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:35.681859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:35.681859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:35.681859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:35.683388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:35.683388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:30:35.683388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:35.683388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:35.683388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:35.683388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:35.683388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:35.683388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:35.683388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:35.683388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:35.683388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 16:30:35.683388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:35.683388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 16:30:35.683388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:30:35.683388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 572/1165] 10.222.0.110 () {56 vars in 1122 bytes} [Thu May 26 16:30:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:35.688868 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd0f91-3fc3-493a-8c09-aa4946f50acc None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:35.781196 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:35.795327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd0f91-3fc3-493a-8c09-aa4946f50acc None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:35.830162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b1e4b-6f71-403e-9f31-8184bb583072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:35.830863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b1e4b-6f71-403e-9f31-8184bb583072 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:35.831148 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b1e4b-6f71-403e-9f31-8184bb583072 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:35.831427 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b1e4b-6f71-403e-9f31-8184bb583072 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:35.832565 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b1e4b-6f71-403e-9f31-8184bb583072 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:35.832880 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b1e4b-6f71-403e-9f31-8184bb583072 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:35.834247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b1e4b-6f71-403e-9f31-8184bb583072 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:35.842199 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 594/1166] 10.222.0.110 () {56 vars in 1120 bytes} [Thu May 26 16:30:35 2022] GET /identity/v3/domains?name=swift_test => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:38.064628 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f43d4-d67a-4c31-ba5a-78fbb91bc967 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:38.065147 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f43d4-d67a-4c31-ba5a-78fbb91bc967 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:38.065262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f43d4-d67a-4c31-ba5a-78fbb91bc967 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:38.066597 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 573/1167] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:38.072206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a3abe-e3a9-473e-8730-a65075dc3d29 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:38.072624 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a3abe-e3a9-473e-8730-a65075dc3d29 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:38.072786 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a3abe-e3a9-473e-8730-a65075dc3d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:38.090861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-854a3abe-e3a9-473e-8730-a65075dc3d29 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:38.092516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-854a3abe-e3a9-473e-8730-a65075dc3d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:38.161508 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 595/1168] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:38 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:30:38.185178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f43d4-d67a-4c31-ba5a-78fbb91bc967 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:38.293335 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f43d4-d67a-4c31-ba5a-78fbb91bc967 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:38.327963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f6558-72e4-4fd0-8791-56f291fecb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:38.328573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f6558-72e4-4fd0-8791-56f291fecb0c None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:38.328863 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f6558-72e4-4fd0-8791-56f291fecb0c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:38.329143 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f6558-72e4-4fd0-8791-56f291fecb0c None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:38.329884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f6558-72e4-4fd0-8791-56f291fecb0c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:38.331272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f6558-72e4-4fd0-8791-56f291fecb0c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:38.346384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 574/1169] 10.222.0.110 () {60 vars in 1143 bytes} [Thu May 26 16:30:38 2022] POST /identity/v3/domains => generated 268 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:30:40.584397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cbc2a-9ead-42ec-9953-a2f147d5645c None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:40.584916 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cbc2a-9ead-42ec-9953-a2f147d5645c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:40.585039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cbc2a-9ead-42ec-9953-a2f147d5645c None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:40.586324 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 596/1170] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:40.591516 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fe119-181a-4087-b1d4-98bfa4764b7b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:40.591912 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fe119-181a-4087-b1d4-98bfa4764b7b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:40.592086 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fe119-181a-4087-b1d4-98bfa4764b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:40.608773 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-208fe119-181a-4087-b1d4-98bfa4764b7b None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:40.609946 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-208fe119-181a-4087-b1d4-98bfa4764b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:40.655088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:40.675562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 575/1171] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:40 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:40.699256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cbc2a-9ead-42ec-9953-a2f147d5645c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:40.780330 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:40.802267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cbc2a-9ead-42ec-9953-a2f147d5645c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:40.838711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36f878-1c11-4281-a73b-575b62d718fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:40.839631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36f878-1c11-4281-a73b-575b62d718fd None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:40.839917 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36f878-1c11-4281-a73b-575b62d718fd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:40.840195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36f878-1c11-4281-a73b-575b62d718fd None admin] PATH_INFO: `/v3/domains/0c1dffec650646ba89897e8f66924864` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:40.850850 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36f878-1c11-4281-a73b-575b62d718fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=0c1dffec650646ba89897e8f66924864)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:40.852315 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36f878-1c11-4281-a73b-575b62d718fd None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:40.854881 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 597/1172] 10.222.0.110 () {56 vars in 1188 bytes} [Thu May 26 16:30:40 2022] GET /identity/v3/domains/0c1dffec650646ba89897e8f66924864 => generated 268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:40.860563 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fe119-181a-4087-b1d4-98bfa4764b7b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:40.959835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fe119-181a-4087-b1d4-98bfa4764b7b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:40.993331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9293761-c76c-48f5-9405-c54845471fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:40.994826 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9293761-c76c-48f5-9405-c54845471fd5 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:40.995108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9293761-c76c-48f5-9405-c54845471fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:40.995382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9293761-c76c-48f5-9405-c54845471fd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:40.996101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9293761-c76c-48f5-9405-c54845471fd5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:40.997525 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9293761-c76c-48f5-9405-c54845471fd5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:41.025068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 576/1173] 10.222.0.110 () {60 vars in 1146 bytes} [Thu May 26 16:30:40 2022] POST /identity/v3/projects => generated 362 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:30:43.238795 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cb1f3-f2c8-4099-9e9b-26bb9016752a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:43.239328 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cb1f3-f2c8-4099-9e9b-26bb9016752a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:43.239451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cb1f3-f2c8-4099-9e9b-26bb9016752a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:43.240725 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 598/1174] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:43.246782 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428f20f-2f82-4fa0-8cb5-0b94a6d6dc97 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:43.247174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428f20f-2f82-4fa0-8cb5-0b94a6d6dc97 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:43.247344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428f20f-2f82-4fa0-8cb5-0b94a6d6dc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:43.264132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e428f20f-2f82-4fa0-8cb5-0b94a6d6dc97 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:43.265311 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e428f20f-2f82-4fa0-8cb5-0b94a6d6dc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:43.290562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:43.330797 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 577/1175] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:43 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:43.355278 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cb1f3-f2c8-4099-9e9b-26bb9016752a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:43.455530 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cb1f3-f2c8-4099-9e9b-26bb9016752a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:43.487442 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf6775-bf0d-4d02-9fef-c6a1ab829f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:43.488298 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf6775-bf0d-4d02-9fef-c6a1ab829f04 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:43.488588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf6775-bf0d-4d02-9fef-c6a1ab829f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:43.488920 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf6775-bf0d-4d02-9fef-c6a1ab829f04 None admin] PATH_INFO: `/v3/domains/0c1dffec650646ba89897e8f66924864` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:43.490047 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf6775-bf0d-4d02-9fef-c6a1ab829f04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0c1dffec650646ba89897e8f66924864)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:43.491502 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf6775-bf0d-4d02-9fef-c6a1ab829f04 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:43.493124 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 599/1176] 10.222.0.110 () {56 vars in 1188 bytes} [Thu May 26 16:30:43 2022] GET /identity/v3/domains/0c1dffec650646ba89897e8f66924864 => generated 268 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:43.499835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428f20f-2f82-4fa0-8cb5-0b94a6d6dc97 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:43.598371 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428f20f-2f82-4fa0-8cb5-0b94a6d6dc97 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:43.631639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de2bc3-c2b6-4eb3-8281-ac3951f53da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:43.632329 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de2bc3-c2b6-4eb3-8281-ac3951f53da8 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:43.632616 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de2bc3-c2b6-4eb3-8281-ac3951f53da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:43.632889 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de2bc3-c2b6-4eb3-8281-ac3951f53da8 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:43.633580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de2bc3-c2b6-4eb3-8281-ac3951f53da8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:43.635143 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de2bc3-c2b6-4eb3-8281-ac3951f53da8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:43.654538 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 578/1177] 10.222.0.110 () {60 vars in 1137 bytes} [Thu May 26 16:30:43 2022] POST /identity/v3/users => generated 312 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:30:45.867328 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b5583-fdaa-4926-a2d7-6d2c1b5b246d None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:45.867889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b5583-fdaa-4926-a2d7-6d2c1b5b246d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:45.867889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b5583-fdaa-4926-a2d7-6d2c1b5b246d None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:45.869580 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 600/1178] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:45.874933 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c24339-f75e-48d2-bf82-5032d25b1347 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:45.875348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c24339-f75e-48d2-bf82-5032d25b1347 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:45.875500 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c24339-f75e-48d2-bf82-5032d25b1347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:45.892512 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-69c24339-f75e-48d2-bf82-5032d25b1347 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:45.893695 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-69c24339-f75e-48d2-bf82-5032d25b1347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:45.908032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:45.959605 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 579/1179] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:45 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:45.983764 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b5583-fdaa-4926-a2d7-6d2c1b5b246d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:45.996627 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:46.084171 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b5583-fdaa-4926-a2d7-6d2c1b5b246d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:46.116963 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ae8fe-0767-4d0b-a22c-8b11c4796786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:46.117799 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ae8fe-0767-4d0b-a22c-8b11c4796786 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:46.118036 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ae8fe-0767-4d0b-a22c-8b11c4796786 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:46.118560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ae8fe-0767-4d0b-a22c-8b11c4796786 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:46.130121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ae8fe-0767-4d0b-a22c-8b11c4796786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:46.138359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-b07ae8fe-0767-4d0b-a22c-8b11c4796786 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:46.138359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:46.138359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:46.138359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:46.138359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:46.138359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:46.138359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:46.138359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:46.138359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:46.138359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:46.138359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:46.138359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:46.138359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:46.138359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:46.138359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:46.138359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:46.139577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:46.139577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:46.139577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:46.139577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:46.139577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:46.139577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:46.139577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:46.139577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:46.139577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:46.139577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:46.139577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:46.139577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:30:46.139577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:46.139577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:46.139577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:46.139577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:46.140614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:46.140614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:46.140614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:46.140614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:46.140614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:46.140614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:46.140614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:46.140614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:46.140614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:46.140614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:46.140614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:46.140614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:30:46.140614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 601/1180] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:30:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:46.145498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c24339-f75e-48d2-bf82-5032d25b1347 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:46.242310 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c24339-f75e-48d2-bf82-5032d25b1347 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:46.274743 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174acd64-3790-4fe5-911c-135e0070ce6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:46.275905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174acd64-3790-4fe5-911c-135e0070ce6c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:46.276187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174acd64-3790-4fe5-911c-135e0070ce6c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:46.276459 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174acd64-3790-4fe5-911c-135e0070ce6c None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:46.277202 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174acd64-3790-4fe5-911c-135e0070ce6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:46.277509 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174acd64-3790-4fe5-911c-135e0070ce6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:46.278889 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174acd64-3790-4fe5-911c-135e0070ce6c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:46.286845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 580/1181] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:30:46 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:46.293225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ae8fe-0767-4d0b-a22c-8b11c4796786 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:46.361796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:46.393733 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ae8fe-0767-4d0b-a22c-8b11c4796786 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:46.426352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6055364-6278-4910-8b25-0307654e183c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:46.427244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6055364-6278-4910-8b25-0307654e183c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:46.427523 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6055364-6278-4910-8b25-0307654e183c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:46.427794 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6055364-6278-4910-8b25-0307654e183c None admin] PATH_INFO: `/v3/users/79f3bb0407bb49f3aefa01efbbc1334e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:46.441023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6055364-6278-4910-8b25-0307654e183c None admin] RBAC: Authorizing `identity:get_user(user_id=79f3bb0407bb49f3aefa01efbbc1334e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:46.442481 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6055364-6278-4910-8b25-0307654e183c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:46.444136 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 602/1182] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:30:46 2022] GET /identity/v3/users/79f3bb0407bb49f3aefa01efbbc1334e => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:46.450612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174acd64-3790-4fe5-911c-135e0070ce6c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:46.465339 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:46.546803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174acd64-3790-4fe5-911c-135e0070ce6c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:46.578815 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43044dda-2def-477f-a20c-fcc07f64f508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:46.579455 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43044dda-2def-477f-a20c-fcc07f64f508 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:46.579741 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43044dda-2def-477f-a20c-fcc07f64f508 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:46.580017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43044dda-2def-477f-a20c-fcc07f64f508 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:46.645817 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43044dda-2def-477f-a20c-fcc07f64f508 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:46.647227 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43044dda-2def-477f-a20c-fcc07f64f508 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:46.660589 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:46.742419 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 581/1183] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:30:46 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:46.749180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6055364-6278-4910-8b25-0307654e183c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:46.843875 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6055364-6278-4910-8b25-0307654e183c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:46.869841 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:46.877938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ccf72-64c2-418f-8c90-445712df857b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:46.878823 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ccf72-64c2-418f-8c90-445712df857b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:46.879111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ccf72-64c2-418f-8c90-445712df857b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:46.879389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ccf72-64c2-418f-8c90-445712df857b None admin] PATH_INFO: `/v3/projects/3e860af081fb464a999d746df2db49d2` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:46.880558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ccf72-64c2-418f-8c90-445712df857b None admin] RBAC: Authorizing `identity:get_project(project_id=3e860af081fb464a999d746df2db49d2)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:46.881993 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ccf72-64c2-418f-8c90-445712df857b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:46.883785 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 603/1184] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:30:46 2022] GET /identity/v3/projects/3e860af081fb464a999d746df2db49d2 => generated 362 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:46.890238 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43044dda-2def-477f-a20c-fcc07f64f508 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:46.986433 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43044dda-2def-477f-a20c-fcc07f64f508 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:46.999346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:47.020208 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34098f23-401c-4671-93a5-7e2bff3c18d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:47.020891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34098f23-401c-4671-93a5-7e2bff3c18d1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:47.021453 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34098f23-401c-4671-93a5-7e2bff3c18d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:47.021729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34098f23-401c-4671-93a5-7e2bff3c18d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:47.022548 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34098f23-401c-4671-93a5-7e2bff3c18d1 None admin] RBAC: Adding query filter params (role.id=1393d128d39b4649b6cd71b6609846cb, scope.project.id=3e860af081fb464a999d746df2db49d2, user.id=79f3bb0407bb49f3aefa01efbbc1334e) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:47.022892 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34098f23-401c-4671-93a5-7e2bff3c18d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:47.024314 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34098f23-401c-4671-93a5-7e2bff3c18d1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:47.030230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 582/1185] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:30:46 2022] GET /identity/v3/role_assignments?user.id=79f3bb0407bb49f3aefa01efbbc1334e&scope.project.id=3e860af081fb464a999d746df2db49d2&role.id=1393d128d39b4649b6cd71b6609846cb => generated 260 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:49.184535 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a13ce-22d1-4b78-b09a-54602a4dc2f2 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:49.185088 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a13ce-22d1-4b78-b09a-54602a4dc2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:49.185088 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a13ce-22d1-4b78-b09a-54602a4dc2f2 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:49.186475 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 604/1186] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:49.192105 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca8605-7a47-41f6-9da5-de12d8e0e993 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:49.192527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca8605-7a47-41f6-9da5-de12d8e0e993 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:49.192676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca8605-7a47-41f6-9da5-de12d8e0e993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:49.210821 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-03ca8605-7a47-41f6-9da5-de12d8e0e993 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:49.212069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-03ca8605-7a47-41f6-9da5-de12d8e0e993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:49.276478 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 583/1187] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:49 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:49.298399 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a13ce-22d1-4b78-b09a-54602a4dc2f2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:49.401097 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a13ce-22d1-4b78-b09a-54602a4dc2f2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:49.433960 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cc3f1-dbff-4ce3-90bf-34cdf9d3f5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:49.434909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cc3f1-dbff-4ce3-90bf-34cdf9d3f5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:49.435143 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cc3f1-dbff-4ce3-90bf-34cdf9d3f5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:49.435418 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cc3f1-dbff-4ce3-90bf-34cdf9d3f5b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:49.445153 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784cc3f1-dbff-4ce3-90bf-34cdf9d3f5b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:49.453397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-784cc3f1-dbff-4ce3-90bf-34cdf9d3f5b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:49.453397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:49.453397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:49.453397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:49.453397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:49.453397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:49.453397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:49.453397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:49.453397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:49.453397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:49.453397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:49.453397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:49.453397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:49.453397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:49.453397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:49.453397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:49.454451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:49.454451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:49.454451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:49.454451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:49.454451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:49.454451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:49.454451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:49.454451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:49.454451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:49.454451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:49.454451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:49.454451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:30:49.454451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:49.454451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:49.454451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:49.454451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:49.455336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:49.455336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:49.455336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:49.455336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:49.455336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:49.455336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:49.455336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:49.455336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:49.455336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:49.455336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:49.455336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:49.455336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:30:49.455336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 605/1188] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:30:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:49.460734 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca8605-7a47-41f6-9da5-de12d8e0e993 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:49.557298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca8605-7a47-41f6-9da5-de12d8e0e993 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:49.564381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:49.591054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d7796-8fbb-4211-b452-bb6b9d5409f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:49.591717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d7796-8fbb-4211-b452-bb6b9d5409f3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:49.592006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d7796-8fbb-4211-b452-bb6b9d5409f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:49.592284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d7796-8fbb-4211-b452-bb6b9d5409f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:49.593021 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d7796-8fbb-4211-b452-bb6b9d5409f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:49.593331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d7796-8fbb-4211-b452-bb6b9d5409f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:49.594711 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d7796-8fbb-4211-b452-bb6b9d5409f3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:49.602504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 584/1189] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:30:49 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:49.609086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cc3f1-dbff-4ce3-90bf-34cdf9d3f5b1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:49.677457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:49.721572 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cc3f1-dbff-4ce3-90bf-34cdf9d3f5b1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:49.753827 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e55e6-c0d4-477c-8068-fe42ba3808d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:49.754734 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e55e6-c0d4-477c-8068-fe42ba3808d8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:49.755025 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e55e6-c0d4-477c-8068-fe42ba3808d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:49.755306 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e55e6-c0d4-477c-8068-fe42ba3808d8 None admin] PATH_INFO: `/v3/users/79f3bb0407bb49f3aefa01efbbc1334e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:49.756489 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e55e6-c0d4-477c-8068-fe42ba3808d8 None admin] RBAC: Authorizing `identity:get_user(user_id=79f3bb0407bb49f3aefa01efbbc1334e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:49.757922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e55e6-c0d4-477c-8068-fe42ba3808d8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:49.760281 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 606/1190] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:30:49 2022] GET /identity/v3/users/79f3bb0407bb49f3aefa01efbbc1334e => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:49.766060 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d7796-8fbb-4211-b452-bb6b9d5409f3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:49.862316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d7796-8fbb-4211-b452-bb6b9d5409f3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:49.894670 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228407d0-e7dc-41cc-85c3-33e86945387b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:49.895529 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228407d0-e7dc-41cc-85c3-33e86945387b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:49.895813 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228407d0-e7dc-41cc-85c3-33e86945387b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:49.896091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228407d0-e7dc-41cc-85c3-33e86945387b None admin] PATH_INFO: `/v3/projects/3e860af081fb464a999d746df2db49d2` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:49.897254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228407d0-e7dc-41cc-85c3-33e86945387b None admin] RBAC: Authorizing `identity:get_project(project_id=3e860af081fb464a999d746df2db49d2)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:49.898695 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228407d0-e7dc-41cc-85c3-33e86945387b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:49.901032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 585/1191] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:30:49 2022] GET /identity/v3/projects/3e860af081fb464a999d746df2db49d2 => generated 362 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:49.907097 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e55e6-c0d4-477c-8068-fe42ba3808d8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:50.002693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e55e6-c0d4-477c-8068-fe42ba3808d8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:50.024951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:50.035539 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f1c5a-4d93-46e9-86fe-a2fa348af343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:50.036415 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1c5a-4d93-46e9-86fe-a2fa348af343 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:50.036700 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1c5a-4d93-46e9-86fe-a2fa348af343 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:50.036976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1c5a-4d93-46e9-86fe-a2fa348af343 None admin] PATH_INFO: `/v3/projects/3e860af081fb464a999d746df2db49d2/users/79f3bb0407bb49f3aefa01efbbc1334e/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:50.038933 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f1c5a-4d93-46e9-86fe-a2fa348af343 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e860af081fb464a999d746df2db49d2, user_id=79f3bb0407bb49f3aefa01efbbc1334e, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:50.040385 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f1c5a-4d93-46e9-86fe-a2fa348af343 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:50.053766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 607/1192] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:30:49 2022] PUT /identity/v3/projects/3e860af081fb464a999d746df2db49d2/users/79f3bb0407bb49f3aefa01efbbc1334e/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:30:52.217399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0c4ca-f149-4dbe-8f83-e12cf52ecaa9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:52.217984 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0c4ca-f149-4dbe-8f83-e12cf52ecaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:52.217984 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0c4ca-f149-4dbe-8f83-e12cf52ecaa9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:52.219649 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 586/1193] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:30:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:52.224927 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69cd60-8efc-4b7e-99ac-d4853c4cdebd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:52.225334 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69cd60-8efc-4b7e-99ac-d4853c4cdebd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:52.225491 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69cd60-8efc-4b7e-99ac-d4853c4cdebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:52.244013 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fb69cd60-8efc-4b7e-99ac-d4853c4cdebd None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:52.245202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fb69cd60-8efc-4b7e-99ac-d4853c4cdebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:52.310538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 608/1194] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:30:52 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:52.333924 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0c4ca-f149-4dbe-8f83-e12cf52ecaa9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:52.371896 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:52.437261 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0c4ca-f149-4dbe-8f83-e12cf52ecaa9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:52.470138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede4a8d-d90e-49bf-819c-71897b45153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:52.470894 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede4a8d-d90e-49bf-819c-71897b45153d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:52.471184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede4a8d-d90e-49bf-819c-71897b45153d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:52.471464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede4a8d-d90e-49bf-819c-71897b45153d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:52.481429 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede4a8d-d90e-49bf-819c-71897b45153d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:52.489170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4ede4a8d-d90e-49bf-819c-71897b45153d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:52.489170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:52.489170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:52.489170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:52.489170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:52.489170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:52.489170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:52.489170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:52.489170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:52.489170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:52.489170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:52.489170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:52.489170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:52.489170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:52.489170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:52.489170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:52.490284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:52.490284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:52.490284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:52.490284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:52.490284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:52.490284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:52.490284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:52.490284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:52.490284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:52.490284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:52.490284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:52.490284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:30:52.490284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:52.490284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:52.490284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:52.490284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:52.491412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:52.491412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:52.491412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:52.491412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:52.491412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:52.491412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:52.491412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:52.491412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:52.491412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:52.491412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:52.491412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:52.491412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:30:52.491412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 587/1195] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:30:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:52.497065 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69cd60-8efc-4b7e-99ac-d4853c4cdebd None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:52.592747 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69cd60-8efc-4b7e-99ac-d4853c4cdebd None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:52.606545 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:52.626950 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b999bd-4cb6-43ad-9982-ec376e854985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:52.627610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b999bd-4cb6-43ad-9982-ec376e854985 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:52.627896 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b999bd-4cb6-43ad-9982-ec376e854985 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:52.628175 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b999bd-4cb6-43ad-9982-ec376e854985 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:52.628923 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b999bd-4cb6-43ad-9982-ec376e854985 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:52.629220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b999bd-4cb6-43ad-9982-ec376e854985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:52.630595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b999bd-4cb6-43ad-9982-ec376e854985 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:52.638962 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 609/1196] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:30:52 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:52.644721 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede4a8d-d90e-49bf-819c-71897b45153d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:52.737751 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:52.744304 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede4a8d-d90e-49bf-819c-71897b45153d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:52.777422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9d438-cbe0-497d-9425-f984d66ec61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:52.778295 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9d438-cbe0-497d-9425-f984d66ec61c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:52.778594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9d438-cbe0-497d-9425-f984d66ec61c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:52.778880 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9d438-cbe0-497d-9425-f984d66ec61c None admin] PATH_INFO: `/v3/users/79f3bb0407bb49f3aefa01efbbc1334e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:52.780054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9d438-cbe0-497d-9425-f984d66ec61c None admin] RBAC: Authorizing `identity:get_user(user_id=79f3bb0407bb49f3aefa01efbbc1334e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:52.781471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9d438-cbe0-497d-9425-f984d66ec61c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:52.783120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 588/1197] 10.222.0.110 () {56 vars in 1182 bytes} [Thu May 26 16:30:52 2022] GET /identity/v3/users/79f3bb0407bb49f3aefa01efbbc1334e => generated 312 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:52.788764 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b999bd-4cb6-43ad-9982-ec376e854985 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:52.885163 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b999bd-4cb6-43ad-9982-ec376e854985 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:52.917899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fda5d-6941-45c2-88bb-302767b0e666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:52.918538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fda5d-6941-45c2-88bb-302767b0e666 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:52.918853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fda5d-6941-45c2-88bb-302767b0e666 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:52.919132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fda5d-6941-45c2-88bb-302767b0e666 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:52.961127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:52.984346 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fda5d-6941-45c2-88bb-302767b0e666 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:52.985779 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fda5d-6941-45c2-88bb-302767b0e666 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:53.080254 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 610/1198] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:30:52 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:53.086157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9d438-cbe0-497d-9425-f984d66ec61c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:53.182865 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9d438-cbe0-497d-9425-f984d66ec61c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:53.215225 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a952acf-f70a-498c-b141-cfc8a915094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:53.216072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a952acf-f70a-498c-b141-cfc8a915094e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:53.216355 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a952acf-f70a-498c-b141-cfc8a915094e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:53.216629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a952acf-f70a-498c-b141-cfc8a915094e None admin] PATH_INFO: `/v3/projects/3e860af081fb464a999d746df2db49d2` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:53.217784 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a952acf-f70a-498c-b141-cfc8a915094e None admin] RBAC: Authorizing `identity:get_project(project_id=3e860af081fb464a999d746df2db49d2)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:53.219239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a952acf-f70a-498c-b141-cfc8a915094e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:53.220899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 589/1199] 10.222.0.110 () {56 vars in 1191 bytes} [Thu May 26 16:30:53 2022] GET /identity/v3/projects/3e860af081fb464a999d746df2db49d2 => generated 362 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:53.226907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fda5d-6941-45c2-88bb-302767b0e666 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:53.300806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:53.323619 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fda5d-6941-45c2-88bb-302767b0e666 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:53.356348 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0297c22-5b63-4343-9a5d-f41a12f36af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:53.356934 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0297c22-5b63-4343-9a5d-f41a12f36af7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:53.357220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0297c22-5b63-4343-9a5d-f41a12f36af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:53.357529 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0297c22-5b63-4343-9a5d-f41a12f36af7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:53.358363 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0297c22-5b63-4343-9a5d-f41a12f36af7 None admin] RBAC: Adding query filter params (role.id=1393d128d39b4649b6cd71b6609846cb, scope.project.id=3e860af081fb464a999d746df2db49d2, user.id=79f3bb0407bb49f3aefa01efbbc1334e) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:53.358710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0297c22-5b63-4343-9a5d-f41a12f36af7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:53.360139 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0297c22-5b63-4343-9a5d-f41a12f36af7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:53.366060 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 611/1200] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:30:53 2022] GET /identity/v3/role_assignments?user.id=79f3bb0407bb49f3aefa01efbbc1334e&scope.project.id=3e860af081fb464a999d746df2db49d2&role.id=1393d128d39b4649b6cd71b6609846cb => generated 610 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:03.210587 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=84 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:03.363414 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=30 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:53.626469 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a02ab5-721b-4efa-8ee1-976efcddcba9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:53.627085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a02ab5-721b-4efa-8ee1-976efcddcba9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:53.627296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a02ab5-721b-4efa-8ee1-976efcddcba9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:53.629375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 590/1201] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:31:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:31:53.634727 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dff25-1f5e-4f27-8d81-92d996364871 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:53.635322 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dff25-1f5e-4f27-8d81-92d996364871 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:53.635322 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dff25-1f5e-4f27-8d81-92d996364871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:53.657403 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-277dff25-1f5e-4f27-8d81-92d996364871 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:31:53.659199 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-277dff25-1f5e-4f27-8d81-92d996364871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:31:53.750924 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 612/1202] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:31:53 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:31:53.778096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a02ab5-721b-4efa-8ee1-976efcddcba9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:53.927206 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a02ab5-721b-4efa-8ee1-976efcddcba9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:53.969242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7e8db-6c17-4ba2-8319-0b6a4cf737a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:53.970048 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7e8db-6c17-4ba2-8319-0b6a4cf737a2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:53.970333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7e8db-6c17-4ba2-8319-0b6a4cf737a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:53.970627 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7e8db-6c17-4ba2-8319-0b6a4cf737a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:53.981632 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7e8db-6c17-4ba2-8319-0b6a4cf737a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:53.983150 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7e8db-6c17-4ba2-8319-0b6a4cf737a2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:54.005633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4ce7e8db-6c17-4ba2-8319-0b6a4cf737a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:31:54.005633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:31:54.005633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:31:54.005633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:31:54.005633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:31:54.005633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:31:54.005633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:31:54.005633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:31:54.005633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:31:54.005633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:31:54.005633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:31:54.005633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:31:54.005633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:31:54.005633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:31:54.005633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:31:54.007077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:31:54.007077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:31:54.007077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:31:54.007077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:31:54.007077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:31:54.007077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:31:54.007077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:31:54.007077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:31:54.007077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:31:54.007077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:31:54.007077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:31:54.007077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:31:54.007077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:31:54.007077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:31:54.007077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:31:54.007077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:31:54.007077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:31:54.008053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:31:54.008053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:31:54.008053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:31:54.008053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:31:54.008053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 591/1203] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:31:54.012938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277dff25-1f5e-4f27-8d81-92d996364871 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:54.155744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277dff25-1f5e-4f27-8d81-92d996364871 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:54.198304 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:54.210268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c14636-8447-43df-97d4-3cf701560169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:54.211073 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c14636-8447-43df-97d4-3cf701560169 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:54.211400 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c14636-8447-43df-97d4-3cf701560169 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:54.212049 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c14636-8447-43df-97d4-3cf701560169 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:54.214619 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c14636-8447-43df-97d4-3cf701560169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:31:54.214619 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c14636-8447-43df-97d4-3cf701560169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:54.214862 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c14636-8447-43df-97d4-3cf701560169 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:54.231655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 613/1204] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:31:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:54.237345 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7e8db-6c17-4ba2-8319-0b6a4cf737a2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:54.301742 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:54.367006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7e8db-6c17-4ba2-8319-0b6a4cf737a2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:54.420229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c6bb8-b5cd-4533-a63b-cd914aee63b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:54.421149 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c6bb8-b5cd-4533-a63b-cd914aee63b9 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:54.421622 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c6bb8-b5cd-4533-a63b-cd914aee63b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:54.422028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c6bb8-b5cd-4533-a63b-cd914aee63b9 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:54.422907 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c6bb8-b5cd-4533-a63b-cd914aee63b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:54.425019 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c6bb8-b5cd-4533-a63b-cd914aee63b9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:54.450759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 592/1205] 10.222.0.110 () {60 vars in 1137 bytes} [Thu May 26 16:31:54 2022] POST /identity/v3/users => generated 252 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:31:56.906167 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeb7a2-1a55-4cd2-ab1a-683ab077f8a2 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:56.906769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeb7a2-1a55-4cd2-ab1a-683ab077f8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:56.906856 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeb7a2-1a55-4cd2-ab1a-683ab077f8a2 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:56.908315 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 614/1206] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:31:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:31:56.914108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca874701-f321-463a-b566-b810d1ef1109 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:56.914595 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca874701-f321-463a-b566-b810d1ef1109 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:56.914753 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca874701-f321-463a-b566-b810d1ef1109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:56.934431 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ca874701-f321-463a-b566-b810d1ef1109 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:31:56.935707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ca874701-f321-463a-b566-b810d1ef1109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:31:57.023771 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 593/1207] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:31:56 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:31:57.051062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eeb7a2-1a55-4cd2-ab1a-683ab077f8a2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:57.220346 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eeb7a2-1a55-4cd2-ab1a-683ab077f8a2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:57.275596 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd6722-80f6-4ea7-849a-e62c36575a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:57.276444 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd6722-80f6-4ea7-849a-e62c36575a5f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:57.276796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd6722-80f6-4ea7-849a-e62c36575a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:57.277081 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd6722-80f6-4ea7-849a-e62c36575a5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:57.291403 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd6722-80f6-4ea7-849a-e62c36575a5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:31:57.300023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-27cd6722-80f6-4ea7-849a-e62c36575a5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:31:57.300023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:31:57.300023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:31:57.300023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:31:57.300023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:31:57.300023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:31:57.300023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:31:57.300023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:31:57.300023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:31:57.300023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:31:57.300023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:31:57.300023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:31:57.300023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:31:57.300023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:31:57.300023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:31:57.300023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:31:57.301020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:31:57.301020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:31:57.301020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:31:57.301020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:31:57.301020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:31:57.301020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:31:57.301020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:31:57.301020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:31:57.301020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:31:57.301020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:31:57.301020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:31:57.301020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:31:57.301020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:31:57.301020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:31:57.301020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:31:57.301020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:31:57.301866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:31:57.301866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:31:57.301866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:31:57.301866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:31:57.301866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:31:57.301866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:31:57.301866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:31:57.301866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:31:57.301866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:31:57.301866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:31:57.301866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:31:57.301866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:31:57.301866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 615/1208] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:31:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:31:57.309276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca874701-f321-463a-b566-b810d1ef1109 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:57.355038 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:57.437696 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca874701-f321-463a-b566-b810d1ef1109 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:57.482029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927965e1-ca29-4a3f-9909-da84d598580b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:57.482790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927965e1-ca29-4a3f-9909-da84d598580b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:57.483084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927965e1-ca29-4a3f-9909-da84d598580b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:57.483363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927965e1-ca29-4a3f-9909-da84d598580b None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:57.484172 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927965e1-ca29-4a3f-9909-da84d598580b None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:31:57.484521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927965e1-ca29-4a3f-9909-da84d598580b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:57.485987 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927965e1-ca29-4a3f-9909-da84d598580b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:57.498611 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 594/1209] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:31:57 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:57.504392 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd6722-80f6-4ea7-849a-e62c36575a5f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:57.566398 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:57.629135 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd6722-80f6-4ea7-849a-e62c36575a5f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:57.672951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f030af-3b07-467e-a9eb-a71a513a5de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:57.673832 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f030af-3b07-467e-a9eb-a71a513a5de9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:57.674695 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f030af-3b07-467e-a9eb-a71a513a5de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:57.674976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f030af-3b07-467e-a9eb-a71a513a5de9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:57.686754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f030af-3b07-467e-a9eb-a71a513a5de9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:57.688765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f030af-3b07-467e-a9eb-a71a513a5de9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:57.708971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-a2f030af-3b07-467e-a9eb-a71a513a5de9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:31:57.708971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:31:57.708971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:31:57.708971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:31:57.708971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:31:57.708971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:31:57.708971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:31:57.708971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:31:57.708971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:31:57.708971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:31:57.708971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:31:57.708971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:31:57.708971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:31:57.708971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:31:57.708971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:31:57.711037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:31:57.711037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:31:57.711037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:31:57.711037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:31:57.711037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:31:57.711037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:31:57.711037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:31:57.711037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:31:57.711037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:31:57.711037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:31:57.711037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:31:57.711037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:31:57.711037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:31:57.711037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:31:57.711037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:31:57.711037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:31:57.711037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:31:57.711973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:31:57.711973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:31:57.711973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:31:57.711973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:31:57.711973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 616/1210] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:31:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:31:57.716193 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927965e1-ca29-4a3f-9909-da84d598580b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:57.828932 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:57.831436 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927965e1-ca29-4a3f-9909-da84d598580b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:57.867653 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdac14-894f-4b3e-ac28-be331158435e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:57.868386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdac14-894f-4b3e-ac28-be331158435e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:57.868599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdac14-894f-4b3e-ac28-be331158435e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:57.868876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdac14-894f-4b3e-ac28-be331158435e None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:57.869621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdac14-894f-4b3e-ac28-be331158435e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:31:57.869935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdac14-894f-4b3e-ac28-be331158435e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:57.871388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdac14-894f-4b3e-ac28-be331158435e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:57.885640 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 595/1211] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:31:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:57.891713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f030af-3b07-467e-a9eb-a71a513a5de9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:58.001845 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f030af-3b07-467e-a9eb-a71a513a5de9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:58.004328 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:58.041761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22a148-82b4-4314-8945-848d65a27d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:58.042941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22a148-82b4-4314-8945-848d65a27d8e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:58.042941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22a148-82b4-4314-8945-848d65a27d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:58.043136 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22a148-82b4-4314-8945-848d65a27d8e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:58.051355 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22a148-82b4-4314-8945-848d65a27d8e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:58.052807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22a148-82b4-4314-8945-848d65a27d8e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:58.068271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-5c22a148-82b4-4314-8945-848d65a27d8e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:31:58.068271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:31:58.068271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:31:58.068271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:31:58.068271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:31:58.068271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:31:58.068271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:31:58.068271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:31:58.068271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:31:58.068271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:31:58.068271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:31:58.068271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:31:58.068271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:31:58.068271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:31:58.068271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:31:58.068271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:31:58.069500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:31:58.069500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:31:58.069500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:31:58.069500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:31:58.069500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:31:58.069500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:31:58.069500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:31:58.069500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:31:58.069500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:31:58.069500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:31:58.069500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:31:58.069500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:31:58.069500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:31:58.069500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:31:58.069500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:31:58.069500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:31:58.069500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:31:58.069500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:31:58.070469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:31:58.070469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:31:58.070469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:31:58.070469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:31:58.070469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:31:58.070469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:31:58.070469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:31:58.070469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:31:58.070469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:31:58.070469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:31:58.070469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 617/1212] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:31:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:31:58.075795 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdac14-894f-4b3e-ac28-be331158435e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:58.187139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdac14-894f-4b3e-ac28-be331158435e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:58.223233 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f650af2-d1fc-4926-89fa-938651312186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:58.223901 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f650af2-d1fc-4926-89fa-938651312186 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:58.224186 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f650af2-d1fc-4926-89fa-938651312186 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:58.224461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f650af2-d1fc-4926-89fa-938651312186 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:58.225298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f650af2-d1fc-4926-89fa-938651312186 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:31:58.225610 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f650af2-d1fc-4926-89fa-938651312186 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:58.227138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f650af2-d1fc-4926-89fa-938651312186 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:58.246355 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 596/1213] 10.222.0.110 () {56 vars in 1148 bytes} [Thu May 26 16:31:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:58.251990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22a148-82b4-4314-8945-848d65a27d8e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:58.373653 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22a148-82b4-4314-8945-848d65a27d8e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:58.414957 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fda2b-6580-417a-bd64-cb57c35f3db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:58.415954 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fda2b-6580-417a-bd64-cb57c35f3db3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:58.416385 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fda2b-6580-417a-bd64-cb57c35f3db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:58.416930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fda2b-6580-417a-bd64-cb57c35f3db3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:58.452453 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:58.501402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fda2b-6580-417a-bd64-cb57c35f3db3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:58.503624 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fda2b-6580-417a-bd64-cb57c35f3db3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:58.630913 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 618/1214] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:31:58 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:31:58.637439 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f650af2-d1fc-4926-89fa-938651312186 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:58.658840 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:58.749167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f650af2-d1fc-4926-89fa-938651312186 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:58.788190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1419e-0a63-45fe-a840-2f3c439dc4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:58.788996 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1419e-0a63-45fe-a840-2f3c439dc4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:58.789286 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1419e-0a63-45fe-a840-2f3c439dc4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:58.789566 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1419e-0a63-45fe-a840-2f3c439dc4c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:58.799870 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1419e-0a63-45fe-a840-2f3c439dc4c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:58.801313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1419e-0a63-45fe-a840-2f3c439dc4c8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:58.820464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-2ad1419e-0a63-45fe-a840-2f3c439dc4c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:31:58.820464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:31:58.820464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:31:58.820464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:31:58.820464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:31:58.820464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:31:58.820464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:31:58.820464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:31:58.820464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:31:58.820464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:31:58.820464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:31:58.820464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:31:58.820464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:31:58.820464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:31:58.820464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:31:58.821427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:31:58.821427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:31:58.821427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:31:58.821427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:31:58.821427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:31:58.821427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:31:58.821427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:31:58.821427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:31:58.821427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:31:58.821427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:31:58.821427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:31:58.821427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:31:58.821427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:31:58.821427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:31:58.821427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:31:58.821427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:31:58.821427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:31:58.822364 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:31:58.822364 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:31:58.822364 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:31:58.822364 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:31:58.822364 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 597/1215] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:31:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:31:58.827709 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fda2b-6580-417a-bd64-cb57c35f3db3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:58.902280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:58.945585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fda2b-6580-417a-bd64-cb57c35f3db3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:58.983404 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca121592-9ce4-4316-b1b5-8b4828bd7e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:58.984075 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca121592-9ce4-4316-b1b5-8b4828bd7e0f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:58.984361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca121592-9ce4-4316-b1b5-8b4828bd7e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:58.984631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca121592-9ce4-4316-b1b5-8b4828bd7e0f None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:58.985362 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca121592-9ce4-4316-b1b5-8b4828bd7e0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:31:58.985668 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca121592-9ce4-4316-b1b5-8b4828bd7e0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:58.987301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca121592-9ce4-4316-b1b5-8b4828bd7e0f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:58.999750 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 619/1216] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:31:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:59.005454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1419e-0a63-45fe-a840-2f3c439dc4c8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:59.079394 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:59.116369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1419e-0a63-45fe-a840-2f3c439dc4c8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:59.166411 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e51dc-b78d-44e5-929b-5bf506b61bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:59.167403 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e51dc-b78d-44e5-929b-5bf506b61bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:59.167733 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e51dc-b78d-44e5-929b-5bf506b61bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:59.168033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e51dc-b78d-44e5-929b-5bf506b61bb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:59.177333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e51dc-b78d-44e5-929b-5bf506b61bb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:59.178998 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e51dc-b78d-44e5-929b-5bf506b61bb6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:59.194537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-7e8e51dc-b78d-44e5-929b-5bf506b61bb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:31:59.194537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:31:59.194537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:31:59.194537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:31:59.194537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:31:59.194537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:31:59.194537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:31:59.194537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:31:59.194537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:31:59.194537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:31:59.194537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:31:59.194537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:31:59.194537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:31:59.194537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:31:59.194537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:31:59.195787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:31:59.195787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:31:59.195787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:31:59.195787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:31:59.195787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:31:59.195787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:31:59.195787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:31:59.195787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:31:59.195787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:31:59.195787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:31:59.195787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:31:59.195787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:31:59.195787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:31:59.195787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:31:59.195787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:31:59.195787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:31:59.195787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:31:59.201520 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:31:59.201520 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:31:59.201520 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:31:59.201520 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:31:59.201520 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:31:59.201520 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:31:59.201520 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:31:59.201520 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:31:59.201520 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 598/1217] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:31:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:31:59.202143 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca121592-9ce4-4316-b1b5-8b4828bd7e0f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:59.319611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca121592-9ce4-4316-b1b5-8b4828bd7e0f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:59.343692 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:59.357051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b541bc-eba1-49d3-823a-50b9e0286f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:59.357886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b541bc-eba1-49d3-823a-50b9e0286f00 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:59.358270 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b541bc-eba1-49d3-823a-50b9e0286f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:59.358688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b541bc-eba1-49d3-823a-50b9e0286f00 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:59.359577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b541bc-eba1-49d3-823a-50b9e0286f00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:31:59.360614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b541bc-eba1-49d3-823a-50b9e0286f00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:59.361545 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b541bc-eba1-49d3-823a-50b9e0286f00 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:59.378142 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 620/1218] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:31:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:59.384227 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e51dc-b78d-44e5-929b-5bf506b61bb6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:59.503539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e51dc-b78d-44e5-929b-5bf506b61bb6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:59.534587 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:59.541075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7dbf03-74bf-4f6b-a940-a1d30230c71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:59.542591 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7dbf03-74bf-4f6b-a940-a1d30230c71d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:59.542591 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7dbf03-74bf-4f6b-a940-a1d30230c71d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:59.542591 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7dbf03-74bf-4f6b-a940-a1d30230c71d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:59.543121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7dbf03-74bf-4f6b-a940-a1d30230c71d None admin] RBAC: Adding query filter params (role.id=a21e569e87fa4cb7bfb252986942b9ab, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=9ffef7640dd1487ab2ea91fc0f4be9e9) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:31:59.543439 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7dbf03-74bf-4f6b-a940-a1d30230c71d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:59.544937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7dbf03-74bf-4f6b-a940-a1d30230c71d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:59.558606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 599/1219] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:31:59 2022] GET /identity/v3/role_assignments?user.id=9ffef7640dd1487ab2ea91fc0f4be9e9&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=a21e569e87fa4cb7bfb252986942b9ab => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:32:01.894449 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a4a40-3fe3-4616-b9e0-18ecdf58f08a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:01.895044 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a4a40-3fe3-4616-b9e0-18ecdf58f08a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:01.895326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a4a40-3fe3-4616-b9e0-18ecdf58f08a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:01.898610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 621/1220] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:32:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:01.902522 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5575e-4bb8-490f-98d9-0bcbb18505f7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:01.902976 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5575e-4bb8-490f-98d9-0bcbb18505f7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:01.903330 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5575e-4bb8-490f-98d9-0bcbb18505f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:01.922688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e4d5575e-4bb8-490f-98d9-0bcbb18505f7 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:01.924703 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e4d5575e-4bb8-490f-98d9-0bcbb18505f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:02.001346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 600/1221] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:32:01 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:32:02.024241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a4a40-3fe3-4616-b9e0-18ecdf58f08a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:02.146004 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a4a40-3fe3-4616-b9e0-18ecdf58f08a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:02.182252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936e951-8549-41fe-a907-60bcf063ae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:02.183058 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936e951-8549-41fe-a907-60bcf063ae6a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:02.183360 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936e951-8549-41fe-a907-60bcf063ae6a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:02.183623 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936e951-8549-41fe-a907-60bcf063ae6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:02.194467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936e951-8549-41fe-a907-60bcf063ae6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:02.202138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-7936e951-8549-41fe-a907-60bcf063ae6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:32:02.202138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:02.202138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:02.202138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:02.202138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:02.202138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:02.202138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:02.202138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:02.202138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:02.202138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:02.202138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:02.202138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:02.202138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:02.202138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:02.202138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:02.202138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:02.203110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:02.203110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:02.203110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:02.203110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:02.203110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:02.203110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:02.203110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:02.203110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:02.203110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:02.203110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:02.203110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:02.203110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:32:02.203110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:02.203110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:02.203110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:02.203110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:02.203959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:02.203959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:02.203959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:02.203959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:02.203959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:02.203959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:02.203959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:02.203959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:02.203959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:02.203959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:02.203959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:32:02.203959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:02.203959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 622/1222] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:32:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:02.209936 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5575e-4bb8-490f-98d9-0bcbb18505f7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:02.315828 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5575e-4bb8-490f-98d9-0bcbb18505f7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:02.339901 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:02.353148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f79fd-ad39-4f8c-9715-6bce34189a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:02.353867 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f79fd-ad39-4f8c-9715-6bce34189a0b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:02.354156 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f79fd-ad39-4f8c-9715-6bce34189a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:02.354434 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f79fd-ad39-4f8c-9715-6bce34189a0b None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:02.355234 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f79fd-ad39-4f8c-9715-6bce34189a0b None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:02.355550 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f79fd-ad39-4f8c-9715-6bce34189a0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:02.356929 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f79fd-ad39-4f8c-9715-6bce34189a0b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:02.366698 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 601/1223] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:32:02 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:02.372993 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936e951-8549-41fe-a907-60bcf063ae6a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:02.424557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:02.489268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936e951-8549-41fe-a907-60bcf063ae6a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:02.527360 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f375e-2ef9-4e69-b554-e61a02972310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:02.528204 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f375e-2ef9-4e69-b554-e61a02972310 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:02.528490 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f375e-2ef9-4e69-b554-e61a02972310 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:02.528767 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f375e-2ef9-4e69-b554-e61a02972310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:02.540400 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f375e-2ef9-4e69-b554-e61a02972310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:02.541991 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f375e-2ef9-4e69-b554-e61a02972310 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:02.560434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-9f5f375e-2ef9-4e69-b554-e61a02972310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:02.560434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:02.560434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:02.560434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:02.560434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:02.560434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:02.560434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:02.560434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:02.560434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:02.560434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:02.560434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:02.560434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:02.560434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:32:02.560434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:32:02.560434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:32:02.561651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:32:02.561651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:02.561651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:02.561651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:02.561651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:02.561651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:02.561651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:02.561651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:02.561651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:32:02.561651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:02.561651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:02.561651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:02.561651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:02.561651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:02.561651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:02.561651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:02.561651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:02.562789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:32:02.562789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:32:02.562789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:02.562789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:02.562789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 623/1224] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:32:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:32:02.569690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f79fd-ad39-4f8c-9715-6bce34189a0b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:02.676369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f79fd-ad39-4f8c-9715-6bce34189a0b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:02.713914 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8731c27-ba52-4dda-b43b-65133154672e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:02.714648 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8731c27-ba52-4dda-b43b-65133154672e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:02.714897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8731c27-ba52-4dda-b43b-65133154672e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:02.715173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8731c27-ba52-4dda-b43b-65133154672e None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:02.715938 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8731c27-ba52-4dda-b43b-65133154672e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:02.716210 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8731c27-ba52-4dda-b43b-65133154672e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:02.717579 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8731c27-ba52-4dda-b43b-65133154672e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:02.730711 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 602/1225] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:32:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:02.736860 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f375e-2ef9-4e69-b554-e61a02972310 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:02.840156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:02.848894 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f375e-2ef9-4e69-b554-e61a02972310 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:02.886251 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54cf12-4f1e-4701-9d8e-fb170d62f745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:02.887109 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54cf12-4f1e-4701-9d8e-fb170d62f745 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:02.887481 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54cf12-4f1e-4701-9d8e-fb170d62f745 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:02.887818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54cf12-4f1e-4701-9d8e-fb170d62f745 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:02.896137 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54cf12-4f1e-4701-9d8e-fb170d62f745 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:02.897600 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54cf12-4f1e-4701-9d8e-fb170d62f745 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:02.912228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-6d54cf12-4f1e-4701-9d8e-fb170d62f745 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:32:02.912228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:02.912228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:02.912228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:02.912228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:02.912228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:02.912228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:02.912228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:02.912228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:02.912228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:02.912228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:02.912228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:02.912228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:32:02.912228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:32:02.912228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:32:02.912228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:32:02.913540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:02.913540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:02.913540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:32:02.913540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:32:02.913540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:32:02.913540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:32:02.913540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:02.913540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:02.913540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:02.913540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:02.913540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:02.913540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:32:02.913540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:02.913540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:02.913540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:02.913540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:02.913540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:02.913540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:02.915133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:02.915133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:02.915133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:32:02.915133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:32:02.915133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:32:02.915133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:32:02.915133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:32:02.915133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:32:02.915133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:32:02.915133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:02.915133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 624/1226] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:32:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:02.919355 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8731c27-ba52-4dda-b43b-65133154672e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:02.969558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:03.025129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8731c27-ba52-4dda-b43b-65133154672e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:03.059685 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee254045-57a7-42d7-b82a-7b7156bf6b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:03.060363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee254045-57a7-42d7-b82a-7b7156bf6b58 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:03.060668 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee254045-57a7-42d7-b82a-7b7156bf6b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:03.060923 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee254045-57a7-42d7-b82a-7b7156bf6b58 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:03.061748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee254045-57a7-42d7-b82a-7b7156bf6b58 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:03.062060 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee254045-57a7-42d7-b82a-7b7156bf6b58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:03.063513 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee254045-57a7-42d7-b82a-7b7156bf6b58 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:03.082582 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 603/1227] 10.222.0.110 () {56 vars in 1148 bytes} [Thu May 26 16:32:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:03.088366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54cf12-4f1e-4701-9d8e-fb170d62f745 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:03.201516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54cf12-4f1e-4701-9d8e-fb170d62f745 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:03.240628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddad6b-e6b8-4af9-bade-3dae5f96c03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:03.241423 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddad6b-e6b8-4af9-bade-3dae5f96c03c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:03.241705 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddad6b-e6b8-4af9-bade-3dae5f96c03c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:03.241978 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddad6b-e6b8-4af9-bade-3dae5f96c03c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:03.255050 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddad6b-e6b8-4af9-bade-3dae5f96c03c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:03.256517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddad6b-e6b8-4af9-bade-3dae5f96c03c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:03.278443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-c1ddad6b-e6b8-4af9-bade-3dae5f96c03c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:03.278443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:03.278443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:03.278443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:03.278443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:03.278443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:03.278443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:03.278443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:03.278443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:03.278443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:03.278443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:03.278443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:03.278443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:32:03.278443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:32:03.278443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:32:03.279616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:32:03.279616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:03.279616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:03.279616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:03.279616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:03.279616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:03.279616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:03.279616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:03.279616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:32:03.279616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:03.279616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:03.279616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:03.279616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:03.279616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:03.279616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:03.279616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:03.279616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:03.280542 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:32:03.280542 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:32:03.280542 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:03.280542 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:03.280542 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 625/1228] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:32:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:03.286700 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee254045-57a7-42d7-b82a-7b7156bf6b58 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:03.403234 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee254045-57a7-42d7-b82a-7b7156bf6b58 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:03.406137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:03.442880 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939264c9-e3a1-4f79-bdf9-5d9c670e27e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:03.443854 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939264c9-e3a1-4f79-bdf9-5d9c670e27e1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:03.444260 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939264c9-e3a1-4f79-bdf9-5d9c670e27e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:03.444635 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939264c9-e3a1-4f79-bdf9-5d9c670e27e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:03.445412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939264c9-e3a1-4f79-bdf9-5d9c670e27e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:03.445749 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939264c9-e3a1-4f79-bdf9-5d9c670e27e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:03.447647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939264c9-e3a1-4f79-bdf9-5d9c670e27e1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:03.462145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 604/1229] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:32:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:03.467869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddad6b-e6b8-4af9-bade-3dae5f96c03c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:03.477637 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:03.575032 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddad6b-e6b8-4af9-bade-3dae5f96c03c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:03.609243 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12489a40-6e9d-4944-a01b-08998c61d60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:03.610071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12489a40-6e9d-4944-a01b-08998c61d60a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:03.610371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12489a40-6e9d-4944-a01b-08998c61d60a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:03.610691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12489a40-6e9d-4944-a01b-08998c61d60a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:03.620395 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12489a40-6e9d-4944-a01b-08998c61d60a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:03.621852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12489a40-6e9d-4944-a01b-08998c61d60a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:03.636883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-12489a40-6e9d-4944-a01b-08998c61d60a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:32:03.636883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:03.636883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:03.636883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:03.636883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:03.636883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:03.636883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:03.636883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:03.636883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:03.636883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:03.636883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:03.636883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:03.636883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:32:03.636883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:32:03.636883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:32:03.638149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:32:03.638149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:03.638149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:03.638149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:03.638149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:03.638149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:03.638149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:03.638149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:03.638149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:32:03.638149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:03.638149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:03.638149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:03.638149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:03.638149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:03.638149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:03.638149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:03.638149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:03.639466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:32:03.639466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:32:03.639466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:32:03.639466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:32:03.639466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:32:03.639466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:32:03.639466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:32:03.639466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:03.639466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 626/1230] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:32:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:32:03.644379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939264c9-e3a1-4f79-bdf9-5d9c670e27e1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:03.749526 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939264c9-e3a1-4f79-bdf9-5d9c670e27e1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:03.789932 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f24e33-6831-4a68-82bc-21b06108d34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:03.790652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f24e33-6831-4a68-82bc-21b06108d34e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:03.790949 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f24e33-6831-4a68-82bc-21b06108d34e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:03.791313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f24e33-6831-4a68-82bc-21b06108d34e None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:03.792117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f24e33-6831-4a68-82bc-21b06108d34e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:03.792435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f24e33-6831-4a68-82bc-21b06108d34e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:03.793902 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f24e33-6831-4a68-82bc-21b06108d34e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:03.807703 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 605/1231] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:32:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:03.815190 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12489a40-6e9d-4944-a01b-08998c61d60a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:03.888512 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:03.927238 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12489a40-6e9d-4944-a01b-08998c61d60a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:03.964522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222396d6-8304-4537-9f85-077560971ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:03.965458 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222396d6-8304-4537-9f85-077560971ac2 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:03.965831 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222396d6-8304-4537-9f85-077560971ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:03.966086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222396d6-8304-4537-9f85-077560971ac2 None admin] PATH_INFO: `/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/9ffef7640dd1487ab2ea91fc0f4be9e9/roles/a21e569e87fa4cb7bfb252986942b9ab` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:03.981608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222396d6-8304-4537-9f85-077560971ac2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d33e1f400b3e46379d2a0abd05921181, user_id=9ffef7640dd1487ab2ea91fc0f4be9e9, role_id=a21e569e87fa4cb7bfb252986942b9ab)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:03.983092 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222396d6-8304-4537-9f85-077560971ac2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:03.996850 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 627/1232] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:32:03 2022] PUT /identity/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/9ffef7640dd1487ab2ea91fc0f4be9e9/roles/a21e569e87fa4cb7bfb252986942b9ab => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:32:06.226520 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5323f-7b45-4d76-941e-b26177a0bf71 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:06.227164 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5323f-7b45-4d76-941e-b26177a0bf71 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:06.227164 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5323f-7b45-4d76-941e-b26177a0bf71 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:06.228477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 606/1233] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:32:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:06.234051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f7fa2-9c26-4aab-b165-a24c409f1077 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:06.234529 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f7fa2-9c26-4aab-b165-a24c409f1077 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:06.234663 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f7fa2-9c26-4aab-b165-a24c409f1077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:06.253119 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-005f7fa2-9c26-4aab-b165-a24c409f1077 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:06.254630 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-005f7fa2-9c26-4aab-b165-a24c409f1077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:06.332382 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 628/1234] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:32:06 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:32:06.355841 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5323f-7b45-4d76-941e-b26177a0bf71 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:06.389068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:06.476686 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5323f-7b45-4d76-941e-b26177a0bf71 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:06.512592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99269ede-444d-41d5-8c85-ab8de8f8718c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:06.513504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99269ede-444d-41d5-8c85-ab8de8f8718c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:06.513788 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99269ede-444d-41d5-8c85-ab8de8f8718c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:06.514063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99269ede-444d-41d5-8c85-ab8de8f8718c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:06.525720 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99269ede-444d-41d5-8c85-ab8de8f8718c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:06.534078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-99269ede-444d-41d5-8c85-ab8de8f8718c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:32:06.534078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:06.534078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:06.534078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:06.534078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:06.534078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:06.534078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:06.534078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:06.534078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:06.534078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:06.534078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:06.534078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:06.534078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:06.534078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:06.534078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:06.534078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:06.535173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:06.535173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:06.535173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:06.535173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:06.535173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:06.535173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:06.535173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:06.535173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:06.535173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:06.535173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:06.535173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:06.535173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:32:06.535173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:06.535173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:06.535173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:06.535173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:06.536089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:06.536089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:06.536089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:06.536089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:06.536089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:06.536089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:06.536089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:06.536089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:06.536089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:06.536089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:06.536089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:32:06.536089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:32:06.536089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 607/1235] 10.222.0.110 () {56 vars in 1107 bytes} [Thu May 26 16:32:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:06.543074 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f7fa2-9c26-4aab-b165-a24c409f1077 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:06.592844 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:06.661568 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f7fa2-9c26-4aab-b165-a24c409f1077 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:06.702075 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00f006-f351-47d9-a46d-0a83efb433f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:06.703144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00f006-f351-47d9-a46d-0a83efb433f4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:06.703587 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00f006-f351-47d9-a46d-0a83efb433f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:06.704081 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00f006-f351-47d9-a46d-0a83efb433f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:06.705090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00f006-f351-47d9-a46d-0a83efb433f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:06.705552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00f006-f351-47d9-a46d-0a83efb433f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:06.707273 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00f006-f351-47d9-a46d-0a83efb433f4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:06.716515 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 629/1236] 10.222.0.110 () {56 vars in 1108 bytes} [Thu May 26 16:32:06 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:06.723259 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99269ede-444d-41d5-8c85-ab8de8f8718c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:06.825226 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:06.845606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99269ede-444d-41d5-8c85-ab8de8f8718c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:06.886392 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd3f30-0ce4-4b38-9e0f-234ee3f849bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:06.887284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd3f30-0ce4-4b38-9e0f-234ee3f849bf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:06.887540 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd3f30-0ce4-4b38-9e0f-234ee3f849bf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:06.887813 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd3f30-0ce4-4b38-9e0f-234ee3f849bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:06.900038 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd3f30-0ce4-4b38-9e0f-234ee3f849bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:06.901587 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd3f30-0ce4-4b38-9e0f-234ee3f849bf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:06.921111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-2bcd3f30-0ce4-4b38-9e0f-234ee3f849bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:06.921111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:06.921111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:06.921111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:06.921111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:06.921111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:06.921111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:06.921111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:06.921111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:06.921111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:06.921111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:06.921111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:06.921111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:32:06.921111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:32:06.921111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:32:06.922263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:32:06.922263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:06.922263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:06.922263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:06.922263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:06.922263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:06.922263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:06.922263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:06.922263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:32:06.922263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:06.922263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:06.922263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:06.922263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:06.922263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:06.922263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:06.922263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:06.922263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:06.930190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:32:06.930190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:32:06.930190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:06.930190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:32:06.930190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 608/1237] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:32:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:32:06.930548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00f006-f351-47d9-a46d-0a83efb433f4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:07.039429 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00f006-f351-47d9-a46d-0a83efb433f4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:07.049255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:07.075917 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31036823-4b81-4eaf-a14b-22abae6dc7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:07.076591 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31036823-4b81-4eaf-a14b-22abae6dc7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:07.076892 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31036823-4b81-4eaf-a14b-22abae6dc7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:07.077169 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31036823-4b81-4eaf-a14b-22abae6dc7c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:07.077959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31036823-4b81-4eaf-a14b-22abae6dc7c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:07.078271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31036823-4b81-4eaf-a14b-22abae6dc7c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:07.079804 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31036823-4b81-4eaf-a14b-22abae6dc7c1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:07.092131 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 630/1238] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:32:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:07.098871 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd3f30-0ce4-4b38-9e0f-234ee3f849bf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:07.210391 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd3f30-0ce4-4b38-9e0f-234ee3f849bf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:07.247297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf62cf-d2ee-4a63-b8d8-97acac8d7773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:07.248176 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf62cf-d2ee-4a63-b8d8-97acac8d7773 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:07.248465 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf62cf-d2ee-4a63-b8d8-97acac8d7773 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:07.248743 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf62cf-d2ee-4a63-b8d8-97acac8d7773 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:07.252636 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:07.258277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf62cf-d2ee-4a63-b8d8-97acac8d7773 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:07.259874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf62cf-d2ee-4a63-b8d8-97acac8d7773 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:07.274577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-21bf62cf-d2ee-4a63-b8d8-97acac8d7773 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:32:07.274577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:07.274577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:07.274577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:07.274577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:07.274577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:07.274577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:07.274577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:07.274577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:07.274577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:07.274577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:07.274577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:07.274577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:32:07.274577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:32:07.274577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:32:07.274577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:32:07.275839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:07.275839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:07.275839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:32:07.275839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:32:07.275839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:32:07.275839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:32:07.275839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:07.275839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:07.275839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:07.275839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:07.275839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:07.275839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:32:07.275839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:07.275839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:07.275839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:07.275839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:07.275839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:07.275839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:07.276876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:07.276876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:07.276876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:32:07.276876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:32:07.276876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:32:07.276876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:32:07.276876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:32:07.276876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:32:07.276876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:32:07.276876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:32:07.276876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 609/1239] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:32:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:07.281578 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31036823-4b81-4eaf-a14b-22abae6dc7c1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:07.392942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31036823-4b81-4eaf-a14b-22abae6dc7c1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:07.432406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0ead7-70d0-462b-abc9-95260abbb665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:07.433219 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0ead7-70d0-462b-abc9-95260abbb665 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:07.433507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0ead7-70d0-462b-abc9-95260abbb665 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:07.433788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0ead7-70d0-462b-abc9-95260abbb665 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:07.434661 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0ead7-70d0-462b-abc9-95260abbb665 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:07.434977 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0ead7-70d0-462b-abc9-95260abbb665 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:07.436410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0ead7-70d0-462b-abc9-95260abbb665 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:07.455963 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 631/1240] 10.222.0.110 () {56 vars in 1148 bytes} [Thu May 26 16:32:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:07.461961 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf62cf-d2ee-4a63-b8d8-97acac8d7773 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:07.578468 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf62cf-d2ee-4a63-b8d8-97acac8d7773 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:07.615189 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246aad17-6305-43f2-8978-74fe1c3f356f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:07.615849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246aad17-6305-43f2-8978-74fe1c3f356f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:07.616146 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246aad17-6305-43f2-8978-74fe1c3f356f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:07.616425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246aad17-6305-43f2-8978-74fe1c3f356f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:07.682784 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:07.690860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246aad17-6305-43f2-8978-74fe1c3f356f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:07.692314 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246aad17-6305-43f2-8978-74fe1c3f356f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:07.800874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 610/1241] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:32:07 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:32:07.806740 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0ead7-70d0-462b-abc9-95260abbb665 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:07.835648 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:07.912277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0ead7-70d0-462b-abc9-95260abbb665 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:07.949575 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad83373-c055-4576-88f4-5e73c2ade802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:07.950327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad83373-c055-4576-88f4-5e73c2ade802 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:07.950641 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad83373-c055-4576-88f4-5e73c2ade802 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:07.950966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad83373-c055-4576-88f4-5e73c2ade802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:07.962123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad83373-c055-4576-88f4-5e73c2ade802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:07.963813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad83373-c055-4576-88f4-5e73c2ade802 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:07.983813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-8ad83373-c055-4576-88f4-5e73c2ade802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:07.983813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:07.983813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:07.983813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:07.983813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:07.983813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:07.983813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:07.983813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:07.983813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:07.983813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:07.983813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:07.983813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:07.983813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:32:07.983813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:32:07.983813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:32:07.984867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:32:07.984867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:07.984867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:07.984867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:07.984867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:07.984867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:07.984867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:07.984867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:07.984867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:32:07.984867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:07.984867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:07.984867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:07.984867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:07.984867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:07.984867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:07.984867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:07.984867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:07.985943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:32:07.985943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:32:07.985943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:07.985943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:07.985943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 632/1242] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:32:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:07.991291 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246aad17-6305-43f2-8978-74fe1c3f356f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:08.091517 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:08.098669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246aad17-6305-43f2-8978-74fe1c3f356f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:08.139839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ccb72-3580-4c5d-953e-3ebb2e8c34d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:08.140515 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ccb72-3580-4c5d-953e-3ebb2e8c34d0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:08.140839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ccb72-3580-4c5d-953e-3ebb2e8c34d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:08.141094 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ccb72-3580-4c5d-953e-3ebb2e8c34d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:08.142453 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ccb72-3580-4c5d-953e-3ebb2e8c34d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:08.142798 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ccb72-3580-4c5d-953e-3ebb2e8c34d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:08.146858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ccb72-3580-4c5d-953e-3ebb2e8c34d0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:08.162852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 611/1243] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:32:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:08.169750 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad83373-c055-4576-88f4-5e73c2ade802 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:08.262494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:08.286319 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad83373-c055-4576-88f4-5e73c2ade802 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:08.321744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4087a7b-ad84-4e94-a31a-c97c7d3b39f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:08.322541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4087a7b-ad84-4e94-a31a-c97c7d3b39f6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:08.323640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4087a7b-ad84-4e94-a31a-c97c7d3b39f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:08.323640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4087a7b-ad84-4e94-a31a-c97c7d3b39f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:08.331530 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4087a7b-ad84-4e94-a31a-c97c7d3b39f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:08.333126 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4087a7b-ad84-4e94-a31a-c97c7d3b39f6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:08.349425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-c4087a7b-ad84-4e94-a31a-c97c7d3b39f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:32:08.349425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:08.349425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:08.349425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:08.349425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:08.349425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:08.349425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:08.349425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:08.349425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:08.349425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:08.349425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:08.349425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:08.349425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:32:08.349425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:32:08.349425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:32:08.351305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:32:08.351305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:08.351305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:08.351305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:08.351305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:08.351305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:08.351305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:08.351305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:08.351305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:32:08.351305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:08.351305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:08.351305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:08.351305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:08.351305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:08.351305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:08.351305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:08.351305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:08.352712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:32:08.352712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:32:08.352712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:32:08.352712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:32:08.352712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:32:08.352712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:32:08.352712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:32:08.352712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:08.352712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 633/1244] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:32:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:08.356901 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ccb72-3580-4c5d-953e-3ebb2e8c34d0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:08.477420 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ccb72-3580-4c5d-953e-3ebb2e8c34d0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:08.516176 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4bcdb-e593-4be9-8afc-7b413f23169f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:08.517369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4bcdb-e593-4be9-8afc-7b413f23169f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:08.517709 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4bcdb-e593-4be9-8afc-7b413f23169f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:08.517921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4bcdb-e593-4be9-8afc-7b413f23169f None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:08.518792 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4bcdb-e593-4be9-8afc-7b413f23169f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:08.519152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4bcdb-e593-4be9-8afc-7b413f23169f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:08.520687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4bcdb-e593-4be9-8afc-7b413f23169f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:08.533391 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 612/1245] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:32:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:08.540269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4087a7b-ad84-4e94-a31a-c97c7d3b39f6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:08.651543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4087a7b-ad84-4e94-a31a-c97c7d3b39f6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:08.685912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b712dbd-37b5-449a-a626-9396daef7c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:08.686608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b712dbd-37b5-449a-a626-9396daef7c45 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:08.686895 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b712dbd-37b5-449a-a626-9396daef7c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:08.687170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b712dbd-37b5-449a-a626-9396daef7c45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:08.688003 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b712dbd-37b5-449a-a626-9396daef7c45 None admin] RBAC: Adding query filter params (role.id=a21e569e87fa4cb7bfb252986942b9ab, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=9ffef7640dd1487ab2ea91fc0f4be9e9) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:08.688318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b712dbd-37b5-449a-a626-9396daef7c45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:08.689764 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b712dbd-37b5-449a-a626-9396daef7c45 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:08.696244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 634/1246] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:32:08 2022] GET /identity/v3/role_assignments?user.id=9ffef7640dd1487ab2ea91fc0f4be9e9&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=a21e569e87fa4cb7bfb252986942b9ab => generated 610 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:11.017824 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c7ca4-1eac-4995-aa97-0782605ca437 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:11.018389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c7ca4-1eac-4995-aa97-0782605ca437 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:11.018389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c7ca4-1eac-4995-aa97-0782605ca437 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:11.019768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 613/1247] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:32:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:11.025517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65492812-fcc0-4b11-96e3-25120f722fa3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:11.026049 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65492812-fcc0-4b11-96e3-25120f722fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:11.026156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65492812-fcc0-4b11-96e3-25120f722fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:11.031503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:11.044570 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-65492812-fcc0-4b11-96e3-25120f722fa3 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:11.045885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-65492812-fcc0-4b11-96e3-25120f722fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:11.126608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 635/1248] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:32:11 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:32:11.160587 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c7ca4-1eac-4995-aa97-0782605ca437 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:11.185299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:11.288153 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c7ca4-1eac-4995-aa97-0782605ca437 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:11.324379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aabc7a-954c-4b4e-8a56-09b1be4fa23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:11.325187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aabc7a-954c-4b4e-8a56-09b1be4fa23d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:11.325501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aabc7a-954c-4b4e-8a56-09b1be4fa23d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:11.325762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aabc7a-954c-4b4e-8a56-09b1be4fa23d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:11.336667 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aabc7a-954c-4b4e-8a56-09b1be4fa23d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:11.344425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-01aabc7a-954c-4b4e-8a56-09b1be4fa23d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:32:11.344425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:11.344425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:11.344425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:11.344425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:11.344425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:11.344425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:11.344425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:11.344425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:11.344425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:11.344425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:11.344425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:11.344425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:11.344425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:11.344425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:11.344425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:11.346117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:11.346117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:11.346117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:11.346117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:11.346117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:11.346117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:11.346117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:11.346117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:11.346117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:11.346117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:11.346117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:11.346117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:32:11.346117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:11.346117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:11.346117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:11.346117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:11.347098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:11.347098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:11.347098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:11.347098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:11.347098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:11.347098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:11.347098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:11.347098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:11.347098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:11.347098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:11.347098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:32:11.347098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:32:11.347098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 614/1249] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:32:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:32:11.352467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65492812-fcc0-4b11-96e3-25120f722fa3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:11.460824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65492812-fcc0-4b11-96e3-25120f722fa3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:11.495179 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:11.501887 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e3310-c60f-48af-9bc7-9ba6d96ff74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:11.502628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e3310-c60f-48af-9bc7-9ba6d96ff74e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:11.503046 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e3310-c60f-48af-9bc7-9ba6d96ff74e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:11.503324 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e3310-c60f-48af-9bc7-9ba6d96ff74e None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:11.504085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e3310-c60f-48af-9bc7-9ba6d96ff74e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:11.504424 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e3310-c60f-48af-9bc7-9ba6d96ff74e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:11.505815 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e3310-c60f-48af-9bc7-9ba6d96ff74e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:11.514318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 636/1250] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:32:11 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:11.521026 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aabc7a-954c-4b4e-8a56-09b1be4fa23d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:11.608075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:11.634183 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aabc7a-954c-4b4e-8a56-09b1be4fa23d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:11.673733 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa95b6d-7110-402f-b6ed-85cebf1c92b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:11.674544 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa95b6d-7110-402f-b6ed-85cebf1c92b9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:11.674864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa95b6d-7110-402f-b6ed-85cebf1c92b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:11.675146 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa95b6d-7110-402f-b6ed-85cebf1c92b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:11.686378 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa95b6d-7110-402f-b6ed-85cebf1c92b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:11.687946 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa95b6d-7110-402f-b6ed-85cebf1c92b9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:11.706719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-6aa95b6d-7110-402f-b6ed-85cebf1c92b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:11.706719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:11.706719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:11.706719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:11.706719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:11.706719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:11.706719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:11.706719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:11.706719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:11.706719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:11.706719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:11.706719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:11.706719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:32:11.706719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:32:11.706719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:32:11.707728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:32:11.707728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:11.707728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:11.707728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:11.707728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:11.707728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:11.707728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:11.707728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:11.707728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:32:11.707728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:11.707728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:11.707728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:11.707728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:11.707728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:11.707728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:11.707728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:11.707728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:11.708665 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:32:11.708665 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:32:11.708665 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:11.708665 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:32:11.708665 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 615/1251] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:32:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:11.713930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e3310-c60f-48af-9bc7-9ba6d96ff74e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:11.826967 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e3310-c60f-48af-9bc7-9ba6d96ff74e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:11.863981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc6007-932d-495f-8d16-03f50c7ded12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:11.864648 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc6007-932d-495f-8d16-03f50c7ded12 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:11.864941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc6007-932d-495f-8d16-03f50c7ded12 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:11.865250 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc6007-932d-495f-8d16-03f50c7ded12 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:11.866078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc6007-932d-495f-8d16-03f50c7ded12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:11.866443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc6007-932d-495f-8d16-03f50c7ded12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:11.867975 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc6007-932d-495f-8d16-03f50c7ded12 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:11.881018 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 637/1252] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:32:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:11.886944 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa95b6d-7110-402f-b6ed-85cebf1c92b9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:11.998717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa95b6d-7110-402f-b6ed-85cebf1c92b9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:12.028241 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:12.036268 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33d570-7286-4bed-b3ee-4f32ddb6ddba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:12.037191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33d570-7286-4bed-b3ee-4f32ddb6ddba None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:12.038250 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33d570-7286-4bed-b3ee-4f32ddb6ddba None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:12.038250 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33d570-7286-4bed-b3ee-4f32ddb6ddba None admin] PATH_INFO: `/v3/users/placement` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:12.047173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33d570-7286-4bed-b3ee-4f32ddb6ddba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:12.048983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33d570-7286-4bed-b3ee-4f32ddb6ddba None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:12.065246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ea33d570-7286-4bed-b3ee-4f32ddb6ddba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:32:12.065246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:12.065246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:12.065246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:12.065246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:12.065246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:12.065246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:12.065246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:12.065246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:12.065246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:12.065246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:12.065246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:12.065246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:32:12.065246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:32:12.065246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:32:12.065246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:32:12.066342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:12.066342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:12.066342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:32:12.066342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:32:12.066342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:32:12.066342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:32:12.066342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:12.066342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:12.066342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:12.066342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:12.066342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:12.066342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:32:12.066342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:12.066342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:12.066342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:12.066342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:12.066342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:12.066342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:12.072127 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:12.072127 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:12.072127 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:32:12.072127 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:32:12.072127 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:32:12.072127 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:32:12.072127 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:32:12.072127 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:32:12.072127 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:32:12.072127 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:32:12.072127 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 616/1253] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:32:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:12.072788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc6007-932d-495f-8d16-03f50c7ded12 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:12.133097 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:12.189540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc6007-932d-495f-8d16-03f50c7ded12 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:12.231124 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee2545-23e4-40d2-9da2-f49f156032d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:12.232080 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee2545-23e4-40d2-9da2-f49f156032d3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:12.232424 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee2545-23e4-40d2-9da2-f49f156032d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:12.232724 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee2545-23e4-40d2-9da2-f49f156032d3 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:12.233685 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee2545-23e4-40d2-9da2-f49f156032d3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:12.234033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee2545-23e4-40d2-9da2-f49f156032d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:12.235579 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee2545-23e4-40d2-9da2-f49f156032d3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:12.255247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 638/1254] 10.222.0.110 () {56 vars in 1148 bytes} [Thu May 26 16:32:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:12.261179 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33d570-7286-4bed-b3ee-4f32ddb6ddba None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:12.370733 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33d570-7286-4bed-b3ee-4f32ddb6ddba None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:12.406783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f89bb0-b073-49e7-8f69-deade816dde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:12.407959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f89bb0-b073-49e7-8f69-deade816dde6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:12.408246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f89bb0-b073-49e7-8f69-deade816dde6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:12.408550 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f89bb0-b073-49e7-8f69-deade816dde6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:12.466810 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:12.479427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f89bb0-b073-49e7-8f69-deade816dde6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:12.481041 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f89bb0-b073-49e7-8f69-deade816dde6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:12.586898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 617/1255] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:32:12 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:32:12.593038 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee2545-23e4-40d2-9da2-f49f156032d3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:12.708984 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee2545-23e4-40d2-9da2-f49f156032d3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:12.724269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:12.749831 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcf168-f9fc-414b-9f83-047986e2c568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:12.750728 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcf168-f9fc-414b-9f83-047986e2c568 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:12.751624 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcf168-f9fc-414b-9f83-047986e2c568 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:12.751909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcf168-f9fc-414b-9f83-047986e2c568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:12.763334 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcf168-f9fc-414b-9f83-047986e2c568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:12.764808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcf168-f9fc-414b-9f83-047986e2c568 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:12.784451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-d8bcf168-f9fc-414b-9f83-047986e2c568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:12.784451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:12.784451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:12.784451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:12.784451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:12.784451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:12.784451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:12.784451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:12.784451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:12.784451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:12.784451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:12.784451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:12.784451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:32:12.784451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:32:12.784451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:32:12.785616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:32:12.785616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:12.785616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:12.785616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:12.785616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:12.785616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:12.785616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:12.785616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:12.785616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:32:12.785616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:12.785616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:12.785616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:12.785616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:12.785616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:12.785616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:12.785616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:12.785616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:12.786951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:32:12.786951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:32:12.786951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:12.786951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:12.786951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 639/1256] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:32:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:12.791690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f89bb0-b073-49e7-8f69-deade816dde6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:12.886219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:12.899649 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f89bb0-b073-49e7-8f69-deade816dde6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:12.935671 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6ec73-7611-4423-8c48-d90b0bb6ad43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:12.936354 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6ec73-7611-4423-8c48-d90b0bb6ad43 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:12.936643 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6ec73-7611-4423-8c48-d90b0bb6ad43 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:12.936921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6ec73-7611-4423-8c48-d90b0bb6ad43 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:12.937649 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6ec73-7611-4423-8c48-d90b0bb6ad43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:12.937960 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6ec73-7611-4423-8c48-d90b0bb6ad43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:12.939472 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6ec73-7611-4423-8c48-d90b0bb6ad43 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:12.956084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 618/1257] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:32:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:12.957585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcf168-f9fc-414b-9f83-047986e2c568 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:13.062220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcf168-f9fc-414b-9f83-047986e2c568 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:13.098257 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053d612-8085-4068-aab1-f2894bd6c321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:13.099115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053d612-8085-4068-aab1-f2894bd6c321 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:13.099403 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053d612-8085-4068-aab1-f2894bd6c321 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:13.099680 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053d612-8085-4068-aab1-f2894bd6c321 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:13.107161 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053d612-8085-4068-aab1-f2894bd6c321 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:13.108642 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053d612-8085-4068-aab1-f2894bd6c321 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:13.123818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-0053d612-8085-4068-aab1-f2894bd6c321 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:32:13.123818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:13.123818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:13.123818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:13.123818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:13.123818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:13.123818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:13.123818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:13.123818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:13.123818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:13.123818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:13.123818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:13.123818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:32:13.123818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:32:13.123818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:32:13.125011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:32:13.125011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:13.125011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:13.125011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:13.125011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:13.125011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:13.125011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:13.125011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:13.125011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:32:13.125011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:13.125011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:13.125011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:13.125011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:13.125011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:13.125011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:13.125011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:13.125011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:13.131318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:32:13.131318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:32:13.131318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:32:13.131318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:32:13.131318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:32:13.131318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:32:13.131318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:32:13.131318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:13.131318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 640/1258] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:32:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:32:13.131808 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6ec73-7611-4423-8c48-d90b0bb6ad43 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:13.245724 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6ec73-7611-4423-8c48-d90b0bb6ad43 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:13.279720 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778508c7-cb23-485f-95c1-dbe7b8c7e9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:13.280396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778508c7-cb23-485f-95c1-dbe7b8c7e9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:13.280686 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778508c7-cb23-485f-95c1-dbe7b8c7e9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:13.280969 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778508c7-cb23-485f-95c1-dbe7b8c7e9c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:13.281759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778508c7-cb23-485f-95c1-dbe7b8c7e9c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:13.282067 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778508c7-cb23-485f-95c1-dbe7b8c7e9c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:13.283537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778508c7-cb23-485f-95c1-dbe7b8c7e9c2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:13.296473 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 619/1259] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:32:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:13.303030 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053d612-8085-4068-aab1-f2894bd6c321 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:13.334522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:13.416500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053d612-8085-4068-aab1-f2894bd6c321 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:13.449253 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9048a65-37b5-4539-8ea2-0f70ec31a0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:13.449901 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9048a65-37b5-4539-8ea2-0f70ec31a0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:13.450184 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9048a65-37b5-4539-8ea2-0f70ec31a0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:13.450461 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9048a65-37b5-4539-8ea2-0f70ec31a0d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:13.451313 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9048a65-37b5-4539-8ea2-0f70ec31a0d0 None admin] RBAC: Adding query filter params (role.id=1393d128d39b4649b6cd71b6609846cb, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=9ffef7640dd1487ab2ea91fc0f4be9e9) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:13.451624 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9048a65-37b5-4539-8ea2-0f70ec31a0d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:13.453110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9048a65-37b5-4539-8ea2-0f70ec31a0d0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:13.458451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 641/1260] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:32:13 2022] GET /identity/v3/role_assignments?user.id=9ffef7640dd1487ab2ea91fc0f4be9e9&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=1393d128d39b4649b6cd71b6609846cb => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:15.627053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f55cfb-093a-445f-9049-6c6170b69e2c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:15.627565 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f55cfb-093a-445f-9049-6c6170b69e2c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:15.627565 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f55cfb-093a-445f-9049-6c6170b69e2c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:15.628910 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 620/1261] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:32:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:15.634299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb44292-455a-4d42-95aa-db79c09d62a8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:15.634753 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb44292-455a-4d42-95aa-db79c09d62a8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:15.634900 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb44292-455a-4d42-95aa-db79c09d62a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:15.652553 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-bfb44292-455a-4d42-95aa-db79c09d62a8 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:15.653734 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bfb44292-455a-4d42-95aa-db79c09d62a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:15.717359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 642/1262] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:32:15 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:32:15.740219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f55cfb-093a-445f-9049-6c6170b69e2c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:15.751663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:15.844897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f55cfb-093a-445f-9049-6c6170b69e2c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:15.880559 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce0e84-36a1-4dd1-9eaa-e186a24e9990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:15.881288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce0e84-36a1-4dd1-9eaa-e186a24e9990 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:15.881577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce0e84-36a1-4dd1-9eaa-e186a24e9990 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:15.881856 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce0e84-36a1-4dd1-9eaa-e186a24e9990 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:15.892508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce0e84-36a1-4dd1-9eaa-e186a24e9990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:15.900174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-97ce0e84-36a1-4dd1-9eaa-e186a24e9990 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:32:15.900174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:15.900174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:15.900174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:15.900174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:15.900174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:15.900174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:15.900174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:15.900174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:15.900174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:15.900174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:15.900174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:15.900174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:15.900174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:15.900174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:15.900174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:15.901265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:15.901265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:15.901265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:15.901265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:15.901265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:15.901265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:15.901265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:15.901265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:15.901265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:15.901265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:15.901265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:15.901265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:32:15.901265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:15.901265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:15.901265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:15.901265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:15.902316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:15.902316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:15.902316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:15.902316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:15.902316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:15.902316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:15.902316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:15.902316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:15.902316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:15.902316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:15.902316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:32:15.902316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:32:15.902316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 621/1263] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:32:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:15.907960 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb44292-455a-4d42-95aa-db79c09d62a8 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:15.926215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:16.004576 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb44292-455a-4d42-95aa-db79c09d62a8 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:16.037204 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e97c7a-9fd8-4719-9ec1-dec36ca96cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:16.037864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e97c7a-9fd8-4719-9ec1-dec36ca96cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:16.038245 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e97c7a-9fd8-4719-9ec1-dec36ca96cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:16.038533 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e97c7a-9fd8-4719-9ec1-dec36ca96cf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:16.039301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e97c7a-9fd8-4719-9ec1-dec36ca96cf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:16.039614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e97c7a-9fd8-4719-9ec1-dec36ca96cf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:16.040987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e97c7a-9fd8-4719-9ec1-dec36ca96cf0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:16.048915 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 643/1264] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:32:15 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:16.054732 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce0e84-36a1-4dd1-9eaa-e186a24e9990 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:16.120737 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:16.157106 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce0e84-36a1-4dd1-9eaa-e186a24e9990 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:16.196769 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c68deb-df6f-48c2-a2ba-b012f21f8542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:16.197639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c68deb-df6f-48c2-a2ba-b012f21f8542 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:16.197977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c68deb-df6f-48c2-a2ba-b012f21f8542 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:16.198303 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c68deb-df6f-48c2-a2ba-b012f21f8542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:16.210829 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c68deb-df6f-48c2-a2ba-b012f21f8542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:16.212432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c68deb-df6f-48c2-a2ba-b012f21f8542 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:16.230645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e1c68deb-df6f-48c2-a2ba-b012f21f8542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:16.230645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:16.230645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:16.230645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:16.230645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:16.230645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:16.230645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:16.230645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:16.230645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:16.230645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:16.230645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:16.230645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:16.230645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:32:16.230645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:32:16.230645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:32:16.231562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:32:16.231562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:16.231562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:16.231562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:16.231562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:16.231562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:16.231562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:16.231562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:16.231562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:32:16.231562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:16.231562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:16.231562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:16.231562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:16.231562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:16.231562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:16.231562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:16.231562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:16.232576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:32:16.232576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:32:16.232576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:16.232576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:32:16.232576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 622/1265] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:16.238395 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e97c7a-9fd8-4719-9ec1-dec36ca96cf0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:16.316690 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:16.336058 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e97c7a-9fd8-4719-9ec1-dec36ca96cf0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:16.368675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72b909-3ad1-450a-ae6f-9aa1fabec1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:16.369329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72b909-3ad1-450a-ae6f-9aa1fabec1fc None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:16.369612 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72b909-3ad1-450a-ae6f-9aa1fabec1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:16.369885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72b909-3ad1-450a-ae6f-9aa1fabec1fc None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:16.370621 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72b909-3ad1-450a-ae6f-9aa1fabec1fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:16.370932 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72b909-3ad1-450a-ae6f-9aa1fabec1fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:16.372389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72b909-3ad1-450a-ae6f-9aa1fabec1fc None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:16.384489 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 644/1266] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:32:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:16.390076 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c68deb-df6f-48c2-a2ba-b012f21f8542 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:16.490847 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c68deb-df6f-48c2-a2ba-b012f21f8542 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:16.510147 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:16.524428 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31934f99-5284-4fc3-b5a0-38e4fbf8c545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:16.525230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31934f99-5284-4fc3-b5a0-38e4fbf8c545 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:16.525519 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31934f99-5284-4fc3-b5a0-38e4fbf8c545 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:16.525798 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31934f99-5284-4fc3-b5a0-38e4fbf8c545 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:16.533131 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31934f99-5284-4fc3-b5a0-38e4fbf8c545 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:16.534560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31934f99-5284-4fc3-b5a0-38e4fbf8c545 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:16.548758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-31934f99-5284-4fc3-b5a0-38e4fbf8c545 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:32:16.548758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:16.548758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:16.548758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:16.548758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:16.548758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:16.548758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:16.548758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:16.548758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:16.548758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:16.548758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:16.548758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:16.548758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:32:16.548758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:32:16.548758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:32:16.548758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:32:16.549891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:16.549891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:16.549891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:32:16.549891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:32:16.549891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:32:16.549891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:32:16.549891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:16.549891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:16.549891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:16.549891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:16.549891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:16.549891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:32:16.549891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:16.549891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:16.549891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:16.549891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:16.549891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:16.549891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:16.550904 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:16.550904 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:16.550904 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:32:16.550904 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:32:16.550904 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:32:16.550904 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:32:16.550904 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:32:16.550904 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:32:16.550904 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:32:16.550904 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:32:16.550904 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 623/1267] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:32:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:16.555628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72b909-3ad1-450a-ae6f-9aa1fabec1fc None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:16.650697 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72b909-3ad1-450a-ae6f-9aa1fabec1fc None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:16.692074 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43533043-ef2b-4305-bd28-6e92586ab075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:16.692741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43533043-ef2b-4305-bd28-6e92586ab075 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:16.693031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43533043-ef2b-4305-bd28-6e92586ab075 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:16.693313 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43533043-ef2b-4305-bd28-6e92586ab075 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:16.694140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43533043-ef2b-4305-bd28-6e92586ab075 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:16.694458 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43533043-ef2b-4305-bd28-6e92586ab075 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:16.695916 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43533043-ef2b-4305-bd28-6e92586ab075 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:16.705018 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:16.713718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 645/1268] 10.222.0.110 () {56 vars in 1148 bytes} [Thu May 26 16:32:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:32:16.719423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31934f99-5284-4fc3-b5a0-38e4fbf8c545 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:16.817181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31934f99-5284-4fc3-b5a0-38e4fbf8c545 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:16.849287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67342709-f278-4460-b97d-3796b884a37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:16.850073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67342709-f278-4460-b97d-3796b884a37b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:16.850365 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67342709-f278-4460-b97d-3796b884a37b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:16.850674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67342709-f278-4460-b97d-3796b884a37b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:16.861468 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67342709-f278-4460-b97d-3796b884a37b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:16.863606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67342709-f278-4460-b97d-3796b884a37b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:16.881054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-67342709-f278-4460-b97d-3796b884a37b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:16.881054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:16.881054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:16.881054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:16.881054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:16.881054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:16.881054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:16.881054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:16.881054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:16.881054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:16.881054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:16.881054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:16.881054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:32:16.881054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:32:16.881054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:32:16.882107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:32:16.882107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:16.882107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:16.882107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:16.882107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:16.882107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:16.882107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:16.882107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:16.882107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:32:16.882107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:16.882107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:16.882107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:16.882107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:16.882107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:16.882107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:16.882107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:16.882107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:16.883180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:32:16.883180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:32:16.883180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:16.883180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:32:16.883180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 624/1269] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:16.887848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43533043-ef2b-4305-bd28-6e92586ab075 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:16.983462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43533043-ef2b-4305-bd28-6e92586ab075 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:17.016974 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d86e5-1797-4620-b642-1d6fa599f555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:17.017625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d86e5-1797-4620-b642-1d6fa599f555 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:17.017913 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d86e5-1797-4620-b642-1d6fa599f555 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:17.018196 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d86e5-1797-4620-b642-1d6fa599f555 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:17.018939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d86e5-1797-4620-b642-1d6fa599f555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:17.019251 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d86e5-1797-4620-b642-1d6fa599f555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:17.020611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d86e5-1797-4620-b642-1d6fa599f555 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:17.031561 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 646/1270] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:32:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:17.037043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67342709-f278-4460-b97d-3796b884a37b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:17.068592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:17.135173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67342709-f278-4460-b97d-3796b884a37b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:17.175270 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15565d8-edc6-4452-a1a9-3dd859166d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:17.176085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15565d8-edc6-4452-a1a9-3dd859166d8a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:17.176367 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15565d8-edc6-4452-a1a9-3dd859166d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:17.176647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15565d8-edc6-4452-a1a9-3dd859166d8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:17.183432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15565d8-edc6-4452-a1a9-3dd859166d8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:17.184861 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15565d8-edc6-4452-a1a9-3dd859166d8a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:17.199558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a15565d8-edc6-4452-a1a9-3dd859166d8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:32:17.199558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:17.199558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:17.199558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:17.199558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:17.199558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:17.199558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:17.199558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:17.199558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:17.199558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:17.199558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:17.199558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:17.199558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:32:17.199558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:32:17.199558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:32:17.200596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:32:17.200596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:17.200596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:17.200596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:17.200596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:17.200596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:17.200596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:17.200596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:17.200596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:32:17.200596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:17.200596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:17.200596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:17.200596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:17.200596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:17.200596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:17.200596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:17.200596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:17.201611 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:32:17.201611 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:32:17.201611 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:32:17.201611 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:32:17.201611 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:32:17.201611 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:32:17.201611 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:32:17.201611 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:32:17.201611 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 625/1271] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:32:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:17.206530 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d86e5-1797-4620-b642-1d6fa599f555 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:17.264735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:17.306437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d86e5-1797-4620-b642-1d6fa599f555 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:17.338181 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1db79-2609-4964-b8f2-b1601a7435b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:17.338795 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1db79-2609-4964-b8f2-b1601a7435b7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:17.339078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1db79-2609-4964-b8f2-b1601a7435b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:17.339350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1db79-2609-4964-b8f2-b1601a7435b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:17.340128 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1db79-2609-4964-b8f2-b1601a7435b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:17.340433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1db79-2609-4964-b8f2-b1601a7435b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:17.341852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1db79-2609-4964-b8f2-b1601a7435b7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:17.354111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 647/1272] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:32:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:17.360897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15565d8-edc6-4452-a1a9-3dd859166d8a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:17.449257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:17.458197 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15565d8-edc6-4452-a1a9-3dd859166d8a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:17.494575 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154ee84-44b0-4b4d-9e04-fc32c4f425d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:17.495486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154ee84-44b0-4b4d-9e04-fc32c4f425d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:17.495770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154ee84-44b0-4b4d-9e04-fc32c4f425d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:17.496047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154ee84-44b0-4b4d-9e04-fc32c4f425d9 None admin] PATH_INFO: `/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/9ffef7640dd1487ab2ea91fc0f4be9e9/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:17.497964 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154ee84-44b0-4b4d-9e04-fc32c4f425d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d33e1f400b3e46379d2a0abd05921181, user_id=9ffef7640dd1487ab2ea91fc0f4be9e9, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:17.499409 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154ee84-44b0-4b4d-9e04-fc32c4f425d9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:17.511758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 626/1273] 10.222.0.110 () {58 vars in 1444 bytes} [Thu May 26 16:32:17 2022] PUT /identity/v3/projects/d33e1f400b3e46379d2a0abd05921181/users/9ffef7640dd1487ab2ea91fc0f4be9e9/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:32:19.694879 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef467b-26a1-4414-99df-fa7e0fac4bdf None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:19.695377 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef467b-26a1-4414-99df-fa7e0fac4bdf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:19.695377 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef467b-26a1-4414-99df-fa7e0fac4bdf None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:19.696740 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 648/1274] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:32:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:19.701758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b912f39-fcb7-446c-b525-a7c178b765dc None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:19.702179 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b912f39-fcb7-446c-b525-a7c178b765dc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:19.702322 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b912f39-fcb7-446c-b525-a7c178b765dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:19.719913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8b912f39-fcb7-446c-b525-a7c178b765dc None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:19.721120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8b912f39-fcb7-446c-b525-a7c178b765dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:19.785854 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 627/1275] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:32:19 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:32:19.809068 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef467b-26a1-4414-99df-fa7e0fac4bdf None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:19.908475 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef467b-26a1-4414-99df-fa7e0fac4bdf None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:19.925633 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:19.942366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7ab79-30fc-42ba-96dd-a8ccbd9acc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:19.943187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7ab79-30fc-42ba-96dd-a8ccbd9acc43 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:19.943473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7ab79-30fc-42ba-96dd-a8ccbd9acc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:19.943750 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7ab79-30fc-42ba-96dd-a8ccbd9acc43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:19.953639 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7ab79-30fc-42ba-96dd-a8ccbd9acc43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:19.961247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-a1f7ab79-30fc-42ba-96dd-a8ccbd9acc43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:32:19.961247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:19.961247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:19.961247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:19.961247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:19.961247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:19.961247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:19.961247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:19.961247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:19.961247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:19.961247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:19.961247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:19.961247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:19.961247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:19.961247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:19.961247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:19.962371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:19.962371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:19.962371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:19.962371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:19.962371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:19.962371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:19.962371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:19.962371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:19.962371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:19.962371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:19.962371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:19.962371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:32:19.962371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:19.962371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:19.962371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:19.962371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:19.963567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:19.963567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:19.963567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:19.963567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:19.963567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:19.963567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:19.963567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:19.963567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:19.963567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:19.963567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:19.963567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:32:19.963567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:19.963567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 649/1276] 10.222.0.110 () {56 vars in 1101 bytes} [Thu May 26 16:32:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:19.968543 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b912f39-fcb7-446c-b525-a7c178b765dc None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:20.045966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:20.064576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b912f39-fcb7-446c-b525-a7c178b765dc None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:20.097325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae10363-6d43-486f-8230-5f6f8e385d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:20.097994 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae10363-6d43-486f-8230-5f6f8e385d23 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:20.098280 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae10363-6d43-486f-8230-5f6f8e385d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:20.098560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae10363-6d43-486f-8230-5f6f8e385d23 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:20.099326 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae10363-6d43-486f-8230-5f6f8e385d23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:20.099637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae10363-6d43-486f-8230-5f6f8e385d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:20.100990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae10363-6d43-486f-8230-5f6f8e385d23 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:20.108835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 628/1277] 10.222.0.110 () {56 vars in 1104 bytes} [Thu May 26 16:32:19 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:20.115284 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7ab79-30fc-42ba-96dd-a8ccbd9acc43 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:20.225130 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7ab79-30fc-42ba-96dd-a8ccbd9acc43 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:20.258260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe2b4c-028e-47fe-ae59-872683c1eea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:20.259071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe2b4c-028e-47fe-ae59-872683c1eea8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:20.259357 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe2b4c-028e-47fe-ae59-872683c1eea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:20.259633 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe2b4c-028e-47fe-ae59-872683c1eea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:20.269835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe2b4c-028e-47fe-ae59-872683c1eea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:20.271284 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe2b4c-028e-47fe-ae59-872683c1eea8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:20.288381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-32fe2b4c-028e-47fe-ae59-872683c1eea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:20.288381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:20.288381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:20.288381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:20.288381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:20.288381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:20.288381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:20.288381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:20.288381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:20.288381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:20.288381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:20.288381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:20.288381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:32:20.288381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:32:20.288381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:32:20.289467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:32:20.289467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:20.289467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:20.289467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:20.289467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:20.289467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:20.289467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:20.289467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:20.289467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:32:20.289467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:20.289467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:20.289467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:20.289467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:20.289467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:20.289467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:20.289467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:20.289467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:20.290363 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:32:20.290363 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:32:20.290363 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:20.290363 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:20.290363 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 650/1278] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:32:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:20.295407 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae10363-6d43-486f-8230-5f6f8e385d23 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:20.393659 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae10363-6d43-486f-8230-5f6f8e385d23 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:20.426591 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10378e1a-a233-4c11-b1dc-425cf0c22cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:20.427252 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10378e1a-a233-4c11-b1dc-425cf0c22cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:20.427532 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10378e1a-a233-4c11-b1dc-425cf0c22cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:20.427802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10378e1a-a233-4c11-b1dc-425cf0c22cb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:20.428510 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10378e1a-a233-4c11-b1dc-425cf0c22cb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:20.428813 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10378e1a-a233-4c11-b1dc-425cf0c22cb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:20.430154 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10378e1a-a233-4c11-b1dc-425cf0c22cb4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:20.442440 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 629/1279] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:32:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:20.448086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe2b4c-028e-47fe-ae59-872683c1eea8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:20.478288 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:20.546875 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe2b4c-028e-47fe-ae59-872683c1eea8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:20.579470 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b7c3a-65b3-4cf5-929e-32b38f782660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:20.580253 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b7c3a-65b3-4cf5-929e-32b38f782660 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:20.580538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b7c3a-65b3-4cf5-929e-32b38f782660 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:20.580813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b7c3a-65b3-4cf5-929e-32b38f782660 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:20.587895 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b7c3a-65b3-4cf5-929e-32b38f782660 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:20.589325 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b7c3a-65b3-4cf5-929e-32b38f782660 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:20.603394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-0b8b7c3a-65b3-4cf5-929e-32b38f782660 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:32:20.603394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:20.603394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:20.603394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:20.603394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:20.603394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:20.603394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:20.603394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:20.603394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:20.603394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:20.603394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:20.603394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:20.603394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:32:20.603394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:32:20.603394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:32:20.603394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:32:20.605156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:20.605156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:20.605156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:32:20.605156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:32:20.605156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:32:20.605156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:32:20.605156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:20.605156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:20.605156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:20.605156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:20.605156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:20.605156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:32:20.605156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:20.605156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:20.605156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:20.605156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:20.605156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:20.605156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:20.607078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:20.607078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:20.607078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:32:20.607078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:32:20.607078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:32:20.607078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:32:20.607078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:32:20.607078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:32:20.607078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:32:20.607078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:20.607078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 651/1280] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:32:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:20.610425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10378e1a-a233-4c11-b1dc-425cf0c22cb4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:20.614489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:20.714332 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10378e1a-a233-4c11-b1dc-425cf0c22cb4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:20.747955 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4fa76-aea6-4284-8b73-d50fce311680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:20.748628 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4fa76-aea6-4284-8b73-d50fce311680 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:20.748917 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4fa76-aea6-4284-8b73-d50fce311680 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:20.749193 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4fa76-aea6-4284-8b73-d50fce311680 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:20.750591 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4fa76-aea6-4284-8b73-d50fce311680 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:20.750901 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4fa76-aea6-4284-8b73-d50fce311680 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:20.752458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4fa76-aea6-4284-8b73-d50fce311680 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:20.769046 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 630/1281] 10.222.0.110 () {56 vars in 1148 bytes} [Thu May 26 16:32:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:20.774895 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b7c3a-65b3-4cf5-929e-32b38f782660 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:20.863049 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:20.872434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b7c3a-65b3-4cf5-929e-32b38f782660 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:20.905030 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d8e4b-5e90-4106-bf15-9dcf7ba47c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:20.905735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d8e4b-5e90-4106-bf15-9dcf7ba47c73 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:20.906126 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d8e4b-5e90-4106-bf15-9dcf7ba47c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:20.906530 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d8e4b-5e90-4106-bf15-9dcf7ba47c73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:20.970811 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d8e4b-5e90-4106-bf15-9dcf7ba47c73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:20.972269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d8e4b-5e90-4106-bf15-9dcf7ba47c73 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:21.057440 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:21.067421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 652/1282] 10.222.0.110 () {58 vars in 1287 bytes} [Thu May 26 16:32:20 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:32:21.073286 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4fa76-aea6-4284-8b73-d50fce311680 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:21.132011 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:21.171127 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4fa76-aea6-4284-8b73-d50fce311680 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:21.203415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3ee63-fd91-467d-a32a-0e3271f84b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:21.204235 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3ee63-fd91-467d-a32a-0e3271f84b89 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:21.204516 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3ee63-fd91-467d-a32a-0e3271f84b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:21.204789 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3ee63-fd91-467d-a32a-0e3271f84b89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:21.214604 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3ee63-fd91-467d-a32a-0e3271f84b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:21.216044 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3ee63-fd91-467d-a32a-0e3271f84b89 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:21.234130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-90f3ee63-fd91-467d-a32a-0e3271f84b89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:21.234130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:21.234130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:21.234130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:21.234130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:21.234130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:21.234130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:21.234130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:21.234130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:21.234130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:21.234130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:21.234130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:21.234130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:32:21.234130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:32:21.234130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:32:21.235169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:32:21.235169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:21.235169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:21.235169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:21.235169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:21.235169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:21.235169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:21.235169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:21.235169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:32:21.235169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:21.235169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:21.235169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:21.235169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:21.235169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:21.235169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:21.235169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:21.235169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:21.236742 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:32:21.236742 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:32:21.236742 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:21.236742 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:32:21.236742 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 631/1283] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:32:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:32:21.241801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d8e4b-5e90-4106-bf15-9dcf7ba47c73 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:21.337152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d8e4b-5e90-4106-bf15-9dcf7ba47c73 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:21.371398 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f98dc0-a4ff-4f7d-bf88-2457e724f556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:21.372119 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f98dc0-a4ff-4f7d-bf88-2457e724f556 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:21.372402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f98dc0-a4ff-4f7d-bf88-2457e724f556 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:21.372678 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f98dc0-a4ff-4f7d-bf88-2457e724f556 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:21.373391 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f98dc0-a4ff-4f7d-bf88-2457e724f556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:21.373699 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f98dc0-a4ff-4f7d-bf88-2457e724f556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:21.375612 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f98dc0-a4ff-4f7d-bf88-2457e724f556 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:21.386744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 653/1284] 10.222.0.110 () {56 vars in 1114 bytes} [Thu May 26 16:32:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:21.392867 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3ee63-fd91-467d-a32a-0e3271f84b89 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:21.490785 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3ee63-fd91-467d-a32a-0e3271f84b89 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:21.504306 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:21.524506 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccbee0-e789-415a-bf43-32adf6b7e5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:21.525299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccbee0-e789-415a-bf43-32adf6b7e5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:21.525587 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccbee0-e789-415a-bf43-32adf6b7e5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:21.525865 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccbee0-e789-415a-bf43-32adf6b7e5e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:21.533010 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bccbee0-e789-415a-bf43-32adf6b7e5e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:21.534462 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bccbee0-e789-415a-bf43-32adf6b7e5e9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:21.548215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-9bccbee0-e789-415a-bf43-32adf6b7e5e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:32:21.548215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:21.548215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:21.548215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:21.548215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:21.548215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:21.548215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:21.548215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:21.548215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:21.548215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:21.548215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:21.548215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:21.548215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:32:21.548215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:32:21.548215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:32:21.549258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:32:21.549258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:21.549258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:21.549258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:21.549258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:21.549258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:21.549258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:21.549258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:21.549258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( May 26 16:32:21.549258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:21.549258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:21.549258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:21.549258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:21.549258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:21.549258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:21.549258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:21.549258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:21.550509 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:32:21.550509 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:32:21.550509 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:32:21.550509 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:32:21.550509 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:32:21.550509 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:32:21.550509 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:32:21.550509 dv-cinder-836072-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application May 26 16:32:21.550509 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 632/1285] 10.222.0.110 () {56 vars in 1116 bytes} [Thu May 26 16:32:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:21.555296 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f98dc0-a4ff-4f7d-bf88-2457e724f556 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:21.604029 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:21.652391 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f98dc0-a4ff-4f7d-bf88-2457e724f556 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:21.684273 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e05b26-561c-45c9-a4c3-750bcc5a48dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:21.684921 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e05b26-561c-45c9-a4c3-750bcc5a48dc None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:21.685205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e05b26-561c-45c9-a4c3-750bcc5a48dc None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:21.685479 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e05b26-561c-45c9-a4c3-750bcc5a48dc None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:21.686249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e05b26-561c-45c9-a4c3-750bcc5a48dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:21.686555 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e05b26-561c-45c9-a4c3-750bcc5a48dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:21.688011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e05b26-561c-45c9-a4c3-750bcc5a48dc None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:21.699456 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 654/1286] 10.222.0.110 () {56 vars in 1153 bytes} [Thu May 26 16:32:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:32:21.706064 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccbee0-e789-415a-bf43-32adf6b7e5e9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:21.801399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccbee0-e789-415a-bf43-32adf6b7e5e9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:21.833344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2cb72-eb71-487c-86b7-f46e022419b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:21.833984 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2cb72-eb71-487c-86b7-f46e022419b4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:21.834270 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2cb72-eb71-487c-86b7-f46e022419b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:21.834546 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2cb72-eb71-487c-86b7-f46e022419b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:21.835393 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2cb72-eb71-487c-86b7-f46e022419b4 None admin] RBAC: Adding query filter params (role.id=1393d128d39b4649b6cd71b6609846cb, scope.project.id=d33e1f400b3e46379d2a0abd05921181, user.id=9ffef7640dd1487ab2ea91fc0f4be9e9) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:21.835704 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2cb72-eb71-487c-86b7-f46e022419b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:21.837107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2cb72-eb71-487c-86b7-f46e022419b4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:21.842765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 633/1287] 10.222.0.110 () {56 vars in 1379 bytes} [Thu May 26 16:32:21 2022] GET /identity/v3/role_assignments?user.id=9ffef7640dd1487ab2ea91fc0f4be9e9&scope.project.id=d33e1f400b3e46379d2a0abd05921181&role.id=1393d128d39b4649b6cd71b6609846cb => generated 610 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:24.023974 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfac434-c592-4f54-8033-1bf96944f861 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:24.024503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfac434-c592-4f54-8033-1bf96944f861 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:24.024503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfac434-c592-4f54-8033-1bf96944f861 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:24.025899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 655/1288] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:32:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:24.031672 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc59379-3e6b-406d-bd74-524eb3405b55 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:24.032045 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc59379-3e6b-406d-bd74-524eb3405b55 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:24.032235 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc59379-3e6b-406d-bd74-524eb3405b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:24.049309 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8cc59379-3e6b-406d-bd74-524eb3405b55 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:24.050505 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8cc59379-3e6b-406d-bd74-524eb3405b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:24.079280 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:24.116985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 634/1289] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:32:24 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:32:24.138915 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfac434-c592-4f54-8033-1bf96944f861 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:24.247752 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfac434-c592-4f54-8033-1bf96944f861 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:24.258754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:24.283361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c558dd-19d0-40fa-9f84-25b596564c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:24.284095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c558dd-19d0-40fa-9f84-25b596564c79 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:24.284378 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c558dd-19d0-40fa-9f84-25b596564c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:24.284655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c558dd-19d0-40fa-9f84-25b596564c79 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:24.285301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c558dd-19d0-40fa-9f84-25b596564c79 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:24.286687 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c558dd-19d0-40fa-9f84-25b596564c79 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:24.298971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-56c558dd-19d0-40fa-9f84-25b596564c79 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:32:24.298971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:24.298971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:32:24.298971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:32:24.298971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:32:24.298971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:32:24.298971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:32:24.298971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:32:24.298971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:32:24.298971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:24.298971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:32:24.298971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:24.298971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:24.298971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:24.298971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:24.298971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:24.298971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:24.300028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:24.300028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:24.300028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:24.300028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:24.300028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:24.300028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:24.300028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:32:24.300028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:32:24.300028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:32:24.300028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:32:24.300028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:24.300028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:24.300028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:24.300028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:24.300028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:24.300028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:24.300938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:24.300938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:32:24.300938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:24.300938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:24.300938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:24.300938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:24.300938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:24.300938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:24.300938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:24.300938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:24.300938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:32:24.300938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:32:24.300938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:32:24.300938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:24.300938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 656/1290] 10.222.0.110 () {56 vars in 1122 bytes} [Thu May 26 16:32:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:24.306238 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc59379-3e6b-406d-bd74-524eb3405b55 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:24.404048 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc59379-3e6b-406d-bd74-524eb3405b55 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:24.436206 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162efe41-e098-4b5d-bbac-2943e0a8ea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:24.436949 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162efe41-e098-4b5d-bbac-2943e0a8ea4d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:24.437235 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162efe41-e098-4b5d-bbac-2943e0a8ea4d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:24.437509 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162efe41-e098-4b5d-bbac-2943e0a8ea4d None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:24.438205 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162efe41-e098-4b5d-bbac-2943e0a8ea4d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:24.438508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162efe41-e098-4b5d-bbac-2943e0a8ea4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:24.439883 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162efe41-e098-4b5d-bbac-2943e0a8ea4d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:24.444544 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 635/1291] 10.222.0.110 () {56 vars in 1121 bytes} [Thu May 26 16:32:24 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:24.450358 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c558dd-19d0-40fa-9f84-25b596564c79 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:24.548715 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c558dd-19d0-40fa-9f84-25b596564c79 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:24.580893 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cda912-b6a6-4e28-b1a7-26be30ce0eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:24.581543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cda912-b6a6-4e28-b1a7-26be30ce0eec None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:24.581829 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cda912-b6a6-4e28-b1a7-26be30ce0eec None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:24.582107 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cda912-b6a6-4e28-b1a7-26be30ce0eec None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:24.582830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cda912-b6a6-4e28-b1a7-26be30ce0eec None admin] RBAC: Adding query filter params (type=placement) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:24.583141 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cda912-b6a6-4e28-b1a7-26be30ce0eec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:24.584510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cda912-b6a6-4e28-b1a7-26be30ce0eec None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:24.588839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 657/1292] 10.222.0.110 () {56 vars in 1121 bytes} [Thu May 26 16:32:24 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:26.771073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9012b-181d-4804-b848-9083cfa0b189 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:26.771632 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9012b-181d-4804-b848-9083cfa0b189 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:26.771632 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9012b-181d-4804-b848-9083cfa0b189 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:26.773011 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 636/1293] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:32:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:26.778175 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3d127-c1ec-4443-96c9-506f49fec039 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:26.778603 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3d127-c1ec-4443-96c9-506f49fec039 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:26.778781 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3d127-c1ec-4443-96c9-506f49fec039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:26.795829 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-05a3d127-c1ec-4443-96c9-506f49fec039 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:26.797008 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-05a3d127-c1ec-4443-96c9-506f49fec039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:26.825355 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:26.862153 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 658/1294] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:32:26 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:32:26.884515 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9012b-181d-4804-b848-9083cfa0b189 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:26.915163 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:26.983249 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9012b-181d-4804-b848-9083cfa0b189 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:27.029504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e6a05-540d-4199-961b-3c2a0891a92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:27.030088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e6a05-540d-4199-961b-3c2a0891a92f None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:27.030917 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e6a05-540d-4199-961b-3c2a0891a92f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:27.031192 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e6a05-540d-4199-961b-3c2a0891a92f None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:27.031893 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e6a05-540d-4199-961b-3c2a0891a92f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:27.033235 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e6a05-540d-4199-961b-3c2a0891a92f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:27.046741 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 637/1295] 10.222.0.110 () {60 vars in 1146 bytes} [Thu May 26 16:32:26 2022] POST /identity/v3/services => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:32:29.274816 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d480e00-67a5-4f0a-a34a-4fba43b7a3ca None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:29.275433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d480e00-67a5-4f0a-a34a-4fba43b7a3ca None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:29.275433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d480e00-67a5-4f0a-a34a-4fba43b7a3ca None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:29.277035 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 659/1296] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:32:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:32:29.283317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8f60e-76cf-40c6-bc15-425459efaec8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:29.283750 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8f60e-76cf-40c6-bc15-425459efaec8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:29.283860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8f60e-76cf-40c6-bc15-425459efaec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:29.301043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dcc8f60e-76cf-40c6-bc15-425459efaec8 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:29.302227 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dcc8f60e-76cf-40c6-bc15-425459efaec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:29.374263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 638/1297] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:32:29 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:32:29.396418 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d480e00-67a5-4f0a-a34a-4fba43b7a3ca None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:29.496371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d480e00-67a5-4f0a-a34a-4fba43b7a3ca None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:29.529487 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bcceba-f6a3-4783-9821-f5adffe10902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:29.530885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcceba-f6a3-4783-9821-f5adffe10902 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:29.531173 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcceba-f6a3-4783-9821-f5adffe10902 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:29.531451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcceba-f6a3-4783-9821-f5adffe10902 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:29.532098 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bcceba-f6a3-4783-9821-f5adffe10902 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:29.533458 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bcceba-f6a3-4783-9821-f5adffe10902 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:29.545091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-f5bcceba-f6a3-4783-9821-f5adffe10902 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:32:29.545091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:29.545091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:32:29.545091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:32:29.545091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:32:29.545091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:32:29.545091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:32:29.545091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:32:29.545091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:32:29.545091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:29.545091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:32:29.545091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:29.545091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:29.545091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:29.545091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:29.545091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:29.545091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:29.546316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:29.546316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:29.546316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:29.546316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:29.546316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:29.546316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:29.546316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:32:29.546316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:32:29.546316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:32:29.546316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:32:29.546316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:29.546316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:29.546316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:29.546316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:29.546316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:29.546316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:29.547983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:29.547983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:32:29.547983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:29.547983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:29.547983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:29.547983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:29.547983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:29.547983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:29.547983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:29.547983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:29.547983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:32:29.547983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:32:29.547983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:32:29.547983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:29.547983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 660/1298] 10.222.0.110 () {56 vars in 1122 bytes} [Thu May 26 16:32:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:29.553131 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8f60e-76cf-40c6-bc15-425459efaec8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:29.571240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:29.650938 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8f60e-76cf-40c6-bc15-425459efaec8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:29.683733 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8815ea-1ff2-454a-ab47-b8036ab7bfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:29.684395 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8815ea-1ff2-454a-ab47-b8036ab7bfaf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:29.684678 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8815ea-1ff2-454a-ab47-b8036ab7bfaf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:29.684950 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8815ea-1ff2-454a-ab47-b8036ab7bfaf None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:29.685647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8815ea-1ff2-454a-ab47-b8036ab7bfaf None admin] RBAC: Adding query filter params (name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:29.685949 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8815ea-1ff2-454a-ab47-b8036ab7bfaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:29.687863 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8815ea-1ff2-454a-ab47-b8036ab7bfaf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:29.692862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 639/1299] 10.222.0.110 () {56 vars in 1121 bytes} [Thu May 26 16:32:29 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:29.698905 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bcceba-f6a3-4783-9821-f5adffe10902 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:29.729909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:29.798519 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bcceba-f6a3-4783-9821-f5adffe10902 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:29.830895 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3078e8-a676-4086-b2f7-873dfc045b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:29.831555 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3078e8-a676-4086-b2f7-873dfc045b7a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:29.831844 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3078e8-a676-4086-b2f7-873dfc045b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:29.832124 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3078e8-a676-4086-b2f7-873dfc045b7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:29.832911 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3078e8-a676-4086-b2f7-873dfc045b7a None admin] RBAC: Adding query filter params (interface=public, service_id=7480b2cd55ff48178ececdef3dcd3cbf, region_id=RegionOne) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:29.833230 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3078e8-a676-4086-b2f7-873dfc045b7a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:29.834612 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3078e8-a676-4086-b2f7-873dfc045b7a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:29.839516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 661/1300] 10.222.0.110 () {56 vars in 1256 bytes} [Thu May 26 16:32:29 2022] GET /identity/v3/endpoints?service_id=7480b2cd55ff48178ececdef3dcd3cbf&interface=public®ion_id=RegionOne => generated 195 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:29.845173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8815ea-1ff2-454a-ab47-b8036ab7bfaf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:29.925158 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:29.943406 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8815ea-1ff2-454a-ab47-b8036ab7bfaf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:29.975876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57ea87-c165-470d-b339-5699fbfc7bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:29.976533 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57ea87-c165-470d-b339-5699fbfc7bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:29.976820 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57ea87-c165-470d-b339-5699fbfc7bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:29.977095 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57ea87-c165-470d-b339-5699fbfc7bf6 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:29.977763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57ea87-c165-470d-b339-5699fbfc7bf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:29.979151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57ea87-c165-470d-b339-5699fbfc7bf6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:29.986540 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 640/1301] 10.222.0.110 () {56 vars in 1092 bytes} [Thu May 26 16:32:29 2022] GET /identity/v3/services => generated 2201 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:32:32.172085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98268d98-ea27-4ba6-a89d-530900a0654e None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:32.172647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98268d98-ea27-4ba6-a89d-530900a0654e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:32.172647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98268d98-ea27-4ba6-a89d-530900a0654e None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:32.174022 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 662/1302] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:32:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:32.179417 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c030fa-d639-498b-a6ad-6a7dde6020d6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:32.179800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c030fa-d639-498b-a6ad-6a7dde6020d6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:32.179982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c030fa-d639-498b-a6ad-6a7dde6020d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:32.196965 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-56c030fa-d639-498b-a6ad-6a7dde6020d6 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:32.198139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-56c030fa-d639-498b-a6ad-6a7dde6020d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:32.262361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 641/1303] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:32:32 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:32:32.285538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98268d98-ea27-4ba6-a89d-530900a0654e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:32.377801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:32.384976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98268d98-ea27-4ba6-a89d-530900a0654e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:32.417536 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a72da5-5b2d-49f7-baf7-4c9198fe59cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:32.418329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a72da5-5b2d-49f7-baf7-4c9198fe59cb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:32.418647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a72da5-5b2d-49f7-baf7-4c9198fe59cb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:32.418931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a72da5-5b2d-49f7-baf7-4c9198fe59cb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:32.419583 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a72da5-5b2d-49f7-baf7-4c9198fe59cb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:32.420991 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a72da5-5b2d-49f7-baf7-4c9198fe59cb None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:32.432691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-84a72da5-5b2d-49f7-baf7-4c9198fe59cb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:32:32.432691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:32.432691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:32:32.432691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:32:32.432691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:32:32.432691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:32:32.432691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:32:32.432691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:32:32.432691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:32:32.432691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:32.432691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:32:32.432691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:32.432691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:32.432691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:32.432691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:32.432691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:32.432691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:32.433852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:32.433852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:32.433852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:32.433852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:32.433852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:32.433852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:32.433852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:32:32.433852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:32:32.433852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:32:32.433852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:32:32.433852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:32.433852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:32.433852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:32.433852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:32.433852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:32.433852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:32.434912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:32.434912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( May 26 16:32:32.434912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:32.434912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:32.434912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:32.434912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:32.434912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:32.434912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:32.434912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:32.434912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:32.434912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:32:32.434912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:32:32.434912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:32:32.434912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application May 26 16:32:32.434912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 663/1304] 10.222.0.110 () {56 vars in 1122 bytes} [Thu May 26 16:32:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:32.440529 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c030fa-d639-498b-a6ad-6a7dde6020d6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:32.514673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:32.537666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c030fa-d639-498b-a6ad-6a7dde6020d6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:32.571609 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310734f-69c3-46af-827a-7ccc83ef8bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:32.572267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310734f-69c3-46af-827a-7ccc83ef8bad None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:32.572556 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310734f-69c3-46af-827a-7ccc83ef8bad None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:32.572834 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310734f-69c3-46af-827a-7ccc83ef8bad None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:32.573533 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310734f-69c3-46af-827a-7ccc83ef8bad None admin] RBAC: Adding query filter params (name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:32.573841 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310734f-69c3-46af-827a-7ccc83ef8bad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:32.575226 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310734f-69c3-46af-827a-7ccc83ef8bad None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:32.580403 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 642/1305] 10.222.0.110 () {56 vars in 1121 bytes} [Thu May 26 16:32:32 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:32.586105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a72da5-5b2d-49f7-baf7-4c9198fe59cb None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:32.683603 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a72da5-5b2d-49f7-baf7-4c9198fe59cb None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:32.717036 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175bc4b-bf0b-4e24-a4a0-99d1f409b116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:32.718231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175bc4b-bf0b-4e24-a4a0-99d1f409b116 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:32.718516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175bc4b-bf0b-4e24-a4a0-99d1f409b116 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:32.718821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175bc4b-bf0b-4e24-a4a0-99d1f409b116 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:32.719570 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175bc4b-bf0b-4e24-a4a0-99d1f409b116 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:32.720942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175bc4b-bf0b-4e24-a4a0-99d1f409b116 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:32.738836 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 664/1306] 10.222.0.110 () {60 vars in 1149 bytes} [Thu May 26 16:32:32 2022] POST /identity/v3/endpoints => generated 333 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:32:42.577469 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=30 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:42.734305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:36.574240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5660dbe-f67a-49c4-846f-5556208a59e9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:36.575650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5660dbe-f67a-49c4-846f-5556208a59e9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:36.576430 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5660dbe-f67a-49c4-846f-5556208a59e9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:36.588006 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e2b38-7cf1-46a8-b191-598532221014 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:36.589158 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e2b38-7cf1-46a8-b191-598532221014 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:36.590082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e2b38-7cf1-46a8-b191-598532221014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:36.594296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 643/1307] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:33:36 2022] GET /identity => generated 271 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:36.738655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-571e2b38-7cf1-46a8-b191-598532221014 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:36.741028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-571e2b38-7cf1-46a8-b191-598532221014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:36.886691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 665/1308] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:36.934727 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c5b4a-51b6-4ac9-852a-6ccef8e73387 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:36.935102 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c5b4a-51b6-4ac9-852a-6ccef8e73387 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:36.935456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c5b4a-51b6-4ac9-852a-6ccef8e73387 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:36.936968 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 644/1309] 10.222.0.110 () {54 vars in 969 bytes} [Thu May 26 16:33:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:36.942984 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8173f-84d5-4401-860c-dd266a27a3b3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:36.943275 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8173f-84d5-4401-860c-dd266a27a3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:36.943555 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8173f-84d5-4401-860c-dd266a27a3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:37.029297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-65e8173f-84d5-4401-860c-dd266a27a3b3 None None] MFA Rules not processed for user `f2411c1c780449e1a24fecb747cc3761`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:37.030592 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-65e8173f-84d5-4401-860c-dd266a27a3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:37.055867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:37.119912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 666/1310] 10.222.0.110 () {58 vars in 1066 bytes} [Thu May 26 16:33:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:37.129057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c5b4a-51b6-4ac9-852a-6ccef8e73387 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:37.130829 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ab5c5b4a-51b6-4ac9-852a-6ccef8e73387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:37.244019 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c5b4a-51b6-4ac9-852a-6ccef8e73387 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:37.328294 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f365d3-70ca-4d18-ba98-c9af2184dd68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:37.329158 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f365d3-70ca-4d18-ba98-c9af2184dd68 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:37.329437 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f365d3-70ca-4d18-ba98-c9af2184dd68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:37.329705 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f365d3-70ca-4d18-ba98-c9af2184dd68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:37.331358 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-85f365d3-70ca-4d18-ba98-c9af2184dd68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:37.396660 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:37.455645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f365d3-70ca-4d18-ba98-c9af2184dd68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:37.457120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f365d3-70ca-4d18-ba98-c9af2184dd68 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:37.476909 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 645/1311] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:33:39.995380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34c01-452d-4d13-aa53-f3e06eeb7686 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:39.995942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34c01-452d-4d13-aa53-f3e06eeb7686 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:39.995942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34c01-452d-4d13-aa53-f3e06eeb7686 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:39.997347 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 667/1312] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:33:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:40.002662 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eedec-2fd8-4f5c-a1c9-3a2e87cc72b2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:40.003082 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eedec-2fd8-4f5c-a1c9-3a2e87cc72b2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:40.003231 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eedec-2fd8-4f5c-a1c9-3a2e87cc72b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:40.077611 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-003eedec-2fd8-4f5c-a1c9-3a2e87cc72b2 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:40.079536 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-003eedec-2fd8-4f5c-a1c9-3a2e87cc72b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:40.180370 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 646/1313] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:40.218946 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c34c01-452d-4d13-aa53-f3e06eeb7686 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:40.220498 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d7c34c01-452d-4d13-aa53-f3e06eeb7686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:40.331816 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c34c01-452d-4d13-aa53-f3e06eeb7686 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:40.418412 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:40.421484 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37d57f-b2dd-47fc-be0a-ab2f1ce5de57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:40.422153 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37d57f-b2dd-47fc-be0a-ab2f1ce5de57 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:40.422867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37d57f-b2dd-47fc-be0a-ab2f1ce5de57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:40.423509 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37d57f-b2dd-47fc-be0a-ab2f1ce5de57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:40.425605 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ca37d57f-b2dd-47fc-be0a-ab2f1ce5de57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:40.555013 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37d57f-b2dd-47fc-be0a-ab2f1ce5de57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:40.556472 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37d57f-b2dd-47fc-be0a-ab2f1ce5de57 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:40.577505 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 668/1314] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:33:43.142777 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479c20c-bcb5-42df-b819-db7c44aa317f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:43.143325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479c20c-bcb5-42df-b819-db7c44aa317f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:43.143325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479c20c-bcb5-42df-b819-db7c44aa317f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:43.144976 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 647/1315] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:33:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:43.150916 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad493b-d983-4c65-a2c4-ce9304ee77e4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:43.151332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad493b-d983-4c65-a2c4-ce9304ee77e4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:43.151526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad493b-d983-4c65-a2c4-ce9304ee77e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:43.215346 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-96ad493b-d983-4c65-a2c4-ce9304ee77e4 None None] MFA Rules not processed for user `a2fade2221bd4e6ca9ea62551c3c1ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:43.216563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-96ad493b-d983-4c65-a2c4-ce9304ee77e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:43.267541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:43.313297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 669/1316] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:33:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:43.367512 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca46e3-341b-475b-a608-4962d1c74251 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:43.367802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca46e3-341b-475b-a608-4962d1c74251 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:43.368087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca46e3-341b-475b-a608-4962d1c74251 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:43.369484 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 648/1317] 10.222.0.110 () {54 vars in 969 bytes} [Thu May 26 16:33:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:43.376033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71ae39-5bb0-4001-bf6c-a8c6f1650534 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:43.376332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71ae39-5bb0-4001-bf6c-a8c6f1650534 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:43.376619 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71ae39-5bb0-4001-bf6c-a8c6f1650534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:43.449100 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8d71ae39-5bb0-4001-bf6c-a8c6f1650534 None None] MFA Rules not processed for user `f2411c1c780449e1a24fecb747cc3761`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:43.450318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8d71ae39-5bb0-4001-bf6c-a8c6f1650534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:43.526589 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 670/1318] 10.222.0.110 () {58 vars in 1066 bytes} [Thu May 26 16:33:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:43.535521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca46e3-341b-475b-a608-4962d1c74251 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:43.537081 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ffca46e3-341b-475b-a608-4962d1c74251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:43.547324 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:43.643218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca46e3-341b-475b-a608-4962d1c74251 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:43.716755 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e5ab7-d72b-43d9-a6a5-428f7ecaa280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:43.717397 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e5ab7-d72b-43d9-a6a5-428f7ecaa280 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:43.717681 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e5ab7-d72b-43d9-a6a5-428f7ecaa280 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:43.717958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e5ab7-d72b-43d9-a6a5-428f7ecaa280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:43.719595 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6e5e5ab7-d72b-43d9-a6a5-428f7ecaa280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:43.781693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:43.829332 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e5ab7-d72b-43d9-a6a5-428f7ecaa280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:43.830797 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e5ab7-d72b-43d9-a6a5-428f7ecaa280 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:43.848872 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 649/1319] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:33:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:33:46.964737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67118eda-f315-41c0-865d-b5b0bb5ea87f None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:46.965325 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67118eda-f315-41c0-865d-b5b0bb5ea87f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:46.965325 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67118eda-f315-41c0-865d-b5b0bb5ea87f None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:46.967143 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 671/1320] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:33:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:46.972043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73240a7-9a0f-4a29-ad04-29e8e3d14f27 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:46.972471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73240a7-9a0f-4a29-ad04-29e8e3d14f27 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:46.972621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73240a7-9a0f-4a29-ad04-29e8e3d14f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:47.038811 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d73240a7-9a0f-4a29-ad04-29e8e3d14f27 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:47.040030 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d73240a7-9a0f-4a29-ad04-29e8e3d14f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:47.134713 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 650/1321] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:33:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:47.180898 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67118eda-f315-41c0-865d-b5b0bb5ea87f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:47.182435 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-67118eda-f315-41c0-865d-b5b0bb5ea87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:47.233057 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:47.287971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67118eda-f315-41c0-865d-b5b0bb5ea87f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:47.359346 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b469c1-020a-4737-89ed-6be2b3f24942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:47.360001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b469c1-020a-4737-89ed-6be2b3f24942 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:47.360287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b469c1-020a-4737-89ed-6be2b3f24942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:47.360564 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b469c1-020a-4737-89ed-6be2b3f24942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:47.362204 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-80b469c1-020a-4737-89ed-6be2b3f24942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:47.456836 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:47.470161 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b469c1-020a-4737-89ed-6be2b3f24942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:47.471633 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b469c1-020a-4737-89ed-6be2b3f24942 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:47.489513 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 672/1322] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:33:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:33:50.438137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2477e-3845-43fd-8602-0d4199715a83 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:50.438716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2477e-3845-43fd-8602-0d4199715a83 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:50.438831 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2477e-3845-43fd-8602-0d4199715a83 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:50.440124 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 651/1323] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:33:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:50.445664 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22f98-e3af-4633-9342-e60cd7f0fe21 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:50.446120 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22f98-e3af-4633-9342-e60cd7f0fe21 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:50.446220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22f98-e3af-4633-9342-e60cd7f0fe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:50.518351 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-47e22f98-e3af-4633-9342-e60cd7f0fe21 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:50.519676 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-47e22f98-e3af-4633-9342-e60cd7f0fe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:50.619557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 673/1324] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:50.656343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2477e-3845-43fd-8602-0d4199715a83 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:50.658006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-43f2477e-3845-43fd-8602-0d4199715a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:50.677883 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:50.763772 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2477e-3845-43fd-8602-0d4199715a83 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:50.837134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445596c-650d-4e36-b1c7-f2b0e7fc1439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:50.837810 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445596c-650d-4e36-b1c7-f2b0e7fc1439 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:50.838090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445596c-650d-4e36-b1c7-f2b0e7fc1439 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:50.838362 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445596c-650d-4e36-b1c7-f2b0e7fc1439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:50.840007 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c445596c-650d-4e36-b1c7-f2b0e7fc1439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:50.916980 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:50.954586 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445596c-650d-4e36-b1c7-f2b0e7fc1439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:50.956021 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445596c-650d-4e36-b1c7-f2b0e7fc1439 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:50.974968 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 652/1325] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:33:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:33:53.238154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce5d13-eb04-494e-9686-90f6156d7595 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:53.238745 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce5d13-eb04-494e-9686-90f6156d7595 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:53.238842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce5d13-eb04-494e-9686-90f6156d7595 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:53.240713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 674/1326] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:33:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:53.245951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8ae52-6ecd-45d2-b515-752b34206db0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:53.246350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8ae52-6ecd-45d2-b515-752b34206db0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:53.246519 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8ae52-6ecd-45d2-b515-752b34206db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:53.310846 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f2f8ae52-6ecd-45d2-b515-752b34206db0 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:53.312106 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f2f8ae52-6ecd-45d2-b515-752b34206db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:53.411396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 653/1327] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:53.447311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce5d13-eb04-494e-9686-90f6156d7595 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:53.448949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cbce5d13-eb04-494e-9686-90f6156d7595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:53.511589 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:53.555330 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce5d13-eb04-494e-9686-90f6156d7595 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:53.626937 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b9db6-2df8-4ceb-910c-22853ec6401f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:53.627678 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b9db6-2df8-4ceb-910c-22853ec6401f service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:53.628010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b9db6-2df8-4ceb-910c-22853ec6401f service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:53.628315 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b9db6-2df8-4ceb-910c-22853ec6401f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:53.629933 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4d1b9db6-2df8-4ceb-910c-22853ec6401f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:53.737933 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:53.740619 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b9db6-2df8-4ceb-910c-22853ec6401f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:53.742891 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b9db6-2df8-4ceb-910c-22853ec6401f service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:53.761508 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 675/1328] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:33:56.056480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757af45-b655-45e4-b2bf-d28d61d4c77d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:56.057053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757af45-b655-45e4-b2bf-d28d61d4c77d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:56.057053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757af45-b655-45e4-b2bf-d28d61d4c77d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:56.058456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 654/1329] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:33:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:56.063764 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc5e68-3213-4dc6-8cdc-aa9522e79e46 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:56.064207 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc5e68-3213-4dc6-8cdc-aa9522e79e46 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:56.064341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc5e68-3213-4dc6-8cdc-aa9522e79e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:56.133259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4ecc5e68-3213-4dc6-8cdc-aa9522e79e46 None None] MFA Rules not processed for user `a2fade2221bd4e6ca9ea62551c3c1ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:56.134473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4ecc5e68-3213-4dc6-8cdc-aa9522e79e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:56.235511 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 676/1330] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:33:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:56.273399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757af45-b655-45e4-b2bf-d28d61d4c77d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:56.275100 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0757af45-b655-45e4-b2bf-d28d61d4c77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:56.308350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:56.386710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757af45-b655-45e4-b2bf-d28d61d4c77d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:56.460578 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80043aa-c0fa-4d50-af7a-f98cae48b823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:56.461237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80043aa-c0fa-4d50-af7a-f98cae48b823 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:56.461527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80043aa-c0fa-4d50-af7a-f98cae48b823 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:56.461808 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80043aa-c0fa-4d50-af7a-f98cae48b823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:56.463490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e80043aa-c0fa-4d50-af7a-f98cae48b823 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:56.542624 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:56.574742 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80043aa-c0fa-4d50-af7a-f98cae48b823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:56.576103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80043aa-c0fa-4d50-af7a-f98cae48b823 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:56.594547 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 655/1331] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:33:56 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:33:59.061519 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a25ba-c720-4bd8-9398-e0cad5ca6b56 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:59.062021 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a25ba-c720-4bd8-9398-e0cad5ca6b56 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:59.062021 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a25ba-c720-4bd8-9398-e0cad5ca6b56 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:59.063433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 677/1332] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:33:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:59.069306 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c65b5-079c-4063-b861-6fb78df38e54 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:59.069693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c65b5-079c-4063-b861-6fb78df38e54 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:59.069853 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c65b5-079c-4063-b861-6fb78df38e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:59.136052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-819c65b5-079c-4063-b861-6fb78df38e54 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:59.137251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-819c65b5-079c-4063-b861-6fb78df38e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:59.234189 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 656/1333] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:59.272203 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a25ba-c720-4bd8-9398-e0cad5ca6b56 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:59.273769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-039a25ba-c720-4bd8-9398-e0cad5ca6b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:59.346853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:59.385078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a25ba-c720-4bd8-9398-e0cad5ca6b56 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:59.463401 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab63f4-722e-4753-bd2a-72a2e26a06c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:59.464059 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab63f4-722e-4753-bd2a-72a2e26a06c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:59.464346 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab63f4-722e-4753-bd2a-72a2e26a06c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:59.464622 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab63f4-722e-4753-bd2a-72a2e26a06c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:59.466274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-77ab63f4-722e-4753-bd2a-72a2e26a06c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:59.581971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab63f4-722e-4753-bd2a-72a2e26a06c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:59.583943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab63f4-722e-4753-bd2a-72a2e26a06c3 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:59.594220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:59.603850 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 678/1334] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:01.875129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67993557-db2c-45e0-8d56-41c8fae0e5e0 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:01.875702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67993557-db2c-45e0-8d56-41c8fae0e5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:01.875702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67993557-db2c-45e0-8d56-41c8fae0e5e0 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:01.877116 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 657/1335] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:34:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:01.882826 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75869ea-c83e-41bc-b2a0-5759a0e4174d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:01.883238 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75869ea-c83e-41bc-b2a0-5759a0e4174d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:01.883389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75869ea-c83e-41bc-b2a0-5759a0e4174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:01.947306 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f75869ea-c83e-41bc-b2a0-5759a0e4174d None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:01.948436 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f75869ea-c83e-41bc-b2a0-5759a0e4174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:02.044949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 679/1336] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:02.086640 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67993557-db2c-45e0-8d56-41c8fae0e5e0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:02.088219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-67993557-db2c-45e0-8d56-41c8fae0e5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:02.129015 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:02.193533 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67993557-db2c-45e0-8d56-41c8fae0e5e0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:02.266859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5984df3-25d8-45a3-8e85-9dcc38a9367f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:02.267518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5984df3-25d8-45a3-8e85-9dcc38a9367f service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:02.267804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5984df3-25d8-45a3-8e85-9dcc38a9367f service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:02.268080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5984df3-25d8-45a3-8e85-9dcc38a9367f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:02.269828 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b5984df3-25d8-45a3-8e85-9dcc38a9367f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:02.356889 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:02.384859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5984df3-25d8-45a3-8e85-9dcc38a9367f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:02.386313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5984df3-25d8-45a3-8e85-9dcc38a9367f service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:02.407347 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 658/1337] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:04.935589 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49af27d-36e9-4ab6-93ba-c64e5650b66b None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:04.936146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49af27d-36e9-4ab6-93ba-c64e5650b66b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:04.936146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49af27d-36e9-4ab6-93ba-c64e5650b66b None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:04.937573 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 680/1338] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:34:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:04.943537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651ba46-996b-4561-8453-87d5dc08440a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:04.943933 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651ba46-996b-4561-8453-87d5dc08440a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:04.944120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651ba46-996b-4561-8453-87d5dc08440a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:05.006987 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0651ba46-996b-4561-8453-87d5dc08440a None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:05.008180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0651ba46-996b-4561-8453-87d5dc08440a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:05.104058 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 659/1339] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:34:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:05.140106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49af27d-36e9-4ab6-93ba-c64e5650b66b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:05.141639 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d49af27d-36e9-4ab6-93ba-c64e5650b66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:05.218798 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:05.247711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49af27d-36e9-4ab6-93ba-c64e5650b66b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:05.320059 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ba14f-1ae6-4511-b9d7-ee67907bceab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:05.320710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ba14f-1ae6-4511-b9d7-ee67907bceab service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:05.320999 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ba14f-1ae6-4511-b9d7-ee67907bceab service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:05.321280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ba14f-1ae6-4511-b9d7-ee67907bceab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:05.322952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ba4ba14f-1ae6-4511-b9d7-ee67907bceab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:05.433428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ba14f-1ae6-4511-b9d7-ee67907bceab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:05.434888 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ba14f-1ae6-4511-b9d7-ee67907bceab service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:05.453095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 681/1340] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:34:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:09.633123 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e079fe3-90c0-4275-aa9e-3ab083af6b34 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:09.633689 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e079fe3-90c0-4275-aa9e-3ab083af6b34 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:09.633689 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e079fe3-90c0-4275-aa9e-3ab083af6b34 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:09.635005 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 660/1341] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:34:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:09.640227 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b99afa-14de-4eb5-8a55-7f3b81c901fc None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:09.640655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b99afa-14de-4eb5-8a55-7f3b81c901fc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:09.640788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b99afa-14de-4eb5-8a55-7f3b81c901fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:09.647150 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:09.718044 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f4b99afa-14de-4eb5-8a55-7f3b81c901fc None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:09.719320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f4b99afa-14de-4eb5-8a55-7f3b81c901fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:09.827010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 682/1342] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:09.866225 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e079fe3-90c0-4275-aa9e-3ab083af6b34 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:09.868488 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1e079fe3-90c0-4275-aa9e-3ab083af6b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:09.917866 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:09.964211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e079fe3-90c0-4275-aa9e-3ab083af6b34 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:09.967839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e76d1-bfbb-41b6-bf4a-8ede224ec3db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:09.968486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e76d1-bfbb-41b6-bf4a-8ede224ec3db service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:09.968769 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e76d1-bfbb-41b6-bf4a-8ede224ec3db service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:09.969043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e76d1-bfbb-41b6-bf4a-8ede224ec3db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:09.978219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e76d1-bfbb-41b6-bf4a-8ede224ec3db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:09.979935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e76d1-bfbb-41b6-bf4a-8ede224ec3db service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:09.989664 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 661/1343] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:34:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:13.003645 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aefec-fc8a-4129-be88-8de4d2de3ecc None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:13.004353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aefec-fc8a-4129-be88-8de4d2de3ecc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:13.004353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aefec-fc8a-4129-be88-8de4d2de3ecc None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:13.005495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 683/1344] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:34:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:13.010810 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9e660-6668-4c15-9814-852f24265164 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:13.011261 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9e660-6668-4c15-9814-852f24265164 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:13.011481 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9e660-6668-4c15-9814-852f24265164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:13.040337 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1cf9e660-6668-4c15-9814-852f24265164 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:13.041542 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1cf9e660-6668-4c15-9814-852f24265164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:13.118968 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 662/1345] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:34:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:34:13.156459 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61aefec-fc8a-4129-be88-8de4d2de3ecc None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:13.171429 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61aefec-fc8a-4129-be88-8de4d2de3ecc None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:13.175789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f5e20-ff7b-4b52-b87e-63c2e24ba140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:13.176491 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f5e20-ff7b-4b52-b87e-63c2e24ba140 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:13.176858 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f5e20-ff7b-4b52-b87e-63c2e24ba140 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:13.177159 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f5e20-ff7b-4b52-b87e-63c2e24ba140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:13.188221 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f5e20-ff7b-4b52-b87e-63c2e24ba140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:13.190069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f5e20-ff7b-4b52-b87e-63c2e24ba140 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:13.203064 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 684/1346] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:34:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:17.582971 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97622ec1-5658-4bc3-a3f6-7141c0f96a7d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:17.583503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97622ec1-5658-4bc3-a3f6-7141c0f96a7d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:17.583503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97622ec1-5658-4bc3-a3f6-7141c0f96a7d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:17.584836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 663/1347] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:34:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:17.590000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b58f95-db3e-4e98-a2d2-1d3c84aa52bc None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:17.590425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b58f95-db3e-4e98-a2d2-1d3c84aa52bc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:17.590563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b58f95-db3e-4e98-a2d2-1d3c84aa52bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:17.608591 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d8b58f95-db3e-4e98-a2d2-1d3c84aa52bc None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:17.609784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d8b58f95-db3e-4e98-a2d2-1d3c84aa52bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:17.617775 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 685/1348] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:17.655373 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97622ec1-5658-4bc3-a3f6-7141c0f96a7d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:17.666052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97622ec1-5658-4bc3-a3f6-7141c0f96a7d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:17.669629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b90b6-727f-48c9-92a2-faa0e814f831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:17.670275 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b90b6-727f-48c9-92a2-faa0e814f831 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:17.670561 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b90b6-727f-48c9-92a2-faa0e814f831 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:17.670867 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b90b6-727f-48c9-92a2-faa0e814f831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:17.680078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b90b6-727f-48c9-92a2-faa0e814f831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:17.681505 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b90b6-727f-48c9-92a2-faa0e814f831 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:17.691498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 664/1349] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:34:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:22.995954 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2182c-763f-4506-8ae4-9df90637cfee None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:22.996451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2182c-763f-4506-8ae4-9df90637cfee None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:23.003050 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2182c-763f-4506-8ae4-9df90637cfee None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:23.004971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 686/1350] 10.222.0.110 () {54 vars in 926 bytes} [Thu May 26 16:34:22 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:23.016619 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48d0e9-122b-445e-9b1a-04f57cb0b2b9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:23.017073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48d0e9-122b-445e-9b1a-04f57cb0b2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:23.017470 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48d0e9-122b-445e-9b1a-04f57cb0b2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:23.096539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9a48d0e9-122b-445e-9b1a-04f57cb0b2b9 None None] MFA Rules not processed for user `9ffef7640dd1487ab2ea91fc0f4be9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:23.097978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9a48d0e9-122b-445e-9b1a-04f57cb0b2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:23.126856 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:23.188742 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 665/1351] 10.222.0.110 () {58 vars in 1023 bytes} [Thu May 26 16:34:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:27.505587 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff548e-a941-4765-8e2f-2c2cfe46be63 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:27.506541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff548e-a941-4765-8e2f-2c2cfe46be63 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:27.506855 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff548e-a941-4765-8e2f-2c2cfe46be63 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:27.508442 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 687/1352] 10.222.0.110 () {54 vars in 926 bytes} [Thu May 26 16:34:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:27.518130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260b32c-5b42-4331-813d-3a27305d5f6b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:27.518705 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260b32c-5b42-4331-813d-3a27305d5f6b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:27.518705 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260b32c-5b42-4331-813d-3a27305d5f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:27.540004 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d260b32c-5b42-4331-813d-3a27305d5f6b None None] MFA Rules not processed for user `9ffef7640dd1487ab2ea91fc0f4be9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:27.541211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d260b32c-5b42-4331-813d-3a27305d5f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:27.550825 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 666/1353] 10.222.0.110 () {58 vars in 1023 bytes} [Thu May 26 16:34:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:27.603567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=72 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:29.061882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ed49a-b0bc-4373-93f4-0b3817329c0e None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:29.062512 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ed49a-b0bc-4373-93f4-0b3817329c0e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:29.062512 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ed49a-b0bc-4373-93f4-0b3817329c0e None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:29.063870 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 688/1354] 10.222.0.110 () {54 vars in 926 bytes} [Thu May 26 16:34:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:29.069338 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e1999-6fd5-4c23-a6d7-11a18ea4844f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:29.069734 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e1999-6fd5-4c23-a6d7-11a18ea4844f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:29.069901 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e1999-6fd5-4c23-a6d7-11a18ea4844f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:29.088644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-392e1999-6fd5-4c23-a6d7-11a18ea4844f None None] MFA Rules not processed for user `9ffef7640dd1487ab2ea91fc0f4be9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:29.089854 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-392e1999-6fd5-4c23-a6d7-11a18ea4844f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:29.098336 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 667/1355] 10.222.0.110 () {58 vars in 1023 bytes} [Thu May 26 16:34:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:33.167006 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63998b-de4f-43d0-b7e7-e3294e732afc None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:33.167871 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63998b-de4f-43d0-b7e7-e3294e732afc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:33.168205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63998b-de4f-43d0-b7e7-e3294e732afc None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:33.169863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 689/1356] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:34:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:33.175915 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4cae8-fa14-4337-9524-23dd2c792a63 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:33.176381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4cae8-fa14-4337-9524-23dd2c792a63 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:33.176466 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4cae8-fa14-4337-9524-23dd2c792a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:33.194266 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-15c4cae8-fa14-4337-9524-23dd2c792a63 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:33.195493 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-15c4cae8-fa14-4337-9524-23dd2c792a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:33.203449 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 668/1357] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:33.264555 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1433ec-dc03-4240-917b-b9fe7129c905 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:33.265204 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1433ec-dc03-4240-917b-b9fe7129c905 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:33.265810 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1433ec-dc03-4240-917b-b9fe7129c905 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:33.268841 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 690/1358] 10.222.0.110 () {54 vars in 966 bytes} [Thu May 26 16:34:33 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:33.279301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c6983-17cb-44f2-9eb3-fe8af37d8e85 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:33.279979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c6983-17cb-44f2-9eb3-fe8af37d8e85 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:33.280473 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c6983-17cb-44f2-9eb3-fe8af37d8e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:33.333303 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4a0c6983-17cb-44f2-9eb3-fe8af37d8e85 None None] MFA Rules not processed for user `0043a7d5877f41de905afe6bef355867`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:33.334517 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4a0c6983-17cb-44f2-9eb3-fe8af37d8e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:33.426018 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 669/1359] 10.222.0.110 () {58 vars in 1063 bytes} [Thu May 26 16:34:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:33.433671 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1433ec-dc03-4240-917b-b9fe7129c905 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:33.448632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1433ec-dc03-4240-917b-b9fe7129c905 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:33.454438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a2816-0c69-4ecb-a1d3-abcdd00be5e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:33.455199 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a2816-0c69-4ecb-a1d3-abcdd00be5e5 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:33.455581 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a2816-0c69-4ecb-a1d3-abcdd00be5e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:33.456029 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a2816-0c69-4ecb-a1d3-abcdd00be5e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:33.464986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a2816-0c69-4ecb-a1d3-abcdd00be5e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:33.466769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a2816-0c69-4ecb-a1d3-abcdd00be5e5 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:33.477163 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 691/1360] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:34:35.934080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09868e0c-23b1-4761-b40a-ccb40c2b67dd None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:35.934636 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09868e0c-23b1-4761-b40a-ccb40c2b67dd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:35.934636 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09868e0c-23b1-4761-b40a-ccb40c2b67dd None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:35.936033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 670/1361] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:34:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:35.941990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dfb41-d89d-4198-8ca9-40a137cc9fff None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:35.942784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dfb41-d89d-4198-8ca9-40a137cc9fff None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:35.943071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dfb41-d89d-4198-8ca9-40a137cc9fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:35.961720 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e96dfb41-d89d-4198-8ca9-40a137cc9fff None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:35.962945 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e96dfb41-d89d-4198-8ca9-40a137cc9fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:35.971522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 692/1362] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:36.017444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09868e0c-23b1-4761-b40a-ccb40c2b67dd None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:36.032983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09868e0c-23b1-4761-b40a-ccb40c2b67dd None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:36.038965 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ed589-371e-457b-abee-ca95c6ba873b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:36.039637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ed589-371e-457b-abee-ca95c6ba873b service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:36.039912 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ed589-371e-457b-abee-ca95c6ba873b service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:36.040188 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ed589-371e-457b-abee-ca95c6ba873b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:36.049628 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ed589-371e-457b-abee-ca95c6ba873b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:36.051268 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ed589-371e-457b-abee-ca95c6ba873b service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:36.061415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 671/1363] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:34:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:34:38.643400 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f8b64-eceb-4b0e-817a-43eb10c1c0fb None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:38.643938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f8b64-eceb-4b0e-817a-43eb10c1c0fb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:38.643938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f8b64-eceb-4b0e-817a-43eb10c1c0fb None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:38.645348 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 693/1364] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:34:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:38.650765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727bec0-e3dd-432b-a82c-5c3d6248e25a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:38.651206 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727bec0-e3dd-432b-a82c-5c3d6248e25a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:38.651336 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727bec0-e3dd-432b-a82c-5c3d6248e25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:38.686460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f727bec0-e3dd-432b-a82c-5c3d6248e25a None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:38.686460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f727bec0-e3dd-432b-a82c-5c3d6248e25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:38.712044 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 672/1365] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:38.746261 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851dd53-c85f-48ac-8d2e-3d11483a3c80 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:38.746488 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851dd53-c85f-48ac-8d2e-3d11483a3c80 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:38.746806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851dd53-c85f-48ac-8d2e-3d11483a3c80 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:38.748213 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 694/1366] 10.222.0.110 () {54 vars in 966 bytes} [Thu May 26 16:34:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:38.754255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdcda8-0e71-45b4-bacb-f628899882fa None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:38.754664 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdcda8-0e71-45b4-bacb-f628899882fa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:38.755016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdcda8-0e71-45b4-bacb-f628899882fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:38.773251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5cbdcda8-0e71-45b4-bacb-f628899882fa None None] MFA Rules not processed for user `0043a7d5877f41de905afe6bef355867`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:38.774431 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5cbdcda8-0e71-45b4-bacb-f628899882fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:38.784269 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 673/1367] 10.222.0.110 () {58 vars in 1063 bytes} [Thu May 26 16:34:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:38.792070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851dd53-c85f-48ac-8d2e-3d11483a3c80 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:38.806542 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851dd53-c85f-48ac-8d2e-3d11483a3c80 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:38.811934 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a8f1e-c9d6-4adf-8e4f-21a93712938e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:38.812651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a8f1e-c9d6-4adf-8e4f-21a93712938e service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:38.813489 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a8f1e-c9d6-4adf-8e4f-21a93712938e service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:38.813848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a8f1e-c9d6-4adf-8e4f-21a93712938e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:38.821925 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a8f1e-c9d6-4adf-8e4f-21a93712938e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:38.823524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a8f1e-c9d6-4adf-8e4f-21a93712938e service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:38.833298 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 695/1368] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:41.117459 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e6e45-08d7-4e23-b1c8-ef4581ca8c36 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:41.118013 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e6e45-08d7-4e23-b1c8-ef4581ca8c36 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:41.118013 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e6e45-08d7-4e23-b1c8-ef4581ca8c36 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:41.119934 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 674/1369] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:34:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:41.126232 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1cf1b-9c6d-4d8c-9405-82007b514934 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:41.126737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1cf1b-9c6d-4d8c-9405-82007b514934 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:41.126840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1cf1b-9c6d-4d8c-9405-82007b514934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:41.145508 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d5d1cf1b-9c6d-4d8c-9405-82007b514934 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:41.146758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d5d1cf1b-9c6d-4d8c-9405-82007b514934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:41.157022 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 696/1370] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:41.201346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e6e45-08d7-4e23-b1c8-ef4581ca8c36 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:41.216803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e6e45-08d7-4e23-b1c8-ef4581ca8c36 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:41.222860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfd2ca-f565-47ed-8df5-5850a239509e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:41.223537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfd2ca-f565-47ed-8df5-5850a239509e service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:41.223826 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfd2ca-f565-47ed-8df5-5850a239509e service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:41.224106 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfd2ca-f565-47ed-8df5-5850a239509e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:41.233901 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfd2ca-f565-47ed-8df5-5850a239509e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:41.236456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfd2ca-f565-47ed-8df5-5850a239509e service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:41.248460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 675/1371] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:41.430912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e39bb5-4128-45a9-b91c-15835d05784e None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:41.431210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e39bb5-4128-45a9-b91c-15835d05784e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:41.431689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e39bb5-4128-45a9-b91c-15835d05784e None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:41.433156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 697/1372] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:34:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:41.439922 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a5cfb-875a-441e-bbe1-0ce7a3d327ec None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:41.440523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a5cfb-875a-441e-bbe1-0ce7a3d327ec None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:41.440975 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a5cfb-875a-441e-bbe1-0ce7a3d327ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:41.461937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-aa9a5cfb-875a-441e-bbe1-0ce7a3d327ec None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:41.463501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aa9a5cfb-875a-441e-bbe1-0ce7a3d327ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:41.472005 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 676/1373] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:34:41.798702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64e25f-f69f-40ca-92b4-149ddf074e6c None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:41.799122 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64e25f-f69f-40ca-92b4-149ddf074e6c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:41.799500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64e25f-f69f-40ca-92b4-149ddf074e6c None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:41.801163 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 698/1374] 10.222.0.110 () {54 vars in 968 bytes} [Thu May 26 16:34:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:41.807499 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c3f67-4ce3-4a6f-a278-4d03700235a3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:41.807912 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c3f67-4ce3-4a6f-a278-4d03700235a3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:41.808294 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c3f67-4ce3-4a6f-a278-4d03700235a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:41.815523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:41.861033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c85c3f67-4ce3-4a6f-a278-4d03700235a3 None None] MFA Rules not processed for user `7ac42de1401441c0a3d4e7239e9b020e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:41.862445 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c85c3f67-4ce3-4a6f-a278-4d03700235a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:41.924572 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 677/1375] 10.222.0.110 () {58 vars in 1065 bytes} [Thu May 26 16:34:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:41.932004 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64e25f-f69f-40ca-92b4-149ddf074e6c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:41.943315 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64e25f-f69f-40ca-92b4-149ddf074e6c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:41.947040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e907e-98d3-48e6-bc5b-4dd96c0e798e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:41.947748 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e907e-98d3-48e6-bc5b-4dd96c0e798e service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:41.948101 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e907e-98d3-48e6-bc5b-4dd96c0e798e service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:41.948448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e907e-98d3-48e6-bc5b-4dd96c0e798e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:41.959412 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e907e-98d3-48e6-bc5b-4dd96c0e798e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:41.960090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e907e-98d3-48e6-bc5b-4dd96c0e798e service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:41.970953 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 699/1376] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:43.546743 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650e1eb-b762-4a13-8b1b-ec7f78dd186d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:43.547272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650e1eb-b762-4a13-8b1b-ec7f78dd186d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:43.547595 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650e1eb-b762-4a13-8b1b-ec7f78dd186d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:43.549442 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 678/1377] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:34:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:43.555549 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc6d49-2db2-450c-81da-a8d54f8a3c17 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:43.556127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc6d49-2db2-450c-81da-a8d54f8a3c17 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:43.556127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc6d49-2db2-450c-81da-a8d54f8a3c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:43.575465 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a3dc6d49-2db2-450c-81da-a8d54f8a3c17 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:43.576713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a3dc6d49-2db2-450c-81da-a8d54f8a3c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:43.585347 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 700/1378] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:43.634308 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650e1eb-b762-4a13-8b1b-ec7f78dd186d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:43.649133 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650e1eb-b762-4a13-8b1b-ec7f78dd186d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:43.654799 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0de06-8b70-4c74-8e23-d080b00d2e40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:43.655468 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0de06-8b70-4c74-8e23-d080b00d2e40 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:43.655755 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0de06-8b70-4c74-8e23-d080b00d2e40 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:43.656169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0de06-8b70-4c74-8e23-d080b00d2e40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:43.665514 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0de06-8b70-4c74-8e23-d080b00d2e40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:43.667281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0de06-8b70-4c74-8e23-d080b00d2e40 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:43.678809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 679/1379] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:45.943121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d1bd8-2d7d-4763-bec4-ac840059a80f None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:45.943670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d1bd8-2d7d-4763-bec4-ac840059a80f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:45.943963 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d1bd8-2d7d-4763-bec4-ac840059a80f None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:45.945478 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 701/1380] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:34:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:45.950922 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fb79c-6c4b-4a72-b424-5116b9238393 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:45.951706 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fb79c-6c4b-4a72-b424-5116b9238393 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:45.951987 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fb79c-6c4b-4a72-b424-5116b9238393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:45.971472 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-194fb79c-6c4b-4a72-b424-5116b9238393 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:45.972672 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-194fb79c-6c4b-4a72-b424-5116b9238393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:45.980975 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 680/1381] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:46.025019 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d1bd8-2d7d-4763-bec4-ac840059a80f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:46.041493 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d1bd8-2d7d-4763-bec4-ac840059a80f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:46.047634 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0f4cf-5dc1-46a9-8ed0-852000cf2229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:46.048484 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0f4cf-5dc1-46a9-8ed0-852000cf2229 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:46.048902 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0f4cf-5dc1-46a9-8ed0-852000cf2229 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:46.049277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0f4cf-5dc1-46a9-8ed0-852000cf2229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:46.058966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0f4cf-5dc1-46a9-8ed0-852000cf2229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:46.060992 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0f4cf-5dc1-46a9-8ed0-852000cf2229 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:46.072741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 702/1382] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:34:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:48.317896 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa3be9-4318-47ab-ac71-75c73e1cd03a None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:48.318420 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa3be9-4318-47ab-ac71-75c73e1cd03a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:48.318420 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa3be9-4318-47ab-ac71-75c73e1cd03a None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:48.319748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 681/1383] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:34:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:48.324904 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727dab6-8e34-4852-8a8f-8f62da8ab225 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:48.325325 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727dab6-8e34-4852-8a8f-8f62da8ab225 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:48.325462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727dab6-8e34-4852-8a8f-8f62da8ab225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:48.345102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d727dab6-8e34-4852-8a8f-8f62da8ab225 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:48.346449 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d727dab6-8e34-4852-8a8f-8f62da8ab225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:48.355601 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 703/1384] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:48.396675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa3be9-4318-47ab-ac71-75c73e1cd03a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:48.411785 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa3be9-4318-47ab-ac71-75c73e1cd03a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:48.418170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338cc5a-c758-4ab3-b7b5-75ee044adc1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:48.419116 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338cc5a-c758-4ab3-b7b5-75ee044adc1a service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:48.419628 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338cc5a-c758-4ab3-b7b5-75ee044adc1a service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:48.420109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338cc5a-c758-4ab3-b7b5-75ee044adc1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:48.429336 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338cc5a-c758-4ab3-b7b5-75ee044adc1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:48.431198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338cc5a-c758-4ab3-b7b5-75ee044adc1a service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:48.441696 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 682/1385] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:34:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:50.663902 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ab0ce-029e-4e05-a818-4b7741491880 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:50.664564 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ab0ce-029e-4e05-a818-4b7741491880 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:50.664564 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ab0ce-029e-4e05-a818-4b7741491880 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:50.666449 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 704/1386] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:34:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:50.672305 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa5e63-ebda-44b8-9a9e-9ae45c401810 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:50.673202 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa5e63-ebda-44b8-9a9e-9ae45c401810 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:50.673546 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa5e63-ebda-44b8-9a9e-9ae45c401810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:50.700973 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-47aa5e63-ebda-44b8-9a9e-9ae45c401810 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:50.702314 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-47aa5e63-ebda-44b8-9a9e-9ae45c401810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:50.710637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 683/1387] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:50.754471 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ab0ce-029e-4e05-a818-4b7741491880 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:50.769724 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ab0ce-029e-4e05-a818-4b7741491880 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:50.775534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db6ad4-9f94-4132-bc96-98a8d1bfc9ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:50.776185 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db6ad4-9f94-4132-bc96-98a8d1bfc9ec service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:50.776477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db6ad4-9f94-4132-bc96-98a8d1bfc9ec service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:50.776764 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db6ad4-9f94-4132-bc96-98a8d1bfc9ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:50.786438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db6ad4-9f94-4132-bc96-98a8d1bfc9ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:50.788070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db6ad4-9f94-4132-bc96-98a8d1bfc9ec service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:50.803536 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 705/1388] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:53.103804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ab0f1-2b5e-437a-8080-20db1f4bbd08 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:53.104365 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ab0f1-2b5e-437a-8080-20db1f4bbd08 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:53.104856 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ab0f1-2b5e-437a-8080-20db1f4bbd08 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:53.107072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 684/1389] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:34:53 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:53.112373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b29a3-e352-4086-bea2-6246465db3fa None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:53.112807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b29a3-e352-4086-bea2-6246465db3fa None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:53.112937 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b29a3-e352-4086-bea2-6246465db3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:53.131083 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-192b29a3-e352-4086-bea2-6246465db3fa None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:53.132285 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-192b29a3-e352-4086-bea2-6246465db3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:53.141051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 706/1390] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:53.185685 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ab0f1-2b5e-437a-8080-20db1f4bbd08 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:53.204824 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ab0f1-2b5e-437a-8080-20db1f4bbd08 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:53.211535 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1f89d-74a8-4cb9-8ef1-4a59460f2998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:53.212356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1f89d-74a8-4cb9-8ef1-4a59460f2998 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:53.212992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1f89d-74a8-4cb9-8ef1-4a59460f2998 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:53.213344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1f89d-74a8-4cb9-8ef1-4a59460f2998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:53.228129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1f89d-74a8-4cb9-8ef1-4a59460f2998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:53.230935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1f89d-74a8-4cb9-8ef1-4a59460f2998 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:53.245994 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 685/1391] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:55.494681 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5def2d-2416-40e9-b44e-7ff7be2899d6 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:55.495338 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5def2d-2416-40e9-b44e-7ff7be2899d6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:55.495690 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5def2d-2416-40e9-b44e-7ff7be2899d6 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:55.498345 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 707/1392] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:34:55 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:55.503790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c55d2a-6819-449c-af91-e7472ab755de None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:55.504222 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c55d2a-6819-449c-af91-e7472ab755de None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:55.504359 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c55d2a-6819-449c-af91-e7472ab755de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:55.523364 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-64c55d2a-6819-449c-af91-e7472ab755de None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:55.524558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-64c55d2a-6819-449c-af91-e7472ab755de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:55.533109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 686/1393] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:34:55.578343 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5def2d-2416-40e9-b44e-7ff7be2899d6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:55.592764 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5def2d-2416-40e9-b44e-7ff7be2899d6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:55.598352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68210a-ad33-4bf4-b821-e6d3539136eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:55.599032 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68210a-ad33-4bf4-b821-e6d3539136eb service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:55.599325 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68210a-ad33-4bf4-b821-e6d3539136eb service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:55.599606 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68210a-ad33-4bf4-b821-e6d3539136eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:55.608942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68210a-ad33-4bf4-b821-e6d3539136eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:55.610534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68210a-ad33-4bf4-b821-e6d3539136eb service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:55.622763 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 708/1394] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:57.718221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c564824-05e8-43c3-8ac9-d95b13cc2728 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:57.718824 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c564824-05e8-43c3-8ac9-d95b13cc2728 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:57.718824 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c564824-05e8-43c3-8ac9-d95b13cc2728 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:57.720139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 687/1395] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:34:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:57.725494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907729d7-832e-4885-b914-92550a1c1338 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:57.725940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907729d7-832e-4885-b914-92550a1c1338 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:57.726316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907729d7-832e-4885-b914-92550a1c1338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:57.732352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=52 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:57.746136 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-907729d7-832e-4885-b914-92550a1c1338 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:57.747370 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-907729d7-832e-4885-b914-92550a1c1338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:57.755305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 709/1396] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:57.812061 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a070bbe-1a8a-47a2-b13a-28811b919b07 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:57.812356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a070bbe-1a8a-47a2-b13a-28811b919b07 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:57.812639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a070bbe-1a8a-47a2-b13a-28811b919b07 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:57.814025 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 688/1397] 10.222.0.110 () {54 vars in 967 bytes} [Thu May 26 16:34:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:57.819234 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a0ed0-e3c1-4edd-a4ed-90d57abd439f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:57.819527 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a0ed0-e3c1-4edd-a4ed-90d57abd439f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:57.819806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a0ed0-e3c1-4edd-a4ed-90d57abd439f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:57.848311 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6ff84-2edc-4a01-9103-aed738b0e058 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:57.848607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6ff84-2edc-4a01-9103-aed738b0e058 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:57.848890 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6ff84-2edc-4a01-9103-aed738b0e058 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:57.850266 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 689/1398] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:34:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:34:57.855612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf55527-b30d-410b-8529-52c2182c29e0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:57.855896 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf55527-b30d-410b-8529-52c2182c29e0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:57.856171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf55527-b30d-410b-8529-52c2182c29e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:57.871358 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ae8a0ed0-e3c1-4edd-a4ed-90d57abd439f None None] MFA Rules not processed for user `363d16eebb3f40a1be71506961cc3c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:57.872555 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ae8a0ed0-e3c1-4edd-a4ed-90d57abd439f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:57.873846 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cdf55527-b30d-410b-8529-52c2182c29e0 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:57.875056 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cdf55527-b30d-410b-8529-52c2182c29e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:57.883268 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 690/1399] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:34:57.928438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf55527-b30d-410b-8529-52c2182c29e0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:57.933386 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 710/1400] 10.222.0.110 () {58 vars in 1064 bytes} [Thu May 26 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:57.940987 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf55527-b30d-410b-8529-52c2182c29e0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:57.941154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a0ed0-e3c1-4edd-a4ed-90d57abd439f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:57.946761 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff8c7a-c200-45a4-b6da-4d828ac03ff4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:57.947412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff8c7a-c200-45a4-b6da-4d828ac03ff4 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:57.947698 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff8c7a-c200-45a4-b6da-4d828ac03ff4 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:57.947981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff8c7a-c200-45a4-b6da-4d828ac03ff4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:57.948631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a0ed0-e3c1-4edd-a4ed-90d57abd439f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:57.952815 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35408ba-90ef-450f-a69c-62a074cb0cda service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '363d16eebb3f40a1be71506961cc3c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:57.953451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35408ba-90ef-450f-a69c-62a074cb0cda service glance] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:57.953913 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35408ba-90ef-450f-a69c-62a074cb0cda service glance] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:57.954196 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35408ba-90ef-450f-a69c-62a074cb0cda service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:57.956988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff8c7a-c200-45a4-b6da-4d828ac03ff4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:57.958585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff8c7a-c200-45a4-b6da-4d828ac03ff4 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:57.963181 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35408ba-90ef-450f-a69c-62a074cb0cda service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:57.964600 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35408ba-90ef-450f-a69c-62a074cb0cda service glance] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:57.968954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 691/1401] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:34:57.975098 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 711/1402] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:34:58.512944 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea06b52-4a1b-4aa3-b78d-3bc5cc4bc463 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:58.513303 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea06b52-4a1b-4aa3-b78d-3bc5cc4bc463 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:58.513645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea06b52-4a1b-4aa3-b78d-3bc5cc4bc463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:58.563316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-aea06b52-4a1b-4aa3-b78d-3bc5cc4bc463 None None] MFA Rules not processed for user `ebf3257328b94092b544cb0dadb789c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:58.564528 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aea06b52-4a1b-4aa3-b78d-3bc5cc4bc463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:58.601445 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:58.635684 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 692/1403] 10.222.0.110 () {58 vars in 1014 bytes} [Thu May 26 16:34:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:58.687105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def2c3a-8d20-4e28-9919-93a1e021b1cb None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:58.687364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def2c3a-8d20-4e28-9919-93a1e021b1cb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:58.687646 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def2c3a-8d20-4e28-9919-93a1e021b1cb None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:58.689217 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 712/1404] 10.222.0.110 () {54 vars in 947 bytes} [Thu May 26 16:34:58 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:58.703451 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e182f1a-999d-4168-aa96-941ddb26622f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:58.703746 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e182f1a-999d-4168-aa96-941ddb26622f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:58.704024 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e182f1a-999d-4168-aa96-941ddb26622f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:58.757281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0e182f1a-999d-4168-aa96-941ddb26622f None None] MFA Rules not processed for user `aa4502c57e324c31a8bce12770a92371`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:58.758395 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0e182f1a-999d-4168-aa96-941ddb26622f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:58.833404 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 693/1405] 10.222.0.110 () {58 vars in 1044 bytes} [Thu May 26 16:34:58 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:34:58.842945 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def2c3a-8d20-4e28-9919-93a1e021b1cb None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:58.857473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def2c3a-8d20-4e28-9919-93a1e021b1cb None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:58.863114 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f08f4-1ff7-4bc4-8a0e-d3f2b200dd55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4502c57e324c31a8bce12770a92371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:58.863823 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f08f4-1ff7-4bc4-8a0e-d3f2b200dd55 service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:58.864178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f08f4-1ff7-4bc4-8a0e-d3f2b200dd55 service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:58.864524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f08f4-1ff7-4bc4-8a0e-d3f2b200dd55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:58.872531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f08f4-1ff7-4bc4-8a0e-d3f2b200dd55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:58.874876 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f08f4-1ff7-4bc4-8a0e-d3f2b200dd55 service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:58.883017 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 713/1406] 10.222.0.110 () {60 vars in 1389 bytes} [Thu May 26 16:34:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:35:00.200079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da16d0-97ff-4d18-bb76-b6032990b531 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:00.200619 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da16d0-97ff-4d18-bb76-b6032990b531 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:00.200619 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da16d0-97ff-4d18-bb76-b6032990b531 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:00.206341 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 694/1407] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:35:00 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:00.207862 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d5844-46e5-4fc4-902b-8ff7faa92605 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:00.208277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d5844-46e5-4fc4-902b-8ff7faa92605 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:00.208426 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d5844-46e5-4fc4-902b-8ff7faa92605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:00.231956 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7d0d5844-46e5-4fc4-902b-8ff7faa92605 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:00.233722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7d0d5844-46e5-4fc4-902b-8ff7faa92605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:00.242056 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 714/1408] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:35:00.286140 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da16d0-97ff-4d18-bb76-b6032990b531 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:00.303018 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da16d0-97ff-4d18-bb76-b6032990b531 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:00.309875 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4c967-16e3-4ff3-973c-6d9459723c75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:00.310806 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4c967-16e3-4ff3-973c-6d9459723c75 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:00.311094 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4c967-16e3-4ff3-973c-6d9459723c75 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:00.311380 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4c967-16e3-4ff3-973c-6d9459723c75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:00.322253 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4c967-16e3-4ff3-973c-6d9459723c75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:00.323891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4c967-16e3-4ff3-973c-6d9459723c75 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:00.336389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 695/1409] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:10.225773 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=55 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:10.332093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=62 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:22.631842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c569f1-3db3-475a-8845-f69adc8c1f00 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:22.632475 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c569f1-3db3-475a-8845-f69adc8c1f00 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:22.632475 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c569f1-3db3-475a-8845-f69adc8c1f00 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:22.633750 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 715/1410] 10.222.0.110 () {54 vars in 923 bytes} [Thu May 26 16:35:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:22.639680 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f53ba-81a9-4e5d-96c6-d258da0f74c1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:22.640140 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f53ba-81a9-4e5d-96c6-d258da0f74c1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:22.640255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f53ba-81a9-4e5d-96c6-d258da0f74c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:22.658547 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fe6f53ba-81a9-4e5d-96c6-d258da0f74c1 None None] MFA Rules not processed for user `9ffef7640dd1487ab2ea91fc0f4be9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:22.659752 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fe6f53ba-81a9-4e5d-96c6-d258da0f74c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:22.668482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 696/1411] 10.222.0.110 () {58 vars in 1020 bytes} [Thu May 26 16:35:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:22.682524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923db7a7-21df-416f-a2f0-f9de55d8708a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:22.682853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923db7a7-21df-416f-a2f0-f9de55d8708a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:22.683664 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923db7a7-21df-416f-a2f0-f9de55d8708a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:22.685070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 716/1412] 10.222.0.110 () {54 vars in 923 bytes} [Thu May 26 16:35:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:22.689571 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad7966-1adb-454e-bb1c-764d4612447f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:22.689855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad7966-1adb-454e-bb1c-764d4612447f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:22.690130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad7966-1adb-454e-bb1c-764d4612447f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:22.708047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-19ad7966-1adb-454e-bb1c-764d4612447f None None] MFA Rules not processed for user `0043a7d5877f41de905afe6bef355867`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:22.709222 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-19ad7966-1adb-454e-bb1c-764d4612447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:22.718749 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 697/1413] 10.222.0.110 () {58 vars in 1020 bytes} [Thu May 26 16:35:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:25.434856 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa881f-f1a7-4325-a562-cf6ebc3d897e None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:25.435424 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa881f-f1a7-4325-a562-cf6ebc3d897e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:25.435533 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa881f-f1a7-4325-a562-cf6ebc3d897e None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:25.436835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:35:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:25.442623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9369404-b790-48df-ad11-83fdb3d7d126 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:25.443130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9369404-b790-48df-ad11-83fdb3d7d126 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:25.443261 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9369404-b790-48df-ad11-83fdb3d7d126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:25.461242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d9369404-b790-48df-ad11-83fdb3d7d126 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:25.462426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d9369404-b790-48df-ad11-83fdb3d7d126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:25.470770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:25.514298 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa881f-f1a7-4325-a562-cf6ebc3d897e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:25.529431 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa881f-f1a7-4325-a562-cf6ebc3d897e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:25.535000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fdc3f-9cfc-4bdf-9e5f-b3abe1883ff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:25.535647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fdc3f-9cfc-4bdf-9e5f-b3abe1883ff2 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:25.535933 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fdc3f-9cfc-4bdf-9e5f-b3abe1883ff2 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:25.536209 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fdc3f-9cfc-4bdf-9e5f-b3abe1883ff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:25.544218 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874fdc3f-9cfc-4bdf-9e5f-b3abe1883ff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:25.545778 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874fdc3f-9cfc-4bdf-9e5f-b3abe1883ff2 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:25.555289 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 718/1416] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:26.519054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bf2cf-6e6b-4b86-8e1a-bf6b477dc336 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:26.519743 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bf2cf-6e6b-4b86-8e1a-bf6b477dc336 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:26.519743 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bf2cf-6e6b-4b86-8e1a-bf6b477dc336 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:26.521070 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:35:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:26.525934 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd259e0-7b39-4265-963b-4707660139e4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:26.526408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd259e0-7b39-4265-963b-4707660139e4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:26.527055 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd259e0-7b39-4265-963b-4707660139e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:26.544879 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2cd259e0-7b39-4265-963b-4707660139e4 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:26.546419 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2cd259e0-7b39-4265-963b-4707660139e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:26.554407 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:26.712265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bf2cf-6e6b-4b86-8e1a-bf6b477dc336 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:26.727438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bf2cf-6e6b-4b86-8e1a-bf6b477dc336 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:26.733340 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647130c-4c88-4948-9d29-c69ef6f4510a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:26.733979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647130c-4c88-4948-9d29-c69ef6f4510a service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:26.734264 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647130c-4c88-4948-9d29-c69ef6f4510a service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:26.734542 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647130c-4c88-4948-9d29-c69ef6f4510a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:26.742652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647130c-4c88-4948-9d29-c69ef6f4510a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:26.744234 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647130c-4c88-4948-9d29-c69ef6f4510a service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:26.753831 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 700/1419] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:27.713051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03c837-c361-4567-b2b4-2660bb2e16fc None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:27.713682 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03c837-c361-4567-b2b4-2660bb2e16fc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:27.713682 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03c837-c361-4567-b2b4-2660bb2e16fc None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:27.715585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:35:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:27.720542 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f67bc-25af-4e74-9c76-254914f70c38 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:27.721033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f67bc-25af-4e74-9c76-254914f70c38 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:27.721158 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f67bc-25af-4e74-9c76-254914f70c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:27.740009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d58f67bc-25af-4e74-9c76-254914f70c38 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:27.741207 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d58f67bc-25af-4e74-9c76-254914f70c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:27.748926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:27.899445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03c837-c361-4567-b2b4-2660bb2e16fc None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:27.914054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03c837-c361-4567-b2b4-2660bb2e16fc None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:27.919967 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446ff91-8686-40ee-9be2-fcf8c2bb93cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:27.920602 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446ff91-8686-40ee-9be2-fcf8c2bb93cb service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:27.920885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446ff91-8686-40ee-9be2-fcf8c2bb93cb service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:27.921163 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446ff91-8686-40ee-9be2-fcf8c2bb93cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:27.929140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446ff91-8686-40ee-9be2-fcf8c2bb93cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:27.930752 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446ff91-8686-40ee-9be2-fcf8c2bb93cb service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:27.940740 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 721/1422] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:28.856617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507a6aa-cc60-4e08-b1d7-1b70b3d5e0c8 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:28.857188 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507a6aa-cc60-4e08-b1d7-1b70b3d5e0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:28.857188 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507a6aa-cc60-4e08-b1d7-1b70b3d5e0c8 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:28.858553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:35:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:28.863586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec14cad-de1d-4ac4-b8f6-dc18ca251fc5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:28.864015 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec14cad-de1d-4ac4-b8f6-dc18ca251fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:28.864158 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec14cad-de1d-4ac4-b8f6-dc18ca251fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:28.882363 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fec14cad-de1d-4ac4-b8f6-dc18ca251fc5 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:28.883759 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fec14cad-de1d-4ac4-b8f6-dc18ca251fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:28.891462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:29.039698 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507a6aa-cc60-4e08-b1d7-1b70b3d5e0c8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:29.054954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507a6aa-cc60-4e08-b1d7-1b70b3d5e0c8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:29.060430 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b846d1b-9ce5-4d8e-9a7b-2ae1df24e1ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:29.061184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b846d1b-9ce5-4d8e-9a7b-2ae1df24e1ae service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:29.061526 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b846d1b-9ce5-4d8e-9a7b-2ae1df24e1ae service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:29.061867 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b846d1b-9ce5-4d8e-9a7b-2ae1df24e1ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:29.070193 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b846d1b-9ce5-4d8e-9a7b-2ae1df24e1ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:29.072005 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b846d1b-9ce5-4d8e-9a7b-2ae1df24e1ae service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:29.081413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 703/1425] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:29.998231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7dc49-65e0-47a7-a041-caaf70a96df4 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:29.998839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7dc49-65e0-47a7-a041-caaf70a96df4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:29.998952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7dc49-65e0-47a7-a041-caaf70a96df4 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:30.000272 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:35:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:35:30.005132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be7e57-a172-480f-af8f-0b0263ab7f51 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:30.005568 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be7e57-a172-480f-af8f-0b0263ab7f51 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:30.005675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be7e57-a172-480f-af8f-0b0263ab7f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:30.023851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-48be7e57-a172-480f-af8f-0b0263ab7f51 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:30.025060 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-48be7e57-a172-480f-af8f-0b0263ab7f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:30.033451 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:30.183079 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7dc49-65e0-47a7-a041-caaf70a96df4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:30.197331 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7dc49-65e0-47a7-a041-caaf70a96df4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:30.203247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de5e7f-02a7-418a-a701-2f5cd5af4485 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:30.203875 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de5e7f-02a7-418a-a701-2f5cd5af4485 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:30.204166 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de5e7f-02a7-418a-a701-2f5cd5af4485 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:30.204445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de5e7f-02a7-418a-a701-2f5cd5af4485 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:30.212555 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de5e7f-02a7-418a-a701-2f5cd5af4485 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:30.214734 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de5e7f-02a7-418a-a701-2f5cd5af4485 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:30.224448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 724/1428] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:31.083893 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1125b1b-5d3e-44e6-bd88-f3ed811d6a5e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:31.084567 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1125b1b-5d3e-44e6-bd88-f3ed811d6a5e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:31.084567 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1125b1b-5d3e-44e6-bd88-f3ed811d6a5e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:31.085837 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:35:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:31.091388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4c403-3c53-4d10-9753-819e4ddaa4a2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:31.091929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4c403-3c53-4d10-9753-819e4ddaa4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:31.091929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4c403-3c53-4d10-9753-819e4ddaa4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:31.109856 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4da4c403-3c53-4d10-9753-819e4ddaa4a2 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:31.111090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4da4c403-3c53-4d10-9753-819e4ddaa4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:31.119205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:31.271880 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1125b1b-5d3e-44e6-bd88-f3ed811d6a5e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:31.288179 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1125b1b-5d3e-44e6-bd88-f3ed811d6a5e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:31.293649 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447a261-1c67-4b94-9fbd-1e5e0cf96e34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:31.294290 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447a261-1c67-4b94-9fbd-1e5e0cf96e34 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:31.294586 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447a261-1c67-4b94-9fbd-1e5e0cf96e34 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:31.295416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447a261-1c67-4b94-9fbd-1e5e0cf96e34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:31.304125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447a261-1c67-4b94-9fbd-1e5e0cf96e34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:31.305700 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447a261-1c67-4b94-9fbd-1e5e0cf96e34 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:31.315675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 706/1431] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:32.163104 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f9815-b17e-4248-9694-b5c7de159430 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:32.163687 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f9815-b17e-4248-9694-b5c7de159430 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:32.163687 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f9815-b17e-4248-9694-b5c7de159430 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:32.165088 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:35:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:32.170421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29289b2e-cc34-49d8-9a90-409d09f073a6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:32.170887 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29289b2e-cc34-49d8-9a90-409d09f073a6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:32.171022 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29289b2e-cc34-49d8-9a90-409d09f073a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:32.189776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-29289b2e-cc34-49d8-9a90-409d09f073a6 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:32.191017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-29289b2e-cc34-49d8-9a90-409d09f073a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:32.199526 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:32.347965 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f9815-b17e-4248-9694-b5c7de159430 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:32.363071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f9815-b17e-4248-9694-b5c7de159430 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:32.368489 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b25a0-29b8-4298-a0a2-984e98fe6b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:32.369199 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b25a0-29b8-4298-a0a2-984e98fe6b18 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:32.369439 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b25a0-29b8-4298-a0a2-984e98fe6b18 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:32.370301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b25a0-29b8-4298-a0a2-984e98fe6b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:32.379017 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b25a0-29b8-4298-a0a2-984e98fe6b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:32.380614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b25a0-29b8-4298-a0a2-984e98fe6b18 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:32.390694 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 727/1434] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:33.240702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1eb6e1-8545-4a43-b09b-f311b86bfc2d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:33.241271 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1eb6e1-8545-4a43-b09b-f311b86bfc2d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:33.241271 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1eb6e1-8545-4a43-b09b-f311b86bfc2d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:33.242673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:35:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:33.248206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0881f6-73ee-4ef9-886a-bb769f8ba851 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:33.248637 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0881f6-73ee-4ef9-886a-bb769f8ba851 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:33.248796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0881f6-73ee-4ef9-886a-bb769f8ba851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:33.266465 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-5a0881f6-73ee-4ef9-886a-bb769f8ba851 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:33.267681 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5a0881f6-73ee-4ef9-886a-bb769f8ba851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:33.275337 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:33.424503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1eb6e1-8545-4a43-b09b-f311b86bfc2d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:33.438634 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1eb6e1-8545-4a43-b09b-f311b86bfc2d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:33.444170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842d8a5-eb02-40a1-a841-5920fed7c26c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:33.444809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842d8a5-eb02-40a1-a841-5920fed7c26c service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:33.445096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842d8a5-eb02-40a1-a841-5920fed7c26c service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:33.445373 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842d8a5-eb02-40a1-a841-5920fed7c26c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:33.454347 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842d8a5-eb02-40a1-a841-5920fed7c26c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:33.456278 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842d8a5-eb02-40a1-a841-5920fed7c26c service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:33.467184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 709/1437] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:34.322669 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376e0f6-d82c-46ef-a47b-be4454f872d4 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:34.323293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376e0f6-d82c-46ef-a47b-be4454f872d4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:34.323293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376e0f6-d82c-46ef-a47b-be4454f872d4 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:34.324629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:35:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:34.329698 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd15ec-176c-4547-9d34-4123097e9a0c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:34.330157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd15ec-176c-4547-9d34-4123097e9a0c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:34.330293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd15ec-176c-4547-9d34-4123097e9a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:34.349283 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0cbd15ec-176c-4547-9d34-4123097e9a0c None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:34.350533 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0cbd15ec-176c-4547-9d34-4123097e9a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:34.359752 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:34.513362 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376e0f6-d82c-46ef-a47b-be4454f872d4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:34.528091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376e0f6-d82c-46ef-a47b-be4454f872d4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:34.533474 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902867ca-aa9b-477e-b815-b86662fadab1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:34.534101 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902867ca-aa9b-477e-b815-b86662fadab1 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:34.534459 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902867ca-aa9b-477e-b815-b86662fadab1 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:34.534764 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902867ca-aa9b-477e-b815-b86662fadab1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:34.543483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902867ca-aa9b-477e-b815-b86662fadab1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:34.545134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902867ca-aa9b-477e-b815-b86662fadab1 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:34.558181 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 730/1440] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:36.652664 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859c033-65ba-4f6e-a8d3-c5eb63b75f3b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:36.653194 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859c033-65ba-4f6e-a8d3-c5eb63b75f3b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:36.653194 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859c033-65ba-4f6e-a8d3-c5eb63b75f3b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:36.654530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:35:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:36.659994 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2fdf9-20c8-4bd1-97c0-b81c3eb44e2a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:36.660424 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2fdf9-20c8-4bd1-97c0-b81c3eb44e2a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:36.660563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2fdf9-20c8-4bd1-97c0-b81c3eb44e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:36.678337 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-49c2fdf9-20c8-4bd1-97c0-b81c3eb44e2a None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:36.679542 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-49c2fdf9-20c8-4bd1-97c0-b81c3eb44e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:36.687526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:35:36.725741 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859c033-65ba-4f6e-a8d3-c5eb63b75f3b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:36.727490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7859c033-65ba-4f6e-a8d3-c5eb63b75f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:36.741066 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859c033-65ba-4f6e-a8d3-c5eb63b75f3b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:36.744692 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b993f7-9c49-41f6-b0e0-d4e4f6596256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:36.745328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b993f7-9c49-41f6-b0e0-d4e4f6596256 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:36.745614 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b993f7-9c49-41f6-b0e0-d4e4f6596256 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:36.745893 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b993f7-9c49-41f6-b0e0-d4e4f6596256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:36.754753 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b993f7-9c49-41f6-b0e0-d4e4f6596256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:36.756191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b993f7-9c49-41f6-b0e0-d4e4f6596256 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:36.766075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 712/1443] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:39.184103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24d8bc-b3d7-45b0-9f20-d71a7a5501b3 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:39.184671 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24d8bc-b3d7-45b0-9f20-d71a7a5501b3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:39.184671 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24d8bc-b3d7-45b0-9f20-d71a7a5501b3 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:39.186054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:35:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:39.191378 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186dd0f-ab83-4645-a69b-16af9412b6b9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:39.191789 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186dd0f-ab83-4645-a69b-16af9412b6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:39.191943 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186dd0f-ab83-4645-a69b-16af9412b6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:39.209769 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d186dd0f-ab83-4645-a69b-16af9412b6b9 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:39.211002 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d186dd0f-ab83-4645-a69b-16af9412b6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:39.219335 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:39.256649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24d8bc-b3d7-45b0-9f20-d71a7a5501b3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:39.268173 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24d8bc-b3d7-45b0-9f20-d71a7a5501b3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:39.271704 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f91621-b04d-4ec1-a423-99648bc63b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:39.272345 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f91621-b04d-4ec1-a423-99648bc63b78 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:39.272631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f91621-b04d-4ec1-a423-99648bc63b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:39.272909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f91621-b04d-4ec1-a423-99648bc63b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:39.282528 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f91621-b04d-4ec1-a423-99648bc63b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:39.283985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f91621-b04d-4ec1-a423-99648bc63b78 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:39.293686 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 733/1446] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:41.816300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252c163-4cd4-4ed5-926c-d623e5efd2dc None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:41.816873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252c163-4cd4-4ed5-926c-d623e5efd2dc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:41.816973 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252c163-4cd4-4ed5-926c-d623e5efd2dc None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:41.818326 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:35:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:41.824394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed41aa-a13b-478f-99ff-8b759f36cf48 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:41.824837 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed41aa-a13b-478f-99ff-8b759f36cf48 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:41.824945 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed41aa-a13b-478f-99ff-8b759f36cf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:41.842467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c8ed41aa-a13b-478f-99ff-8b759f36cf48 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:41.843694 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c8ed41aa-a13b-478f-99ff-8b759f36cf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:41.851754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:41.891304 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252c163-4cd4-4ed5-926c-d623e5efd2dc None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:41.905922 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252c163-4cd4-4ed5-926c-d623e5efd2dc None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:41.909487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabe413-001b-4bf9-a89c-dde4cc764ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:41.910143 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabe413-001b-4bf9-a89c-dde4cc764ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:41.910476 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabe413-001b-4bf9-a89c-dde4cc764ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:41.910792 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabe413-001b-4bf9-a89c-dde4cc764ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:41.920075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabe413-001b-4bf9-a89c-dde4cc764ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:41.921502 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabe413-001b-4bf9-a89c-dde4cc764ea9 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:41.931506 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 715/1449] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:44.273142 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d5db9-44d6-48f3-869d-b0737b318d50 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:44.273722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d5db9-44d6-48f3-869d-b0737b318d50 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:44.273722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d5db9-44d6-48f3-869d-b0737b318d50 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:44.275812 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:35:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:44.281143 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c78c9-b0d3-47d2-ac5e-e63866f3c267 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:44.281619 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c78c9-b0d3-47d2-ac5e-e63866f3c267 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:44.281730 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c78c9-b0d3-47d2-ac5e-e63866f3c267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:44.299344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-180c78c9-b0d3-47d2-ac5e-e63866f3c267 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:44.300541 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-180c78c9-b0d3-47d2-ac5e-e63866f3c267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:44.308217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:44.347300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d5db9-44d6-48f3-869d-b0737b318d50 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:44.359737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d5db9-44d6-48f3-869d-b0737b318d50 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:44.362076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373584c-327e-4918-b666-8ddc1d6b2701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:44.362753 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373584c-327e-4918-b666-8ddc1d6b2701 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:44.363040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373584c-327e-4918-b666-8ddc1d6b2701 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:44.363317 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373584c-327e-4918-b666-8ddc1d6b2701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:44.372931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373584c-327e-4918-b666-8ddc1d6b2701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:44.374377 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373584c-327e-4918-b666-8ddc1d6b2701 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:44.384869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 736/1452] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:46.656449 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3887137-f153-44ef-94a7-f58acaec1d94 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:46.656996 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3887137-f153-44ef-94a7-f58acaec1d94 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:46.656996 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3887137-f153-44ef-94a7-f58acaec1d94 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:46.658344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:35:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:46.663606 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e70ef3-e280-4d42-adfe-8de5e1617da7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:46.664061 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e70ef3-e280-4d42-adfe-8de5e1617da7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:46.664165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e70ef3-e280-4d42-adfe-8de5e1617da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:46.681549 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-15e70ef3-e280-4d42-adfe-8de5e1617da7 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:46.682783 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-15e70ef3-e280-4d42-adfe-8de5e1617da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:46.690472 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:46.729110 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3887137-f153-44ef-94a7-f58acaec1d94 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:46.740093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3887137-f153-44ef-94a7-f58acaec1d94 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:46.743597 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7eae4-c0ff-418c-8b7e-1dbfe1dfcd75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:46.744236 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7eae4-c0ff-418c-8b7e-1dbfe1dfcd75 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:46.744524 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7eae4-c0ff-418c-8b7e-1dbfe1dfcd75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:46.744806 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7eae4-c0ff-418c-8b7e-1dbfe1dfcd75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:46.754940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7eae4-c0ff-418c-8b7e-1dbfe1dfcd75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:46.756373 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7eae4-c0ff-418c-8b7e-1dbfe1dfcd75 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:46.766297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 718/1455] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:49.020660 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e9123-05ef-46fd-bf6f-b998f8d14f78 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:49.021235 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e9123-05ef-46fd-bf6f-b998f8d14f78 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:49.021235 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e9123-05ef-46fd-bf6f-b998f8d14f78 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:49.022619 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:35:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:49.028035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35256cd6-fa29-4f4e-b7f1-092a19fdfdf8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:49.028460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35256cd6-fa29-4f4e-b7f1-092a19fdfdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:49.028599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35256cd6-fa29-4f4e-b7f1-092a19fdfdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:49.046415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-35256cd6-fa29-4f4e-b7f1-092a19fdfdf8 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:49.047648 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-35256cd6-fa29-4f4e-b7f1-092a19fdfdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:49.056110 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:49.092882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e9123-05ef-46fd-bf6f-b998f8d14f78 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:49.104385 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e9123-05ef-46fd-bf6f-b998f8d14f78 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:49.107851 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e0eb2-9770-4ffe-8d6e-83d501e3fccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:49.108483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e0eb2-9770-4ffe-8d6e-83d501e3fccd service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:49.108762 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e0eb2-9770-4ffe-8d6e-83d501e3fccd service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:49.109044 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e0eb2-9770-4ffe-8d6e-83d501e3fccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:49.118886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e0eb2-9770-4ffe-8d6e-83d501e3fccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:49.120303 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e0eb2-9770-4ffe-8d6e-83d501e3fccd service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:49.129769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 739/1458] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:51.396614 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012141bf-4593-4625-8257-a032bbea2f14 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:51.397063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012141bf-4593-4625-8257-a032bbea2f14 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:51.397170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012141bf-4593-4625-8257-a032bbea2f14 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:51.398742 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:35:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:51.404245 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069d606-5d36-4d65-a8bd-360303cfd430 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:51.404644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069d606-5d36-4d65-a8bd-360303cfd430 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:51.404813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069d606-5d36-4d65-a8bd-360303cfd430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:51.410768 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=70 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:51.423256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a069d606-5d36-4d65-a8bd-360303cfd430 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:51.424451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a069d606-5d36-4d65-a8bd-360303cfd430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:51.432643 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:51.469890 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012141bf-4593-4625-8257-a032bbea2f14 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:51.475568 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=73 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:51.482042 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012141bf-4593-4625-8257-a032bbea2f14 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:51.485575 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb48b2-298f-4fd6-969a-45e99807b89c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:51.486217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb48b2-298f-4fd6-969a-45e99807b89c service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:51.486500 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb48b2-298f-4fd6-969a-45e99807b89c service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:51.486807 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb48b2-298f-4fd6-969a-45e99807b89c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:51.496294 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb48b2-298f-4fd6-969a-45e99807b89c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:51.497715 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb48b2-298f-4fd6-969a-45e99807b89c service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:51.507047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 721/1461] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:53.767210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d347b-735f-49e0-8df9-39056f6659de None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:53.767769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d347b-735f-49e0-8df9-39056f6659de None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:53.767769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d347b-735f-49e0-8df9-39056f6659de None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:53.769170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:35:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:53.775113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb23868-b2c7-42e9-aa6c-f3fce503453c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:53.775582 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb23868-b2c7-42e9-aa6c-f3fce503453c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:53.775680 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb23868-b2c7-42e9-aa6c-f3fce503453c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:53.793702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8eb23868-b2c7-42e9-aa6c-f3fce503453c None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:53.795011 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8eb23868-b2c7-42e9-aa6c-f3fce503453c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:53.802974 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:53.839769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d347b-735f-49e0-8df9-39056f6659de None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:53.850837 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d347b-735f-49e0-8df9-39056f6659de None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:53.854962 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cb909-790f-4dfb-8ff1-26fc493c5c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:53.855603 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cb909-790f-4dfb-8ff1-26fc493c5c2d service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:53.855891 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cb909-790f-4dfb-8ff1-26fc493c5c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:53.856170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cb909-790f-4dfb-8ff1-26fc493c5c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:53.865114 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cb909-790f-4dfb-8ff1-26fc493c5c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:53.866543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cb909-790f-4dfb-8ff1-26fc493c5c2d service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:53.875970 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 742/1464] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:56.096575 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98e810-81e0-440e-8f19-969f2c815613 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:56.097413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98e810-81e0-440e-8f19-969f2c815613 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:56.097413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98e810-81e0-440e-8f19-969f2c815613 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:56.098795 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:35:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:56.104319 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a709f72-ba71-4f8a-b612-80f52ab067b7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:56.104743 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a709f72-ba71-4f8a-b612-80f52ab067b7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:56.104882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a709f72-ba71-4f8a-b612-80f52ab067b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:56.123361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0a709f72-ba71-4f8a-b612-80f52ab067b7 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:56.124559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0a709f72-ba71-4f8a-b612-80f52ab067b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:56.132293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:56.168936 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98e810-81e0-440e-8f19-969f2c815613 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:56.180357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98e810-81e0-440e-8f19-969f2c815613 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:56.183896 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65569a5c-c350-4507-87cf-d307c108a8dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:56.184517 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65569a5c-c350-4507-87cf-d307c108a8dc service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:56.184802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65569a5c-c350-4507-87cf-d307c108a8dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:56.185082 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65569a5c-c350-4507-87cf-d307c108a8dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:56.194002 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65569a5c-c350-4507-87cf-d307c108a8dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:56.196219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65569a5c-c350-4507-87cf-d307c108a8dc service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:56.205711 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 724/1467] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:58.424110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347f02c-5860-48d7-9b16-7747a8d76adf None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:58.424592 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347f02c-5860-48d7-9b16-7747a8d76adf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:58.424705 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347f02c-5860-48d7-9b16-7747a8d76adf None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:58.426043 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:35:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:58.431264 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bff873-7914-489e-9d06-e26eacec36ad None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:58.431716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bff873-7914-489e-9d06-e26eacec36ad None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:58.431852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bff873-7914-489e-9d06-e26eacec36ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:58.449725 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-97bff873-7914-489e-9d06-e26eacec36ad None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:58.450998 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-97bff873-7914-489e-9d06-e26eacec36ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:58.458847 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:58.496144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347f02c-5860-48d7-9b16-7747a8d76adf None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:58.506610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347f02c-5860-48d7-9b16-7747a8d76adf None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:58.510741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6695295-f6bd-4a77-9476-2f600b1dfbdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:58.511368 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6695295-f6bd-4a77-9476-2f600b1dfbdf service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:58.511655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6695295-f6bd-4a77-9476-2f600b1dfbdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:58.511930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6695295-f6bd-4a77-9476-2f600b1dfbdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:58.520607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6695295-f6bd-4a77-9476-2f600b1dfbdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:58.522031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6695295-f6bd-4a77-9476-2f600b1dfbdf service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:58.531639 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 745/1470] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:35:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:36:08.444618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=17 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:08.527640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=17 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:31.549547 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551a3c7-46a7-4ace-b021-3f016c502d0e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:31.550150 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551a3c7-46a7-4ace-b021-3f016c502d0e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:31.550257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551a3c7-46a7-4ace-b021-3f016c502d0e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:31.552342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 726/1471] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:36:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:36:31.557567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383656e-b6e6-48a2-ac1f-0d02d61b1482 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:31.558016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383656e-b6e6-48a2-ac1f-0d02d61b1482 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:31.558124 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383656e-b6e6-48a2-ac1f-0d02d61b1482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:31.576093 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c383656e-b6e6-48a2-ac1f-0d02d61b1482 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:36:31.577284 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c383656e-b6e6-48a2-ac1f-0d02d61b1482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:36:31.585593 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 746/1472] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:36:31.632455 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b78fb8-6587-4ad8-806d-ecd39d80b90f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:31.632747 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b78fb8-6587-4ad8-806d-ecd39d80b90f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:31.633032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b78fb8-6587-4ad8-806d-ecd39d80b90f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:31.634392 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 727/1473] 10.222.0.110 () {54 vars in 967 bytes} [Thu May 26 16:36:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:36:31.639032 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bbecc-67fe-4df1-9689-594972a38065 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:31.639326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bbecc-67fe-4df1-9689-594972a38065 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:31.639607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bbecc-67fe-4df1-9689-594972a38065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:31.657928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-401bbecc-67fe-4df1-9689-594972a38065 None None] MFA Rules not processed for user `363d16eebb3f40a1be71506961cc3c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:36:31.659164 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-401bbecc-67fe-4df1-9689-594972a38065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:36:31.665658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 747/1474] 10.222.0.110 () {58 vars in 1064 bytes} [Thu May 26 16:36:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:36:31.672737 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b78fb8-6587-4ad8-806d-ecd39d80b90f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:31.683252 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b78fb8-6587-4ad8-806d-ecd39d80b90f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:31.686764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0efba-3050-4658-92ff-2de97ee1cc23 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '363d16eebb3f40a1be71506961cc3c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:31.687400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0efba-3050-4658-92ff-2de97ee1cc23 service glance] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:31.687695 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0efba-3050-4658-92ff-2de97ee1cc23 service glance] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:31.687971 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0efba-3050-4658-92ff-2de97ee1cc23 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:31.697449 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0efba-3050-4658-92ff-2de97ee1cc23 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:31.698909 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0efba-3050-4658-92ff-2de97ee1cc23 service glance] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:31.708928 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 728/1475] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:36:34.016115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd43ce-5e7b-46ec-adba-08c887f84e16 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:34.016708 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd43ce-5e7b-46ec-adba-08c887f84e16 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:34.016708 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd43ce-5e7b-46ec-adba-08c887f84e16 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:34.018070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 748/1476] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:36:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:36:34.024076 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f5b09-70d4-438a-a8c4-28b661d3d33c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:34.024490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f5b09-70d4-438a-a8c4-28b661d3d33c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:34.024610 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f5b09-70d4-438a-a8c4-28b661d3d33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:34.050582 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-577f5b09-70d4-438a-a8c4-28b661d3d33c None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:36:34.052805 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-577f5b09-70d4-438a-a8c4-28b661d3d33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:36:34.060852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 729/1477] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:36:34.085173 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd43ce-5e7b-46ec-adba-08c887f84e16 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:34.098021 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd43ce-5e7b-46ec-adba-08c887f84e16 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:34.102394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c3d1a-c86f-4feb-a0eb-f2ea60d9faae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:34.103072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c3d1a-c86f-4feb-a0eb-f2ea60d9faae admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:34.103382 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c3d1a-c86f-4feb-a0eb-f2ea60d9faae admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:34.103666 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c3d1a-c86f-4feb-a0eb-f2ea60d9faae admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:34.104399 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c3d1a-c86f-4feb-a0eb-f2ea60d9faae admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:34.106175 dv-cinder-836072-5-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-788c3d1a-c86f-4feb-a0eb-f2ea60d9faae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:36:34.106175 dv-cinder-836072-5-smb devstack@keystone.service[80420]: warnings.warn(msg) May 26 16:36:34.106175 dv-cinder-836072-5-smb devstack@keystone.service[80420]: May 26 16:36:34.107354 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c3d1a-c86f-4feb-a0eb-f2ea60d9faae admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:34.127191 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 749/1478] 10.222.0.110 () {56 vars in 1113 bytes} [Thu May 26 16:36:34 2022] GET /identity/v3/projects => generated 2562 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:36:36.388158 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0576e5-105e-4b29-9bd4-154b23b5b331 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:36.388621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0576e5-105e-4b29-9bd4-154b23b5b331 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:36.388754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0576e5-105e-4b29-9bd4-154b23b5b331 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:36.390084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 730/1479] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:36:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:36:36.395421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381269e-b47f-4344-bfaa-515489d5c246 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:36.395827 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381269e-b47f-4344-bfaa-515489d5c246 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:36.395989 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381269e-b47f-4344-bfaa-515489d5c246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:36.413953 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0381269e-b47f-4344-bfaa-515489d5c246 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:36:36.415212 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0381269e-b47f-4344-bfaa-515489d5c246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:36:36.422987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 750/1480] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:36:36.467225 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0576e5-105e-4b29-9bd4-154b23b5b331 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:36.481913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0576e5-105e-4b29-9bd4-154b23b5b331 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:36.487346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99280c15-8285-4f30-ba07-f5d6f9651269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:36.488548 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99280c15-8285-4f30-ba07-f5d6f9651269 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:36.488832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99280c15-8285-4f30-ba07-f5d6f9651269 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:36.489110 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99280c15-8285-4f30-ba07-f5d6f9651269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:36.497171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99280c15-8285-4f30-ba07-f5d6f9651269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:36.498780 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99280c15-8285-4f30-ba07-f5d6f9651269 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:36.509115 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 731/1481] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:36:38.933329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1969ed-8abb-42c9-8d60-3121b62481c2 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:38.933868 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1969ed-8abb-42c9-8d60-3121b62481c2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:38.934017 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1969ed-8abb-42c9-8d60-3121b62481c2 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:38.935322 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 751/1482] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:36:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:36:38.941373 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f98e1d-aff4-4d32-bd91-233572c789b8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:38.941818 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f98e1d-aff4-4d32-bd91-233572c789b8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:38.941917 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f98e1d-aff4-4d32-bd91-233572c789b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:38.959635 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b7f98e1d-aff4-4d32-bd91-233572c789b8 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:36:38.960833 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b7f98e1d-aff4-4d32-bd91-233572c789b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:36:38.968958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 732/1483] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:36:39.005963 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1969ed-8abb-42c9-8d60-3121b62481c2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:39.016601 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1969ed-8abb-42c9-8d60-3121b62481c2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:39.020303 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f95f0b-f2cd-4e6b-899a-1f853c01794e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:39.020948 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f95f0b-f2cd-4e6b-899a-1f853c01794e service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:39.021239 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f95f0b-f2cd-4e6b-899a-1f853c01794e service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:39.021521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f95f0b-f2cd-4e6b-899a-1f853c01794e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:39.030386 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f95f0b-f2cd-4e6b-899a-1f853c01794e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:39.031848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f95f0b-f2cd-4e6b-899a-1f853c01794e service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:39.041829 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 752/1484] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:36:41.327833 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae67734-15fd-4b0d-b7af-330230ee84f4 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:41.328403 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae67734-15fd-4b0d-b7af-330230ee84f4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:41.328403 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae67734-15fd-4b0d-b7af-330230ee84f4 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:41.329779 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 733/1485] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:36:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:36:41.335695 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f0941-7ff9-4682-add9-bd9200614dc0 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:41.336177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f0941-7ff9-4682-add9-bd9200614dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:41.336289 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f0941-7ff9-4682-add9-bd9200614dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:41.353716 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-cd4f0941-7ff9-4682-add9-bd9200614dc0 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:36:41.354931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cd4f0941-7ff9-4682-add9-bd9200614dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:36:41.362780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 753/1486] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:36:41.400524 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae67734-15fd-4b0d-b7af-330230ee84f4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:41.411737 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae67734-15fd-4b0d-b7af-330230ee84f4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:41.415645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7307f-20cc-434d-80f1-72e17980bceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:41.416285 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7307f-20cc-434d-80f1-72e17980bceb service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:41.416596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7307f-20cc-434d-80f1-72e17980bceb service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:41.416887 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7307f-20cc-434d-80f1-72e17980bceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:41.426727 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7307f-20cc-434d-80f1-72e17980bceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:41.428171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7307f-20cc-434d-80f1-72e17980bceb service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:41.437548 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 734/1487] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:36:43.744782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed50ded-9afa-4bea-a80f-07df8e806585 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:43.745370 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed50ded-9afa-4bea-a80f-07df8e806585 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:43.745370 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed50ded-9afa-4bea-a80f-07df8e806585 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:43.746879 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 754/1488] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:36:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:36:43.752788 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ae818-0b53-49d0-80d9-43619f8ceaaa None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:43.753292 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ae818-0b53-49d0-80d9-43619f8ceaaa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:43.753394 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ae818-0b53-49d0-80d9-43619f8ceaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:43.772581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d92ae818-0b53-49d0-80d9-43619f8ceaaa None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:36:43.773783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d92ae818-0b53-49d0-80d9-43619f8ceaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:36:43.781620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 735/1489] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:36:43.821538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed50ded-9afa-4bea-a80f-07df8e806585 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:43.832933 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed50ded-9afa-4bea-a80f-07df8e806585 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:43.836829 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a8224-0fac-4292-a308-a4ae3631ff9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:43.837458 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a8224-0fac-4292-a308-a4ae3631ff9c service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:43.837742 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a8224-0fac-4292-a308-a4ae3631ff9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:43.838020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a8224-0fac-4292-a308-a4ae3631ff9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:43.847341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a8224-0fac-4292-a308-a4ae3631ff9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:43.848773 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a8224-0fac-4292-a308-a4ae3631ff9c service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:43.858123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 755/1490] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:36:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:36:46.273542 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf442765-9764-4989-86c5-4fca94675cfb None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:46.274333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf442765-9764-4989-86c5-4fca94675cfb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:46.274333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf442765-9764-4989-86c5-4fca94675cfb None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:46.275509 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 736/1491] 10.222.0.110 () {54 vars in 931 bytes} [Thu May 26 16:36:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:36:46.281067 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039b3c2-19ec-4b1a-88fc-1a40222b2002 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:46.281485 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039b3c2-19ec-4b1a-88fc-1a40222b2002 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:46.281626 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039b3c2-19ec-4b1a-88fc-1a40222b2002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:46.299596 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0039b3c2-19ec-4b1a-88fc-1a40222b2002 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:36:46.300812 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0039b3c2-19ec-4b1a-88fc-1a40222b2002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:36:46.308335 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 756/1492] 10.222.0.110 () {58 vars in 1028 bytes} [Thu May 26 16:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:36:46.348054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf442765-9764-4989-86c5-4fca94675cfb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:46.359145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf442765-9764-4989-86c5-4fca94675cfb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:46.362657 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326c692-0a1a-421f-bfc9-616188ecbe77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:46.363299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326c692-0a1a-421f-bfc9-616188ecbe77 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:46.363579 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326c692-0a1a-421f-bfc9-616188ecbe77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:46.363868 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326c692-0a1a-421f-bfc9-616188ecbe77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:46.373005 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326c692-0a1a-421f-bfc9-616188ecbe77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:46.374450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326c692-0a1a-421f-bfc9-616188ecbe77 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:46.383649 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 737/1493] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:36:56.294405 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=33 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:56.379623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=33 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:26.824642 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377988c0-9939-4417-9f31-9aa91c87538d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:26.825244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377988c0-9939-4417-9f31-9aa91c87538d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:26.825244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377988c0-9939-4417-9f31-9aa91c87538d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:26.843833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-377988c0-9939-4417-9f31-9aa91c87538d None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:38:26.845040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-377988c0-9939-4417-9f31-9aa91c87538d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:26.853315 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 757/1494] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:38:26.862522 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be28b9-5e18-45a3-8538-2702b1f93e8a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:26.863056 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be28b9-5e18-45a3-8538-2702b1f93e8a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:26.863160 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be28b9-5e18-45a3-8538-2702b1f93e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:26.880610 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-07be28b9-5e18-45a3-8538-2702b1f93e8a None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:38:26.881842 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-07be28b9-5e18-45a3-8538-2702b1f93e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:26.889508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 738/1495] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:38:26.893974 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377988c0-9939-4417-9f31-9aa91c87538d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:26.903985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377988c0-9939-4417-9f31-9aa91c87538d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:26.908450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb975932-d2ff-4fb6-98b8-8727fe821e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:26.909099 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb975932-d2ff-4fb6-98b8-8727fe821e97 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:26.909381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb975932-d2ff-4fb6-98b8-8727fe821e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:26.909656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb975932-d2ff-4fb6-98b8-8727fe821e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:26.910374 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb975932-d2ff-4fb6-98b8-8727fe821e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:26.910721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb975932-d2ff-4fb6-98b8-8727fe821e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:26.911730 dv-cinder-836072-5-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-cb975932-d2ff-4fb6-98b8-8727fe821e97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:38:26.911730 dv-cinder-836072-5-smb devstack@keystone.service[80420]: warnings.warn(msg) May 26 16:38:26.911730 dv-cinder-836072-5-smb devstack@keystone.service[80420]: May 26 16:38:26.912609 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb975932-d2ff-4fb6-98b8-8727fe821e97 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:26.924921 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 758/1496] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:38:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:26.933130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be28b9-5e18-45a3-8538-2702b1f93e8a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:26.942073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be28b9-5e18-45a3-8538-2702b1f93e8a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:26.946686 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8681ae-dc35-4419-a0a5-42b59ffe864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:26.947365 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8681ae-dc35-4419-a0a5-42b59ffe864d admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:26.947647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8681ae-dc35-4419-a0a5-42b59ffe864d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:26.947920 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8681ae-dc35-4419-a0a5-42b59ffe864d admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:26.948594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8681ae-dc35-4419-a0a5-42b59ffe864d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:26.950362 dv-cinder-836072-5-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-eb8681ae-dc35-4419-a0a5-42b59ffe864d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:38:26.950362 dv-cinder-836072-5-smb devstack@keystone.service[80419]: warnings.warn(msg) May 26 16:38:26.950362 dv-cinder-836072-5-smb devstack@keystone.service[80419]: May 26 16:38:26.951563 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8681ae-dc35-4419-a0a5-42b59ffe864d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:26.988436 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 739/1497] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:38:26 2022] POST /identity/v3/projects => generated 380 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:38:26.993102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb975932-d2ff-4fb6-98b8-8727fe821e97 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:27.002826 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb975932-d2ff-4fb6-98b8-8727fe821e97 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:27.059206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00547b-5a09-41e8-a3b6-463e3b0045c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:27.059878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00547b-5a09-41e8-a3b6-463e3b0045c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:27.060168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00547b-5a09-41e8-a3b6-463e3b0045c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:27.060480 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00547b-5a09-41e8-a3b6-463e3b0045c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:27.061178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00547b-5a09-41e8-a3b6-463e3b0045c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:27.062185 dv-cinder-836072-5-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-9c00547b-5a09-41e8-a3b6-463e3b0045c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:38:27.062185 dv-cinder-836072-5-smb devstack@keystone.service[80420]: warnings.warn(msg) May 26 16:38:27.062185 dv-cinder-836072-5-smb devstack@keystone.service[80420]: May 26 16:38:27.063441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00547b-5a09-41e8-a3b6-463e3b0045c7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:27.083177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 759/1498] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:38:26 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:38:27.087580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8681ae-dc35-4419-a0a5-42b59ffe864d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:27.097682 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8681ae-dc35-4419-a0a5-42b59ffe864d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:27.102731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225e0ba-54ee-430b-a44e-da4a5e60cd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:27.103391 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225e0ba-54ee-430b-a44e-da4a5e60cd23 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:27.103675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225e0ba-54ee-430b-a44e-da4a5e60cd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:27.103952 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225e0ba-54ee-430b-a44e-da4a5e60cd23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:27.104669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225e0ba-54ee-430b-a44e-da4a5e60cd23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:27.105670 dv-cinder-836072-5-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-f225e0ba-54ee-430b-a44e-da4a5e60cd23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:38:27.105670 dv-cinder-836072-5-smb devstack@keystone.service[80419]: warnings.warn(msg) May 26 16:38:27.105670 dv-cinder-836072-5-smb devstack@keystone.service[80419]: May 26 16:38:27.106593 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225e0ba-54ee-430b-a44e-da4a5e60cd23 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:27.119654 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 740/1499] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:38:27 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:38:27.123425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00547b-5a09-41e8-a3b6-463e3b0045c7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:27.133134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00547b-5a09-41e8-a3b6-463e3b0045c7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:27.137506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958b694-cfe4-44ba-a342-4294449e394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:27.138151 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958b694-cfe4-44ba-a342-4294449e394d admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:27.138435 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958b694-cfe4-44ba-a342-4294449e394d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:27.138743 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958b694-cfe4-44ba-a342-4294449e394d admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:27.139458 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958b694-cfe4-44ba-a342-4294449e394d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:27.140444 dv-cinder-836072-5-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-b958b694-cfe4-44ba-a342-4294449e394d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:38:27.140444 dv-cinder-836072-5-smb devstack@keystone.service[80420]: warnings.warn(msg) May 26 16:38:27.140444 dv-cinder-836072-5-smb devstack@keystone.service[80420]: May 26 16:38:27.141331 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958b694-cfe4-44ba-a342-4294449e394d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:27.154294 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 760/1500] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:38:27 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:38:27.158265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225e0ba-54ee-430b-a44e-da4a5e60cd23 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:27.168618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225e0ba-54ee-430b-a44e-da4a5e60cd23 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:27.174023 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec3221-0d02-460c-b498-99565f0f5134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:27.175000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec3221-0d02-460c-b498-99565f0f5134 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:27.175351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec3221-0d02-460c-b498-99565f0f5134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:27.175584 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec3221-0d02-460c-b498-99565f0f5134 admin admin] PATH_INFO: `/v3/projects/f3bba96fdf524259bb5f65630fb01394/users/b9439289101f402796ed9aa8080ae2ab/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:27.191561 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec3221-0d02-460c-b498-99565f0f5134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3bba96fdf524259bb5f65630fb01394, user_id=b9439289101f402796ed9aa8080ae2ab, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:27.192602 dv-cinder-836072-5-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-a0ec3221-0d02-460c-b498-99565f0f5134 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:38:27.192602 dv-cinder-836072-5-smb devstack@keystone.service[80419]: warnings.warn(msg) May 26 16:38:27.192602 dv-cinder-836072-5-smb devstack@keystone.service[80419]: May 26 16:38:27.194531 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec3221-0d02-460c-b498-99565f0f5134 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:27.207654 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 741/1501] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:38:27 2022] PUT /identity/v3/projects/f3bba96fdf524259bb5f65630fb01394/users/b9439289101f402796ed9aa8080ae2ab/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:38:27.219187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22b55a-323c-4e3d-9cc4-a647939925b4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:27.219498 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22b55a-323c-4e3d-9cc4-a647939925b4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:27.219764 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22b55a-323c-4e3d-9cc4-a647939925b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:27.246149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7a22b55a-323c-4e3d-9cc4-a647939925b4 None None] MFA Rules not processed for user `b9439289101f402796ed9aa8080ae2ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:38:27.247409 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7a22b55a-323c-4e3d-9cc4-a647939925b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:27.311287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 761/1502] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:38:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:38:27.324647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57367ce3-9731-4176-8f4e-1374b31c5840 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:27.324942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57367ce3-9731-4176-8f4e-1374b31c5840 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:27.325227 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57367ce3-9731-4176-8f4e-1374b31c5840 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:27.326655 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 742/1503] 10.222.0.110 () {54 vars in 968 bytes} [Thu May 26 16:38:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:38:27.331830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00338361-d91a-4939-a77c-bc46a7141855 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:27.332125 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00338361-d91a-4939-a77c-bc46a7141855 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:27.332407 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00338361-d91a-4939-a77c-bc46a7141855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:27.352051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-00338361-d91a-4939-a77c-bc46a7141855 None None] MFA Rules not processed for user `7ac42de1401441c0a3d4e7239e9b020e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:38:27.353186 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-00338361-d91a-4939-a77c-bc46a7141855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:27.396722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:27.406715 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 762/1504] 10.222.0.110 () {58 vars in 1065 bytes} [Thu May 26 16:38:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:38:27.413443 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57367ce3-9731-4176-8f4e-1374b31c5840 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:27.424002 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57367ce3-9731-4176-8f4e-1374b31c5840 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:27.427528 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c6942-0c89-45fb-bcfe-78ae5c974dda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:27.428170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c6942-0c89-45fb-bcfe-78ae5c974dda service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:27.428456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c6942-0c89-45fb-bcfe-78ae5c974dda service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:27.428737 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c6942-0c89-45fb-bcfe-78ae5c974dda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:27.436840 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c6942-0c89-45fb-bcfe-78ae5c974dda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:27.438270 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c6942-0c89-45fb-bcfe-78ae5c974dda service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:27.446915 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 743/1505] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:38:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:38:27.489150 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e160d-2035-4b98-982d-d155de5431d9 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:27.489447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e160d-2035-4b98-982d-d155de5431d9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:27.489733 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e160d-2035-4b98-982d-d155de5431d9 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:27.491162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 763/1506] 10.222.0.110 () {52 vars in 834 bytes} [Thu May 26 16:38:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:38:27.494647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c6942-0c89-45fb-bcfe-78ae5c974dda service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:27.555218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c6942-0c89-45fb-bcfe-78ae5c974dda service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:27.559729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddbdd4-2000-49f0-a256-098ea06ffdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:27.560608 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddbdd4-2000-49f0-a256-098ea06ffdf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:27.560893 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddbdd4-2000-49f0-a256-098ea06ffdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:27.561171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddbdd4-2000-49f0-a256-098ea06ffdf8 admin admin] PATH_INFO: `/v3/users/b9439289101f402796ed9aa8080ae2ab` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:27.562348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddbdd4-2000-49f0-a256-098ea06ffdf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9439289101f402796ed9aa8080ae2ab)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:27.563424 dv-cinder-836072-5-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-a2ddbdd4-2000-49f0-a256-098ea06ffdf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:38:27.563424 dv-cinder-836072-5-smb devstack@keystone.service[80419]: warnings.warn(msg) May 26 16:38:27.563424 dv-cinder-836072-5-smb devstack@keystone.service[80419]: May 26 16:38:27.564629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddbdd4-2000-49f0-a256-098ea06ffdf8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:27.628571 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a2ddbdd4-2000-49f0-a256-098ea06ffdf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9439289101f402796ed9aa8080ae2ab'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:38:27.629138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a2ddbdd4-2000-49f0-a256-098ea06ffdf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9439289101f402796ed9aa8080ae2ab'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:38:27.641536 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a2ddbdd4-2000-49f0-a256-098ea06ffdf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9439289101f402796ed9aa8080ae2ab'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:38:27.642298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a2ddbdd4-2000-49f0-a256-098ea06ffdf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9439289101f402796ed9aa8080ae2ab'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:38:27.651391 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a2ddbdd4-2000-49f0-a256-098ea06ffdf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9439289101f402796ed9aa8080ae2ab'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:38:27.667959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:27.676988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 744/1507] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:38:27 2022] DELETE /identity/v3/users/b9439289101f402796ed9aa8080ae2ab => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:38:27.681567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf424262-5600-4f10-a09e-dba6844437cd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:27.681863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf424262-5600-4f10-a09e-dba6844437cd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:27.682393 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf424262-5600-4f10-a09e-dba6844437cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:27.699741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-bf424262-5600-4f10-a09e-dba6844437cd None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:38:27.700929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bf424262-5600-4f10-a09e-dba6844437cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:27.759209 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 764/1508] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:38:27.768582 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddbdd4-2000-49f0-a256-098ea06ffdf8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:27.769991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a2ddbdd4-2000-49f0-a256-098ea06ffdf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:27.827653 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddbdd4-2000-49f0-a256-098ea06ffdf8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:27.831294 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad372a1-5b7d-4278-af3a-cd97933036b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:27.831950 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad372a1-5b7d-4278-af3a-cd97933036b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:27.832241 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad372a1-5b7d-4278-af3a-cd97933036b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:27.832523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad372a1-5b7d-4278-af3a-cd97933036b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:27.842126 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad372a1-5b7d-4278-af3a-cd97933036b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:27.843596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad372a1-5b7d-4278-af3a-cd97933036b7 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:27.853567 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 745/1509] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:38:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:38:28.208239 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf424262-5600-4f10-a09e-dba6844437cd None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:28.210075 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bf424262-5600-4f10-a09e-dba6844437cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:28.223619 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf424262-5600-4f10-a09e-dba6844437cd None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:28.228958 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba9b1b-e1f0-476e-b78e-845eec4b07b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:28.229834 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba9b1b-e1f0-476e-b78e-845eec4b07b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:28.230125 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba9b1b-e1f0-476e-b78e-845eec4b07b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:28.230407 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba9b1b-e1f0-476e-b78e-845eec4b07b7 admin admin] PATH_INFO: `/v3/projects/f3bba96fdf524259bb5f65630fb01394` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:28.231634 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba9b1b-e1f0-476e-b78e-845eec4b07b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3bba96fdf524259bb5f65630fb01394)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:28.232662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-39ba9b1b-e1f0-476e-b78e-845eec4b07b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:38:28.232662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: warnings.warn(msg) May 26 16:38:28.232662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: May 26 16:38:28.233890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba9b1b-e1f0-476e-b78e-845eec4b07b7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:28.295300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-39ba9b1b-e1f0-476e-b78e-845eec4b07b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3bba96fdf524259bb5f65630fb01394', 'request_id': 'req-39ba9b1b-e1f0-476e-b78e-845eec4b07b7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:38:28.309078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-39ba9b1b-e1f0-476e-b78e-845eec4b07b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3bba96fdf524259bb5f65630fb01394', 'request_id': 'req-39ba9b1b-e1f0-476e-b78e-845eec4b07b7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:38:28.315131 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-39ba9b1b-e1f0-476e-b78e-845eec4b07b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3bba96fdf524259bb5f65630fb01394', 'request_id': 'req-39ba9b1b-e1f0-476e-b78e-845eec4b07b7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:38:28.330061 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-39ba9b1b-e1f0-476e-b78e-845eec4b07b7 admin admin] The token cache is being invalidate because project f3bba96fdf524259bb5f65630fb01394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:38:28.330358 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-39ba9b1b-e1f0-476e-b78e-845eec4b07b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:38:28.331009 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-39ba9b1b-e1f0-476e-b78e-845eec4b07b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:38:28.332643 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 765/1510] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:38:28 2022] DELETE /identity/v3/projects/f3bba96fdf524259bb5f65630fb01394 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:38:37.848801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:38.326929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:21.765056 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c991a96-e45f-4189-aae2-ef0016df7f1b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:21.765757 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c991a96-e45f-4189-aae2-ef0016df7f1b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:21.766084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c991a96-e45f-4189-aae2-ef0016df7f1b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:21.768410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:40:21 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:40:21.774097 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba961c50-bced-4897-ace5-3ce822373882 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:21.774942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba961c50-bced-4897-ace5-3ce822373882 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:21.774942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba961c50-bced-4897-ace5-3ce822373882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:21.796066 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ba961c50-bced-4897-ace5-3ce822373882 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:21.797326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ba961c50-bced-4897-ace5-3ce822373882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:21.885558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:22.155885 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c991a96-e45f-4189-aae2-ef0016df7f1b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:22.157735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4c991a96-e45f-4189-aae2-ef0016df7f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:22.260578 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c991a96-e45f-4189-aae2-ef0016df7f1b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:22.268580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86593bd-1f99-47b0-9901-718bb38598dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:22.269496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86593bd-1f99-47b0-9901-718bb38598dd service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:22.269890 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86593bd-1f99-47b0-9901-718bb38598dd service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:22.270274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86593bd-1f99-47b0-9901-718bb38598dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:22.283289 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86593bd-1f99-47b0-9901-718bb38598dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:22.285663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86593bd-1f99-47b0-9901-718bb38598dd service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:22.298862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 747/1513] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:40:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:40:23.244790 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba63b5c-3a54-4d36-bd83-d096bea02bd0 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:23.245386 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba63b5c-3a54-4d36-bd83-d096bea02bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:23.245866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba63b5c-3a54-4d36-bd83-d096bea02bd0 None None] PATH_INFO: `/v3` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:23.248756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 767/1514] 10.222.0.117 () {54 vars in 930 bytes} [Thu May 26 16:40:23 2022] GET /identity/v3 => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:40:23.256383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be21c56-33c6-423b-8fb7-4f092f7037a4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:23.256950 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be21c56-33c6-423b-8fb7-4f092f7037a4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:23.256950 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be21c56-33c6-423b-8fb7-4f092f7037a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:23.266000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f080c5e-f4ff-4d6e-9cfd-dedb8f8503c8 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:23.266358 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f080c5e-f4ff-4d6e-9cfd-dedb8f8503c8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:23.266593 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f080c5e-f4ff-4d6e-9cfd-dedb8f8503c8 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:23.269053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 768/1515] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:40:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:40:23.274268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed21c0-84b3-4689-9967-0afb9a2e067e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:23.274714 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed21c0-84b3-4689-9967-0afb9a2e067e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:23.275019 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed21c0-84b3-4689-9967-0afb9a2e067e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:23.287741 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8be21c56-33c6-423b-8fb7-4f092f7037a4 None None] MFA Rules not processed for user `9ffef7640dd1487ab2ea91fc0f4be9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:23.289129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8be21c56-33c6-423b-8fb7-4f092f7037a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:23.297329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c5ed21c0-84b3-4689-9967-0afb9a2e067e None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:23.298930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c5ed21c0-84b3-4689-9967-0afb9a2e067e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:23.308585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 769/1516] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:40:23.407244 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 748/1517] 10.222.0.117 () {58 vars in 1020 bytes} [Thu May 26 16:40:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:40:23.473012 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed21c0-84b3-4689-9967-0afb9a2e067e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:23.493235 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed21c0-84b3-4689-9967-0afb9a2e067e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:23.501110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c89b96-c2a6-4cb6-a8b7-6bc7e64b68b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:23.501917 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c89b96-c2a6-4cb6-a8b7-6bc7e64b68b3 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:23.502257 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c89b96-c2a6-4cb6-a8b7-6bc7e64b68b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:23.502544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c89b96-c2a6-4cb6-a8b7-6bc7e64b68b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:23.515818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c89b96-c2a6-4cb6-a8b7-6bc7e64b68b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:23.517477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c89b96-c2a6-4cb6-a8b7-6bc7e64b68b3 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:23.528661 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 770/1518] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:40:32.514523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88b6aa-a078-4a2b-b425-a0403ea19e00 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:32.515097 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88b6aa-a078-4a2b-b425-a0403ea19e00 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:32.515206 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88b6aa-a078-4a2b-b425-a0403ea19e00 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:32.516496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 749/1519] 10.222.0.110 () {54 vars in 965 bytes} [Thu May 26 16:40:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:40:32.521517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e38168-710f-4dfb-bc6e-94cd97312209 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:32.521919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e38168-710f-4dfb-bc6e-94cd97312209 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:32.522143 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e38168-710f-4dfb-bc6e-94cd97312209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:32.540238 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-20e38168-710f-4dfb-bc6e-94cd97312209 None None] MFA Rules not processed for user `9ffef7640dd1487ab2ea91fc0f4be9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:32.541455 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-20e38168-710f-4dfb-bc6e-94cd97312209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:32.550359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 771/1520] 10.222.0.110 () {58 vars in 1062 bytes} [Thu May 26 16:40:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:32.557829 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88b6aa-a078-4a2b-b425-a0403ea19e00 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:32.571374 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88b6aa-a078-4a2b-b425-a0403ea19e00 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:32.577299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50ac08-5a88-4c0e-aa3b-aaa0b0a08fab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ffef7640dd1487ab2ea91fc0f4be9e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:32.577934 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50ac08-5a88-4c0e-aa3b-aaa0b0a08fab service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:32.578220 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50ac08-5a88-4c0e-aa3b-aaa0b0a08fab service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:32.578500 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50ac08-5a88-4c0e-aa3b-aaa0b0a08fab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:32.587031 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50ac08-5a88-4c0e-aa3b-aaa0b0a08fab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:32.588601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50ac08-5a88-4c0e-aa3b-aaa0b0a08fab service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:32.598645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 750/1521] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:40:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:40:34.985461 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84989f-ff5f-4a24-a69f-c2cfc5e811a8 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:34.986013 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84989f-ff5f-4a24-a69f-c2cfc5e811a8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:34.986013 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84989f-ff5f-4a24-a69f-c2cfc5e811a8 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:34.987440 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:40:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:40:34.992486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fd9ca-5080-4e4c-96ec-58b3d34bf3ad None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:34.992953 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fd9ca-5080-4e4c-96ec-58b3d34bf3ad None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:34.993055 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fd9ca-5080-4e4c-96ec-58b3d34bf3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:35.011212 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-224fd9ca-5080-4e4c-96ec-58b3d34bf3ad None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:35.012415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-224fd9ca-5080-4e4c-96ec-58b3d34bf3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:35.020173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:35.173194 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84989f-ff5f-4a24-a69f-c2cfc5e811a8 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:35.189883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84989f-ff5f-4a24-a69f-c2cfc5e811a8 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:35.195556 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e8789-3afe-4d73-be81-1736edd8c9d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:35.196230 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e8789-3afe-4d73-be81-1736edd8c9d7 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:35.196521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e8789-3afe-4d73-be81-1736edd8c9d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:35.196805 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e8789-3afe-4d73-be81-1736edd8c9d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:35.206004 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e8789-3afe-4d73-be81-1736edd8c9d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:35.207845 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e8789-3afe-4d73-be81-1736edd8c9d7 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:35.217239 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 773/1524] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:40:36.089881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba4866-c684-4cea-a1d7-4e1479d02b6b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:36.090458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba4866-c684-4cea-a1d7-4e1479d02b6b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:36.090458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba4866-c684-4cea-a1d7-4e1479d02b6b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:36.092009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:40:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:40:36.096769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e05be-bda1-4dc7-ba5c-8d7c5d8465e2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:36.097183 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e05be-bda1-4dc7-ba5c-8d7c5d8465e2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:36.097367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e05be-bda1-4dc7-ba5c-8d7c5d8465e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:36.115986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-206e05be-bda1-4dc7-ba5c-8d7c5d8465e2 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:36.117134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-206e05be-bda1-4dc7-ba5c-8d7c5d8465e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:36.126183 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:36.277568 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba4866-c684-4cea-a1d7-4e1479d02b6b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:36.292765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba4866-c684-4cea-a1d7-4e1479d02b6b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:36.298163 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55441e8-b194-4c51-bcd8-ad22678f59f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:36.298845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55441e8-b194-4c51-bcd8-ad22678f59f5 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:36.299134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55441e8-b194-4c51-bcd8-ad22678f59f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:36.299414 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55441e8-b194-4c51-bcd8-ad22678f59f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:36.307557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55441e8-b194-4c51-bcd8-ad22678f59f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:36.309136 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55441e8-b194-4c51-bcd8-ad22678f59f5 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:36.318469 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 753/1527] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:40:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:40:40.553910 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139cbce-933c-4500-90ce-3eb321c703c6 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:40.554383 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139cbce-933c-4500-90ce-3eb321c703c6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:40.554489 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139cbce-933c-4500-90ce-3eb321c703c6 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:40.555953 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:40:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:40:40.561177 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07204d5b-a1d9-4552-bdf4-f60016d43496 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:40.561568 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07204d5b-a1d9-4552-bdf4-f60016d43496 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:40.561728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07204d5b-a1d9-4552-bdf4-f60016d43496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:40.579840 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-07204d5b-a1d9-4552-bdf4-f60016d43496 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:40.581053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-07204d5b-a1d9-4552-bdf4-f60016d43496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:40.589424 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:40.625411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139cbce-933c-4500-90ce-3eb321c703c6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:40.627037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d139cbce-933c-4500-90ce-3eb321c703c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:40.684587 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139cbce-933c-4500-90ce-3eb321c703c6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:40.688060 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009c937-60d3-482f-9e70-bd5f481e5aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:40.688710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009c937-60d3-482f-9e70-bd5f481e5aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:40.688995 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009c937-60d3-482f-9e70-bd5f481e5aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:40.689274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009c937-60d3-482f-9e70-bd5f481e5aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:40.698054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009c937-60d3-482f-9e70-bd5f481e5aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:40.699512 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009c937-60d3-482f-9e70-bd5f481e5aa7 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:40.709025 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 776/1530] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:40:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:40:42.899337 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3525c4-42fa-4b2b-b99c-f99eb7e0e5e9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:42.899906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3525c4-42fa-4b2b-b99c-f99eb7e0e5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:42.899906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3525c4-42fa-4b2b-b99c-f99eb7e0e5e9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:42.901314 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:40:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:40:42.906493 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94c9dc-2e5e-43c7-a421-2a9d0ff9de20 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:42.906909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94c9dc-2e5e-43c7-a421-2a9d0ff9de20 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:42.907086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94c9dc-2e5e-43c7-a421-2a9d0ff9de20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:42.925259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0c94c9dc-2e5e-43c7-a421-2a9d0ff9de20 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:42.926471 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0c94c9dc-2e5e-43c7-a421-2a9d0ff9de20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:42.934789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:42.969914 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3525c4-42fa-4b2b-b99c-f99eb7e0e5e9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:42.980793 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3525c4-42fa-4b2b-b99c-f99eb7e0e5e9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:42.984365 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98ff3e-28c5-45d4-9863-e08deeaec4d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:42.985002 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98ff3e-28c5-45d4-9863-e08deeaec4d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:42.985307 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98ff3e-28c5-45d4-9863-e08deeaec4d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:42.985587 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98ff3e-28c5-45d4-9863-e08deeaec4d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:42.994991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98ff3e-28c5-45d4-9863-e08deeaec4d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:42.996417 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98ff3e-28c5-45d4-9863-e08deeaec4d4 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:43.005865 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 756/1533] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:40:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:40:47.050517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72811aaf-25ea-43a9-9a49-f235d02b91eb None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:47.051276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72811aaf-25ea-43a9-9a49-f235d02b91eb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:47.051426 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72811aaf-25ea-43a9-9a49-f235d02b91eb None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:47.052733 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:40:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:40:47.059349 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967517b-9683-4564-afd3-66502feaf8b0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:47.059762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967517b-9683-4564-afd3-66502feaf8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:47.059906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967517b-9683-4564-afd3-66502feaf8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:47.080541 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7967517b-9683-4564-afd3-66502feaf8b0 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:47.081734 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7967517b-9683-4564-afd3-66502feaf8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:47.091048 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:47.362338 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72811aaf-25ea-43a9-9a49-f235d02b91eb None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:47.364059 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-72811aaf-25ea-43a9-9a49-f235d02b91eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:47.421764 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72811aaf-25ea-43a9-9a49-f235d02b91eb None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:47.425314 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168859d-c129-430f-a904-140b5fab1459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:47.425967 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168859d-c129-430f-a904-140b5fab1459 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:47.426258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168859d-c129-430f-a904-140b5fab1459 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:47.426541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168859d-c129-430f-a904-140b5fab1459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:47.433086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:47.437604 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168859d-c129-430f-a904-140b5fab1459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:47.439070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168859d-c129-430f-a904-140b5fab1459 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:47.449093 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 779/1536] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:40:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:40:49.701076 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8863286-171e-4585-8263-2faf7c6b4f35 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:49.701642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8863286-171e-4585-8263-2faf7c6b4f35 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:49.701642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8863286-171e-4585-8263-2faf7c6b4f35 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:49.703046 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:40:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:40:49.708307 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8a5a7-b5c3-41b5-b0c9-dcd4ddd7673c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:49.708764 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8a5a7-b5c3-41b5-b0c9-dcd4ddd7673c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:49.708870 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8a5a7-b5c3-41b5-b0c9-dcd4ddd7673c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:49.726498 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d8f8a5a7-b5c3-41b5-b0c9-dcd4ddd7673c None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:49.727701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d8f8a5a7-b5c3-41b5-b0c9-dcd4ddd7673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:49.735322 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:50.012479 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8863286-171e-4585-8263-2faf7c6b4f35 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:50.014217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d8863286-171e-4585-8263-2faf7c6b4f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:50.021703 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:50.028213 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8863286-171e-4585-8263-2faf7c6b4f35 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:50.031670 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2f8a4-52dc-445b-b0e4-0059149f9260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:50.032309 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2f8a4-52dc-445b-b0e4-0059149f9260 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:50.032593 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2f8a4-52dc-445b-b0e4-0059149f9260 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:50.032872 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2f8a4-52dc-445b-b0e4-0059149f9260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:50.042189 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2f8a4-52dc-445b-b0e4-0059149f9260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:50.043651 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2f8a4-52dc-445b-b0e4-0059149f9260 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:50.052937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 759/1539] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:40:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:40:59.721355 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=6 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:00.048801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:22.337504 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d052b-4b9a-4961-b757-23c81800c3e1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.338154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d052b-4b9a-4961-b757-23c81800c3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.338154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d052b-4b9a-4961-b757-23c81800c3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.353805 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca82b8c-6a15-4faa-971f-925418b2a23b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.354902 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca82b8c-6a15-4faa-971f-925418b2a23b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.355573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca82b8c-6a15-4faa-971f-925418b2a23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.378280 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6ca82b8c-6a15-4faa-971f-925418b2a23b None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:22.381983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b06d052b-4b9a-4961-b757-23c81800c3e1 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:22.383235 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b06d052b-4b9a-4961-b757-23c81800c3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:22.383371 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6ca82b8c-6a15-4faa-971f-925418b2a23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:22.400801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 781/1540] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:22.406225 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 760/1541] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:22.421644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a0fab-389c-4c4e-9bc5-0db9a3052327 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.421998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a0fab-389c-4c4e-9bc5-0db9a3052327 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.422205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a0fab-389c-4c4e-9bc5-0db9a3052327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.425039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d92388-f221-43c5-831c-822906999c12 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.425358 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d92388-f221-43c5-831c-822906999c12 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.425608 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d92388-f221-43c5-831c-822906999c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.452516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6c1a0fab-389c-4c4e-9bc5-0db9a3052327 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:22.453580 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6c1a0fab-389c-4c4e-9bc5-0db9a3052327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:22.455610 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e3d92388-f221-43c5-831c-822906999c12 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:22.457009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e3d92388-f221-43c5-831c-822906999c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:22.473107 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 782/1542] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:22.477345 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 761/1543] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:22.477885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a0fab-389c-4c4e-9bc5-0db9a3052327 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:22.482243 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d92388-f221-43c5-831c-822906999c12 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:22.493397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a0fab-389c-4c4e-9bc5-0db9a3052327 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:22.496872 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d92388-f221-43c5-831c-822906999c12 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:22.505757 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa2073-79ed-48cb-ace8-5d842682dd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:22.506453 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa2073-79ed-48cb-ace8-5d842682dd06 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.506856 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa2073-79ed-48cb-ace8-5d842682dd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.507132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa2073-79ed-48cb-ace8-5d842682dd06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.508202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca16505-cbda-462a-b642-fd1e94a136b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:22.508884 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca16505-cbda-462a-b642-fd1e94a136b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.509153 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca16505-cbda-462a-b642-fd1e94a136b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.509422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca16505-cbda-462a-b642-fd1e94a136b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.510237 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca16505-cbda-462a-b642-fd1e94a136b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:22.510459 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca16505-cbda-462a-b642-fd1e94a136b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:22.512130 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca16505-cbda-462a-b642-fd1e94a136b4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:22.514344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa2073-79ed-48cb-ace8-5d842682dd06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:22.514837 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa2073-79ed-48cb-ace8-5d842682dd06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:22.516084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-30aa2073-79ed-48cb-ace8-5d842682dd06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:42:22.516084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: warnings.warn(msg) May 26 16:42:22.516084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: May 26 16:42:22.516987 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa2073-79ed-48cb-ace8-5d842682dd06 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:22.539840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 783/1544] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:42:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:22.541000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7be40-a2fb-49f6-9513-ff75ad8772d6 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.541300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7be40-a2fb-49f6-9513-ff75ad8772d6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.541572 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7be40-a2fb-49f6-9513-ff75ad8772d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.545413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 762/1545] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:42:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:22.551870 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa2073-79ed-48cb-ace8-5d842682dd06 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:22.576390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa2073-79ed-48cb-ace8-5d842682dd06 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:22.591458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183db60-dcce-430b-b249-3717d2053385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:22.592070 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183db60-dcce-430b-b249-3717d2053385 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.592352 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183db60-dcce-430b-b249-3717d2053385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.593181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183db60-dcce-430b-b249-3717d2053385 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.593871 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183db60-dcce-430b-b249-3717d2053385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:22.597205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-40f7be40-a2fb-49f6-9513-ff75ad8772d6 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:22.598407 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-40f7be40-a2fb-49f6-9513-ff75ad8772d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:22.602632 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183db60-dcce-430b-b249-3717d2053385 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:22.623127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 784/1546] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:22.624284 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7be40-a2fb-49f6-9513-ff75ad8772d6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:22.638378 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 763/1547] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:22 2022] POST /identity/v3/projects => generated 384 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:22.641749 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c8d09-7acd-43f9-b912-8c3f7e1c6339 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.642252 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c8d09-7acd-43f9-b912-8c3f7e1c6339 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.644682 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c8d09-7acd-43f9-b912-8c3f7e1c6339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.652441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7be40-a2fb-49f6-9513-ff75ad8772d6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:22.683729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-986c8d09-7acd-43f9-b912-8c3f7e1c6339 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:22.685407 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-986c8d09-7acd-43f9-b912-8c3f7e1c6339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:22.741778 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80b4d0-fb28-4285-b56f-248882381b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:22.742458 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80b4d0-fb28-4285-b56f-248882381b4e admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.742774 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80b4d0-fb28-4285-b56f-248882381b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.743058 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80b4d0-fb28-4285-b56f-248882381b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.743871 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80b4d0-fb28-4285-b56f-248882381b4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:22.744899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-9f80b4d0-fb28-4285-b56f-248882381b4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:42:22.744899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: warnings.warn(msg) May 26 16:42:22.744899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: May 26 16:42:22.747952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80b4d0-fb28-4285-b56f-248882381b4e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:22.771261 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 764/1548] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:22.772574 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642e06a-f06e-4c95-892d-03aa6ade6ea0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.772869 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642e06a-f06e-4c95-892d-03aa6ade6ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.773150 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642e06a-f06e-4c95-892d-03aa6ade6ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.780713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 785/1549] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:22 2022] POST /identity/v3/projects => generated 386 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:22.782301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84801eaf-fd68-4348-b1d9-b71e72a78c04 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.782681 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84801eaf-fd68-4348-b1d9-b71e72a78c04 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.783722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84801eaf-fd68-4348-b1d9-b71e72a78c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.799892 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c642e06a-f06e-4c95-892d-03aa6ade6ea0 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:22.801364 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c642e06a-f06e-4c95-892d-03aa6ade6ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:22.804430 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-84801eaf-fd68-4348-b1d9-b71e72a78c04 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:22.805840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-84801eaf-fd68-4348-b1d9-b71e72a78c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:22.866116 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 765/1550] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:22.866996 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642e06a-f06e-4c95-892d-03aa6ade6ea0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:22.871290 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 786/1551] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:22.871290 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3e73c-5783-4239-87f6-a7094e6d7714 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.871290 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3e73c-5783-4239-87f6-a7094e6d7714 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.871290 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3e73c-5783-4239-87f6-a7094e6d7714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.877132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642e06a-f06e-4c95-892d-03aa6ade6ea0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:22.881664 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd4412-410c-419d-a9de-01d119a9ebe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:22.882333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd4412-410c-419d-a9de-01d119a9ebe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.882644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd4412-410c-419d-a9de-01d119a9ebe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.882923 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd4412-410c-419d-a9de-01d119a9ebe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.883608 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd4412-410c-419d-a9de-01d119a9ebe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:22.884628 dv-cinder-836072-5-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-dffd4412-410c-419d-a9de-01d119a9ebe1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:42:22.884628 dv-cinder-836072-5-smb devstack@keystone.service[80419]: warnings.warn(msg) May 26 16:42:22.884628 dv-cinder-836072-5-smb devstack@keystone.service[80419]: May 26 16:42:22.885822 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd4412-410c-419d-a9de-01d119a9ebe1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:22.892305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1de3e73c-5783-4239-87f6-a7094e6d7714 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:22.893522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1de3e73c-5783-4239-87f6-a7094e6d7714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:22.902214 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 787/1552] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:22.903565 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a00e0-f45d-4374-a31c-2cc4d7c9414a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.903866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a00e0-f45d-4374-a31c-2cc4d7c9414a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.904146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a00e0-f45d-4374-a31c-2cc4d7c9414a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.917621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 766/1553] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:22 2022] POST /identity/v3/users => generated 293 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:22.919394 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a8d3a-015a-47e3-a2d5-c866552931e6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.919941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a8d3a-015a-47e3-a2d5-c866552931e6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.920494 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a8d3a-015a-47e3-a2d5-c866552931e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.922696 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-235a00e0-f45d-4374-a31c-2cc4d7c9414a None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:22.923904 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-235a00e0-f45d-4374-a31c-2cc4d7c9414a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:22.932242 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 788/1554] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:22.933074 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a00e0-f45d-4374-a31c-2cc4d7c9414a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:22.944330 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a00e0-f45d-4374-a31c-2cc4d7c9414a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:22.947189 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5f4a8d3a-015a-47e3-a2d5-c866552931e6 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:22.948426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5f4a8d3a-015a-47e3-a2d5-c866552931e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:22.948922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f5061-e068-465e-961e-0679e75c0f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:22.949850 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f5061-e068-465e-961e-0679e75c0f63 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.950133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f5061-e068-465e-961e-0679e75c0f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.950411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f5061-e068-465e-961e-0679e75c0f63 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.951175 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f5061-e068-465e-961e-0679e75c0f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:22.953689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f5061-e068-465e-961e-0679e75c0f63 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:22.958555 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 767/1555] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:22.959844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e6b68-a3f6-41ad-856e-b4f62af465e9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.960138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e6b68-a3f6-41ad-856e-b4f62af465e9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.960564 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e6b68-a3f6-41ad-856e-b4f62af465e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.979042 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 789/1556] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:22 2022] POST /identity/v3/users => generated 294 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:22.979042 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f5061-e068-465e-961e-0679e75c0f63 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:22.979362 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-294e6b68-a3f6-41ad-856e-b4f62af465e9 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:22.980397 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-294e6b68-a3f6-41ad-856e-b4f62af465e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:22.988469 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 768/1557] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:22.989206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f5061-e068-465e-961e-0679e75c0f63 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:22.989703 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674c0df-6cb2-40b9-aa96-8985b5109dc2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.990068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674c0df-6cb2-40b9-aa96-8985b5109dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.990265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674c0df-6cb2-40b9-aa96-8985b5109dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.994422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d70aa-8776-4796-8b0c-d537d3be2423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:22.995155 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d70aa-8776-4796-8b0c-d537d3be2423 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.995444 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d70aa-8776-4796-8b0c-d537d3be2423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.995720 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d70aa-8776-4796-8b0c-d537d3be2423 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.996604 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d70aa-8776-4796-8b0c-d537d3be2423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:22.996827 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d70aa-8776-4796-8b0c-d537d3be2423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:22.998421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d70aa-8776-4796-8b0c-d537d3be2423 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.009183 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7674c0df-6cb2-40b9-aa96-8985b5109dc2 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:23.010396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7674c0df-6cb2-40b9-aa96-8985b5109dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:23.012610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 790/1558] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:42:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:23.016509 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0528f7-c522-42c2-8abd-438e39d19139 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.016926 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0528f7-c522-42c2-8abd-438e39d19139 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.017335 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0528f7-c522-42c2-8abd-438e39d19139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.019387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 769/1559] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:23.023438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674c0df-6cb2-40b9-aa96-8985b5109dc2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.032864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674c0df-6cb2-40b9-aa96-8985b5109dc2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.035951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3f0528f7-c522-42c2-8abd-438e39d19139 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:23.037179 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3f0528f7-c522-42c2-8abd-438e39d19139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:23.037338 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65a727-4f98-4ca1-97ad-2b1b77b4ddc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.037996 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65a727-4f98-4ca1-97ad-2b1b77b4ddc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.038279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65a727-4f98-4ca1-97ad-2b1b77b4ddc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.038550 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65a727-4f98-4ca1-97ad-2b1b77b4ddc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.039294 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65a727-4f98-4ca1-97ad-2b1b77b4ddc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.040875 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65a727-4f98-4ca1-97ad-2b1b77b4ddc1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.045752 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 791/1560] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:23.047008 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21706637-6ee5-4b0c-a884-84db8853f92a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.047304 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21706637-6ee5-4b0c-a884-84db8853f92a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.047594 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21706637-6ee5-4b0c-a884-84db8853f92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.051398 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 770/1561] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:23 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:23.052103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65a727-4f98-4ca1-97ad-2b1b77b4ddc1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.053836 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:23.058978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:23.063762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65a727-4f98-4ca1-97ad-2b1b77b4ddc1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.068523 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-21706637-6ee5-4b0c-a884-84db8853f92a None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:23.069986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-21706637-6ee5-4b0c-a884-84db8853f92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:23.070135 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb053cb-994a-4b6d-a9a6-f80cbcd44347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.070741 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb053cb-994a-4b6d-a9a6-f80cbcd44347 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.071029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb053cb-994a-4b6d-a9a6-f80cbcd44347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.071302 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb053cb-994a-4b6d-a9a6-f80cbcd44347 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.072019 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb053cb-994a-4b6d-a9a6-f80cbcd44347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:23.072322 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb053cb-994a-4b6d-a9a6-f80cbcd44347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.073903 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb053cb-994a-4b6d-a9a6-f80cbcd44347 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.078631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 792/1562] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:23.079427 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21706637-6ee5-4b0c-a884-84db8853f92a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.088820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21706637-6ee5-4b0c-a884-84db8853f92a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.097293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 771/1563] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:42:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:23.097293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f2f3-3797-4f0a-9980-ce451d58933b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.097293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f2f3-3797-4f0a-9980-ce451d58933b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.097293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f2f3-3797-4f0a-9980-ce451d58933b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.100807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b152823-7cbb-45ee-aa18-024b554fdc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.101478 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b152823-7cbb-45ee-aa18-024b554fdc60 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.101764 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b152823-7cbb-45ee-aa18-024b554fdc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.102044 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b152823-7cbb-45ee-aa18-024b554fdc60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.102806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b152823-7cbb-45ee-aa18-024b554fdc60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.104465 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b152823-7cbb-45ee-aa18-024b554fdc60 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.109139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6043f2f3-3797-4f0a-9980-ce451d58933b None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:23.110327 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6043f2f3-3797-4f0a-9980-ce451d58933b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:23.118068 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 793/1564] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:23 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:23.118068 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b152823-7cbb-45ee-aa18-024b554fdc60 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.118596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 772/1565] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:23.122179 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043f2f3-3797-4f0a-9980-ce451d58933b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.128986 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043f2f3-3797-4f0a-9980-ce451d58933b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.132030 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b152823-7cbb-45ee-aa18-024b554fdc60 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.133406 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedebcdb-a050-4b52-9521-ed75d559a47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.134043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedebcdb-a050-4b52-9521-ed75d559a47e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.134325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedebcdb-a050-4b52-9521-ed75d559a47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.134625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedebcdb-a050-4b52-9521-ed75d559a47e admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.135342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedebcdb-a050-4b52-9521-ed75d559a47e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:23.135667 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedebcdb-a050-4b52-9521-ed75d559a47e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.137248 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedebcdb-a050-4b52-9521-ed75d559a47e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.137382 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71334f-cc85-420a-ae86-b49f3f607d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.138077 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71334f-cc85-420a-ae86-b49f3f607d15 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.138450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71334f-cc85-420a-ae86-b49f3f607d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.138988 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71334f-cc85-420a-ae86-b49f3f607d15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.140861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71334f-cc85-420a-ae86-b49f3f607d15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.142822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71334f-cc85-420a-ae86-b49f3f607d15 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.156434 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 773/1566] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:42:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:23.156434 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedebcdb-a050-4b52-9521-ed75d559a47e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.166559 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedebcdb-a050-4b52-9521-ed75d559a47e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.170968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 794/1567] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/projects => generated 386 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:23.171223 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e289b-a4df-4ff5-85ea-08fb88a3b17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.171945 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e289b-a4df-4ff5-85ea-08fb88a3b17f admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.172326 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e289b-a4df-4ff5-85ea-08fb88a3b17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.172525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71334f-cc85-420a-ae86-b49f3f607d15 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.172789 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e289b-a4df-4ff5-85ea-08fb88a3b17f admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.173606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e289b-a4df-4ff5-85ea-08fb88a3b17f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:23.174267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e289b-a4df-4ff5-85ea-08fb88a3b17f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.175885 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e289b-a4df-4ff5-85ea-08fb88a3b17f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.188727 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 774/1568] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:42:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:23.189665 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e289b-a4df-4ff5-85ea-08fb88a3b17f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.204217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e289b-a4df-4ff5-85ea-08fb88a3b17f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.245749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71334f-cc85-420a-ae86-b49f3f607d15 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.251082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed1f1f-43b5-4b30-a3f8-589b4aa06e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.251753 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed1f1f-43b5-4b30-a3f8-589b4aa06e4b admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.252039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed1f1f-43b5-4b30-a3f8-589b4aa06e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.252313 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed1f1f-43b5-4b30-a3f8-589b4aa06e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.253031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed1f1f-43b5-4b30-a3f8-589b4aa06e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.254675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed1f1f-43b5-4b30-a3f8-589b4aa06e4b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.265792 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 795/1569] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:23 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:23.265971 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424cac5-a8d1-43a6-b01f-17460e892847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.266441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed1f1f-43b5-4b30-a3f8-589b4aa06e4b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.266554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424cac5-a8d1-43a6-b01f-17460e892847 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.266845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424cac5-a8d1-43a6-b01f-17460e892847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.267054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424cac5-a8d1-43a6-b01f-17460e892847 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.267781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424cac5-a8d1-43a6-b01f-17460e892847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:23.268091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424cac5-a8d1-43a6-b01f-17460e892847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.269694 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424cac5-a8d1-43a6-b01f-17460e892847 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.284427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 775/1570] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:42:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:23.285369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424cac5-a8d1-43a6-b01f-17460e892847 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.286969 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed1f1f-43b5-4b30-a3f8-589b4aa06e4b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.293197 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6b0b2-3b85-4e38-b417-31892210c34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.293874 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6b0b2-3b85-4e38-b417-31892210c34c admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.294218 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6b0b2-3b85-4e38-b417-31892210c34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.294502 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6b0b2-3b85-4e38-b417-31892210c34c admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.295236 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6b0b2-3b85-4e38-b417-31892210c34c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.296217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424cac5-a8d1-43a6-b01f-17460e892847 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.297769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6b0b2-3b85-4e38-b417-31892210c34c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.300961 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dbcb9-fc75-44b8-85fe-f7f73adf3c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.301620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dbcb9-fc75-44b8-85fe-f7f73adf3c73 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.301903 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dbcb9-fc75-44b8-85fe-f7f73adf3c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.302210 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dbcb9-fc75-44b8-85fe-f7f73adf3c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.302959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2dbcb9-fc75-44b8-85fe-f7f73adf3c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.304533 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2dbcb9-fc75-44b8-85fe-f7f73adf3c73 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.316584 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 776/1571] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:23 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:23.317398 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dbcb9-fc75-44b8-85fe-f7f73adf3c73 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.329004 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 796/1572] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/projects => generated 372 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:23.329004 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6b0b2-3b85-4e38-b417-31892210c34c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.329295 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dbcb9-fc75-44b8-85fe-f7f73adf3c73 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.389477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70933cb2-5d1e-4fc9-96ff-9cca6360872a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.390159 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70933cb2-5d1e-4fc9-96ff-9cca6360872a admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.390450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70933cb2-5d1e-4fc9-96ff-9cca6360872a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.390764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70933cb2-5d1e-4fc9-96ff-9cca6360872a admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.391493 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70933cb2-5d1e-4fc9-96ff-9cca6360872a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:23.391805 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70933cb2-5d1e-4fc9-96ff-9cca6360872a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.393412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70933cb2-5d1e-4fc9-96ff-9cca6360872a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.393527 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6b0b2-3b85-4e38-b417-31892210c34c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.398043 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c3980-1ed5-463c-ba86-bcd5320c6bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.398730 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3980-1ed5-463c-ba86-bcd5320c6bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.399021 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3980-1ed5-463c-ba86-bcd5320c6bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.399302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3980-1ed5-463c-ba86-bcd5320c6bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.400031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c3980-1ed5-463c-ba86-bcd5320c6bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.401920 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c3980-1ed5-463c-ba86-bcd5320c6bb4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.405183 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 777/1573] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:42:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:23.406101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70933cb2-5d1e-4fc9-96ff-9cca6360872a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.416360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70933cb2-5d1e-4fc9-96ff-9cca6360872a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.421534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024f729-e50e-4e33-b5f6-bc095415c64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.422372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024f729-e50e-4e33-b5f6-bc095415c64d admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.422683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024f729-e50e-4e33-b5f6-bc095415c64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.423051 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024f729-e50e-4e33-b5f6-bc095415c64d admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.423821 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024f729-e50e-4e33-b5f6-bc095415c64d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.425926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024f729-e50e-4e33-b5f6-bc095415c64d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.432332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 797/1574] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/projects => generated 366 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:23.433128 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c3980-1ed5-463c-ba86-bcd5320c6bb4 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.449803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 778/1575] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/users => generated 294 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:23.449803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024f729-e50e-4e33-b5f6-bc095415c64d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.457105 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024f729-e50e-4e33-b5f6-bc095415c64d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.459663 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:23.469712 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:23.499331 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c3980-1ed5-463c-ba86-bcd5320c6bb4 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.504107 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d14a7-603c-4ecc-9d63-561805ff2aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.504838 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d14a7-603c-4ecc-9d63-561805ff2aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.505154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d14a7-603c-4ecc-9d63-561805ff2aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.505431 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d14a7-603c-4ecc-9d63-561805ff2aa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.506118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d14a7-603c-4ecc-9d63-561805ff2aa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.508098 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d14a7-603c-4ecc-9d63-561805ff2aa1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.516055 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0854ff-d06c-45d3-83f9-7ebc62230ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.516971 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0854ff-d06c-45d3-83f9-7ebc62230ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.517368 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0854ff-d06c-45d3-83f9-7ebc62230ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.517626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0854ff-d06c-45d3-83f9-7ebc62230ea9 admin admin] PATH_INFO: `/v3/projects/978e25a00d4e49a6839459aa85972998/users/01d3da9345ed40f396730e41ccdda091/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.532796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0854ff-d06c-45d3-83f9-7ebc62230ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=978e25a00d4e49a6839459aa85972998, user_id=01d3da9345ed40f396730e41ccdda091, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.537022 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 798/1576] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/projects => generated 380 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:23.537022 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d14a7-603c-4ecc-9d63-561805ff2aa1 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.537300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0854ff-d06c-45d3-83f9-7ebc62230ea9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.551724 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 779/1577] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:23 2022] PUT /identity/v3/projects/978e25a00d4e49a6839459aa85972998/users/01d3da9345ed40f396730e41ccdda091/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:23.552647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0854ff-d06c-45d3-83f9-7ebc62230ea9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.602964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d14a7-603c-4ecc-9d63-561805ff2aa1 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.614033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0854ff-d06c-45d3-83f9-7ebc62230ea9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.618759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a486b5-eb85-43c3-94ca-89bb9214475c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.619757 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a486b5-eb85-43c3-94ca-89bb9214475c admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.620087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a486b5-eb85-43c3-94ca-89bb9214475c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.620338 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a486b5-eb85-43c3-94ca-89bb9214475c admin admin] PATH_INFO: `/v3/projects/a9bb773d106e46aba0ee89c9f798de59/users/7535a906d3884263b6f031080c72cc6d/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.637098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a486b5-eb85-43c3-94ca-89bb9214475c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9bb773d106e46aba0ee89c9f798de59, user_id=7535a906d3884263b6f031080c72cc6d, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.639707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a486b5-eb85-43c3-94ca-89bb9214475c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.652964 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 780/1578] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:23 2022] PUT /identity/v3/projects/a9bb773d106e46aba0ee89c9f798de59/users/7535a906d3884263b6f031080c72cc6d/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:23.653718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a486b5-eb85-43c3-94ca-89bb9214475c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.665114 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e64fc-45ba-4d44-a531-dfc5968038e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.665787 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e64fc-45ba-4d44-a531-dfc5968038e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.666073 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e64fc-45ba-4d44-a531-dfc5968038e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.666360 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e64fc-45ba-4d44-a531-dfc5968038e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.667143 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e64fc-45ba-4d44-a531-dfc5968038e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.669095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e64fc-45ba-4d44-a531-dfc5968038e7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.699891 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 799/1579] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/projects => generated 376 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:23.699891 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e64fc-45ba-4d44-a531-dfc5968038e7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.720368 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a486b5-eb85-43c3-94ca-89bb9214475c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.743103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:23.750288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:23.763231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e64fc-45ba-4d44-a531-dfc5968038e7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.768035 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ee3cd-8552-4f30-a9c6-ec754cadf788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.768710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ee3cd-8552-4f30-a9c6-ec754cadf788 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.769031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ee3cd-8552-4f30-a9c6-ec754cadf788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.769466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ee3cd-8552-4f30-a9c6-ec754cadf788 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.770169 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ee3cd-8552-4f30-a9c6-ec754cadf788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.772172 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ee3cd-8552-4f30-a9c6-ec754cadf788 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.782109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51886745-bc42-4179-b225-abbb069385c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.782832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51886745-bc42-4179-b225-abbb069385c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.783129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51886745-bc42-4179-b225-abbb069385c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.783405 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51886745-bc42-4179-b225-abbb069385c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.784770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51886745-bc42-4179-b225-abbb069385c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.786178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51886745-bc42-4179-b225-abbb069385c6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.806604 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 800/1580] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/projects => generated 388 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:23.806604 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ee3cd-8552-4f30-a9c6-ec754cadf788 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.810477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 781/1581] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:23.811407 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51886745-bc42-4179-b225-abbb069385c6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.822396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51886745-bc42-4179-b225-abbb069385c6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.873185 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ee3cd-8552-4f30-a9c6-ec754cadf788 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.877791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f6880-3d7f-46f5-837a-84de6c725635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.878465 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f6880-3d7f-46f5-837a-84de6c725635 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.878783 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f6880-3d7f-46f5-837a-84de6c725635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.879071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f6880-3d7f-46f5-837a-84de6c725635 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.879505 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adca60-f718-4011-a5a3-0d049e3684e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.879769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f6880-3d7f-46f5-837a-84de6c725635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.880183 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adca60-f718-4011-a5a3-0d049e3684e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.880469 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adca60-f718-4011-a5a3-0d049e3684e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.880750 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adca60-f718-4011-a5a3-0d049e3684e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.881471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adca60-f718-4011-a5a3-0d049e3684e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.881751 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f6880-3d7f-46f5-837a-84de6c725635 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.883109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adca60-f718-4011-a5a3-0d049e3684e9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.894468 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 782/1582] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:23 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:23.895233 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adca60-f718-4011-a5a3-0d049e3684e9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.906265 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 801/1583] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:23.906265 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a9b34-6003-4c06-9969-bfdc14a73782 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.906265 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a9b34-6003-4c06-9969-bfdc14a73782 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.906686 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adca60-f718-4011-a5a3-0d049e3684e9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.906797 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a9b34-6003-4c06-9969-bfdc14a73782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.911390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0077f-2faf-4e60-b19c-9e8030eecc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.912067 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0077f-2faf-4e60-b19c-9e8030eecc46 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.912350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0077f-2faf-4e60-b19c-9e8030eecc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.912628 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0077f-2faf-4e60-b19c-9e8030eecc46 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.913317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0077f-2faf-4e60-b19c-9e8030eecc46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.915293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0077f-2faf-4e60-b19c-9e8030eecc46 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.923939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-335a9b34-6003-4c06-9969-bfdc14a73782 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:23.925127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-335a9b34-6003-4c06-9969-bfdc14a73782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:23.933266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 802/1584] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:23.934496 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c0ecf-d91d-4a55-8b2d-0d379c052573 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.934816 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c0ecf-d91d-4a55-8b2d-0d379c052573 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.935093 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c0ecf-d91d-4a55-8b2d-0d379c052573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.939939 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 783/1585] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/users => generated 291 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:23.939939 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0077f-2faf-4e60-b19c-9e8030eecc46 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.947413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0077f-2faf-4e60-b19c-9e8030eecc46 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.952159 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b580b-807b-42cf-8e75-544f5d8eaae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.952824 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b580b-807b-42cf-8e75-544f5d8eaae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.953117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b580b-807b-42cf-8e75-544f5d8eaae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.953395 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b580b-807b-42cf-8e75-544f5d8eaae0 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.954084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b580b-807b-42cf-8e75-544f5d8eaae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.956075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b580b-807b-42cf-8e75-544f5d8eaae0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.956986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2a9c0ecf-d91d-4a55-8b2d-0d379c052573 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:23.958366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2a9c0ecf-d91d-4a55-8b2d-0d379c052573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:23.966186 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 803/1586] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:23.968181 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c0ecf-d91d-4a55-8b2d-0d379c052573 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.977855 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c0ecf-d91d-4a55-8b2d-0d379c052573 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.981167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 784/1587] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:23.981965 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b580b-807b-42cf-8e75-544f5d8eaae0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.985918 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c458e-0ee4-40c9-8f81-951ba6548eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.986611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c458e-0ee4-40c9-8f81-951ba6548eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.986903 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c458e-0ee4-40c9-8f81-951ba6548eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.987183 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c458e-0ee4-40c9-8f81-951ba6548eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.987882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c458e-0ee4-40c9-8f81-951ba6548eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.989855 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c458e-0ee4-40c9-8f81-951ba6548eb3 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.992195 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b580b-807b-42cf-8e75-544f5d8eaae0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.997983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa58ae6-f0f4-4b0a-9541-11190e137879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.999626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa58ae6-f0f4-4b0a-9541-11190e137879 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.000274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa58ae6-f0f4-4b0a-9541-11190e137879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.000697 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa58ae6-f0f4-4b0a-9541-11190e137879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.002073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa58ae6-f0f4-4b0a-9541-11190e137879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.005333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa58ae6-f0f4-4b0a-9541-11190e137879 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.010902 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 804/1588] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/users => generated 295 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:24.012058 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c458e-0ee4-40c9-8f81-951ba6548eb3 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.020960 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 785/1589] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:23 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:24.022124 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa58ae6-f0f4-4b0a-9541-11190e137879 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.023772 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c458e-0ee4-40c9-8f81-951ba6548eb3 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.028511 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcce23-fc9b-4263-b849-1ef37faabff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.029196 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcce23-fc9b-4263-b849-1ef37faabff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.029485 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcce23-fc9b-4263-b849-1ef37faabff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.030274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcce23-fc9b-4263-b849-1ef37faabff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.031053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdcce23-fc9b-4263-b849-1ef37faabff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.032656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdcce23-fc9b-4263-b849-1ef37faabff5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.033639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa58ae6-f0f4-4b0a-9541-11190e137879 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.043218 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 805/1590] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:24 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:24.043861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcce23-fc9b-4263-b849-1ef37faabff5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.048790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b479e-16c0-414a-92ec-e639604c0e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.049489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b479e-16c0-414a-92ec-e639604c0e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.049775 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b479e-16c0-414a-92ec-e639604c0e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.050056 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b479e-16c0-414a-92ec-e639604c0e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.050832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b479e-16c0-414a-92ec-e639604c0e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.052460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b479e-16c0-414a-92ec-e639604c0e3b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.054527 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcce23-fc9b-4263-b849-1ef37faabff5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.059793 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4148287-cf47-4632-b2af-017dc19e98dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.060471 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4148287-cf47-4632-b2af-017dc19e98dd admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.060754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4148287-cf47-4632-b2af-017dc19e98dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.061084 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4148287-cf47-4632-b2af-017dc19e98dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.061820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4148287-cf47-4632-b2af-017dc19e98dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.063582 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4148287-cf47-4632-b2af-017dc19e98dd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.064942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 786/1591] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:24 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:24.065791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b479e-16c0-414a-92ec-e639604c0e3b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.085133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 806/1592] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:24 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:24.086396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4148287-cf47-4632-b2af-017dc19e98dd admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.120555 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b479e-16c0-414a-92ec-e639604c0e3b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.124278 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d6795-0874-463b-85bd-0f5a614eeee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.124936 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d6795-0874-463b-85bd-0f5a614eeee5 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.125218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d6795-0874-463b-85bd-0f5a614eeee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.125490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d6795-0874-463b-85bd-0f5a614eeee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.135157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d6795-0874-463b-85bd-0f5a614eeee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.136604 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d6795-0874-463b-85bd-0f5a614eeee5 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.142531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4148287-cf47-4632-b2af-017dc19e98dd admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.146387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad890ce7-df9e-476a-9fa4-88ed3d4e29b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.147012 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad890ce7-df9e-476a-9fa4-88ed3d4e29b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.147505 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 787/1593] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:24.147624 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad890ce7-df9e-476a-9fa4-88ed3d4e29b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.147624 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad890ce7-df9e-476a-9fa4-88ed3d4e29b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.151591 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d6795-0874-463b-85bd-0f5a614eeee5 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.158055 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad890ce7-df9e-476a-9fa4-88ed3d4e29b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.159816 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad890ce7-df9e-476a-9fa4-88ed3d4e29b7 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.159967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:24.168474 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d6795-0874-463b-85bd-0f5a614eeee5 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.170940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 807/1594] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:24.171947 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad890ce7-df9e-476a-9fa4-88ed3d4e29b7 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.179185 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:24.181109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dcbad-b262-47aa-8bab-804cadc835a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.182487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dcbad-b262-47aa-8bab-804cadc835a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.182829 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dcbad-b262-47aa-8bab-804cadc835a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.183091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dcbad-b262-47aa-8bab-804cadc835a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.184212 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374dcbad-b262-47aa-8bab-804cadc835a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.186777 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad890ce7-df9e-476a-9fa4-88ed3d4e29b7 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.189691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374dcbad-b262-47aa-8bab-804cadc835a8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.198955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225f82a-a774-4c2b-8c97-8ac4f6488a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.200211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225f82a-a774-4c2b-8c97-8ac4f6488a38 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.200884 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225f82a-a774-4c2b-8c97-8ac4f6488a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.201430 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225f82a-a774-4c2b-8c97-8ac4f6488a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.203648 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 788/1595] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:24 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:24.203873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225f82a-a774-4c2b-8c97-8ac4f6488a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.204527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dcbad-b262-47aa-8bab-804cadc835a8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.207105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225f82a-a774-4c2b-8c97-8ac4f6488a38 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.218237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dcbad-b262-47aa-8bab-804cadc835a8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.224051 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda38f1-6feb-42f4-b3d9-59ce93c6adcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.224745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda38f1-6feb-42f4-b3d9-59ce93c6adcb admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.225030 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda38f1-6feb-42f4-b3d9-59ce93c6adcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.225377 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda38f1-6feb-42f4-b3d9-59ce93c6adcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.226033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda38f1-6feb-42f4-b3d9-59ce93c6adcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.227710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda38f1-6feb-42f4-b3d9-59ce93c6adcb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.228779 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 808/1596] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:24 2022] GET /identity/v3/roles => generated 1427 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:24.230529 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225f82a-a774-4c2b-8c97-8ac4f6488a38 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.246642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 789/1597] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:24 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:24.247820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225f82a-a774-4c2b-8c97-8ac4f6488a38 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.248124 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda38f1-6feb-42f4-b3d9-59ce93c6adcb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.256139 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc0ff5-3186-463c-a994-da0b5549401a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.257464 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc0ff5-3186-463c-a994-da0b5549401a admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.258025 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc0ff5-3186-463c-a994-da0b5549401a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.258665 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc0ff5-3186-463c-a994-da0b5549401a admin admin] PATH_INFO: `/v3/projects/29039bf5c693468da5048c840ffe09f2/users/db949532cadf4a65a86e24d86e937426/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.261087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda38f1-6feb-42f4-b3d9-59ce93c6adcb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.267720 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef04621-5c42-4a77-b55c-8d5de0fbf3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.268676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef04621-5c42-4a77-b55c-8d5de0fbf3ee admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.269171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef04621-5c42-4a77-b55c-8d5de0fbf3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.269623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef04621-5c42-4a77-b55c-8d5de0fbf3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.270549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef04621-5c42-4a77-b55c-8d5de0fbf3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.272539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef04621-5c42-4a77-b55c-8d5de0fbf3ee admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.283838 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc0ff5-3186-463c-a994-da0b5549401a admin admin] RBAC: Authorizing `identity:create_grant(project_id=29039bf5c693468da5048c840ffe09f2, user_id=db949532cadf4a65a86e24d86e937426, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.285191 dv-cinder-836072-5-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-88cc0ff5-3186-463c-a994-da0b5549401a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:42:24.285191 dv-cinder-836072-5-smb devstack@keystone.service[80420]: warnings.warn(msg) May 26 16:42:24.285191 dv-cinder-836072-5-smb devstack@keystone.service[80420]: May 26 16:42:24.288116 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc0ff5-3186-463c-a994-da0b5549401a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.288567 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 790/1598] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:24 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:24.289652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef04621-5c42-4a77-b55c-8d5de0fbf3ee admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.306907 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef04621-5c42-4a77-b55c-8d5de0fbf3ee admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.310636 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 809/1599] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:24 2022] PUT /identity/v3/projects/29039bf5c693468da5048c840ffe09f2/users/db949532cadf4a65a86e24d86e937426/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:24.312531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc0ff5-3186-463c-a994-da0b5549401a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.400991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e44c9-fc4a-4469-ad22-6af83117c6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.401617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e44c9-fc4a-4469-ad22-6af83117c6ff admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.402660 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e44c9-fc4a-4469-ad22-6af83117c6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.402660 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e44c9-fc4a-4469-ad22-6af83117c6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.403696 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e44c9-fc4a-4469-ad22-6af83117c6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.405369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e44c9-fc4a-4469-ad22-6af83117c6ff admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.407214 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc0ff5-3186-463c-a994-da0b5549401a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.413902 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b6798-ccc2-4f68-bd75-898bad1b3228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.414546 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b6798-ccc2-4f68-bd75-898bad1b3228 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.414933 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b6798-ccc2-4f68-bd75-898bad1b3228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.415291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b6798-ccc2-4f68-bd75-898bad1b3228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.416363 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b6798-ccc2-4f68-bd75-898bad1b3228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.418283 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b6798-ccc2-4f68-bd75-898bad1b3228 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.418849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 791/1600] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:24 2022] GET /identity/v3/roles => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:24.423705 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e44c9-fc4a-4469-ad22-6af83117c6ff admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.431634 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 810/1601] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:24 2022] GET /identity/v3/roles => generated 1427 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:24.432746 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b6798-ccc2-4f68-bd75-898bad1b3228 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.435512 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e44c9-fc4a-4469-ad22-6af83117c6ff admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.441161 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8cde6-fdc2-48a7-b502-30de032d39a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.442148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8cde6-fdc2-48a7-b502-30de032d39a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.442431 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8cde6-fdc2-48a7-b502-30de032d39a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.442750 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8cde6-fdc2-48a7-b502-30de032d39a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.443480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8cde6-fdc2-48a7-b502-30de032d39a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.445388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8cde6-fdc2-48a7-b502-30de032d39a5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.447017 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b6798-ccc2-4f68-bd75-898bad1b3228 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.451962 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2e956-5e00-41f8-adad-1be3c0aa8dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.453109 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2e956-5e00-41f8-adad-1be3c0aa8dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.453466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2e956-5e00-41f8-adad-1be3c0aa8dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.453839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2e956-5e00-41f8-adad-1be3c0aa8dcc admin admin] PATH_INFO: `/v3/projects/d0c3f3de81ad4423bfd1ba3ef3b2ae48/users/9a5a533758ef495ba12ffd954fd47dc3/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.456505 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 792/1602] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:24 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:24.457237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8cde6-fdc2-48a7-b502-30de032d39a5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.468521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8cde6-fdc2-48a7-b502-30de032d39a5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.473562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde66e10-092b-4990-a730-72ab9de851d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.474482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde66e10-092b-4990-a730-72ab9de851d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.474780 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde66e10-092b-4990-a730-72ab9de851d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.475058 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde66e10-092b-4990-a730-72ab9de851d7 admin admin] PATH_INFO: `/v3/projects/ada391c74ce149c8a8a82268510ca054/users/9b8c65549fed48918febbf873838f012/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.476492 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2e956-5e00-41f8-adad-1be3c0aa8dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c3f3de81ad4423bfd1ba3ef3b2ae48, user_id=9a5a533758ef495ba12ffd954fd47dc3, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.479459 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2e956-5e00-41f8-adad-1be3c0aa8dcc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.493487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde66e10-092b-4990-a730-72ab9de851d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada391c74ce149c8a8a82268510ca054, user_id=9b8c65549fed48918febbf873838f012, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.496208 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde66e10-092b-4990-a730-72ab9de851d7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.516099 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 811/1603] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:24 2022] PUT /identity/v3/projects/d0c3f3de81ad4423bfd1ba3ef3b2ae48/users/9a5a533758ef495ba12ffd954fd47dc3/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:24.516099 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda84cd-76b3-4548-88d8-2bceecb824de None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.516099 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda84cd-76b3-4548-88d8-2bceecb824de None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.516099 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda84cd-76b3-4548-88d8-2bceecb824de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.523546 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 793/1604] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:24 2022] PUT /identity/v3/projects/ada391c74ce149c8a8a82268510ca054/users/9b8c65549fed48918febbf873838f012/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:24.524974 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde66e10-092b-4990-a730-72ab9de851d7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.554355 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0fda84cd-76b3-4548-88d8-2bceecb824de None None] MFA Rules not processed for user `db949532cadf4a65a86e24d86e937426`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:24.555943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0fda84cd-76b3-4548-88d8-2bceecb824de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:24.677813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 812/1605] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:24.679144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda84cd-76b3-4548-88d8-2bceecb824de None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.680997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde66e10-092b-4990-a730-72ab9de851d7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.686326 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af5ad0-a440-4e45-b602-0d86f44e1749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.687775 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af5ad0-a440-4e45-b602-0d86f44e1749 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.688074 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af5ad0-a440-4e45-b602-0d86f44e1749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.688519 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af5ad0-a440-4e45-b602-0d86f44e1749 admin admin] PATH_INFO: `/v3/projects/c8740cea7f324d248c18313c906aae22/users/d1c1bf4c8bac47129cbd0fb58eb29035/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.697304 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda84cd-76b3-4548-88d8-2bceecb824de None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.703761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768148a6-0688-490e-abb8-bddbc58fa217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.704696 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768148a6-0688-490e-abb8-bddbc58fa217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.704966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768148a6-0688-490e-abb8-bddbc58fa217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.705241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768148a6-0688-490e-abb8-bddbc58fa217 admin admin] PATH_INFO: `/v3/projects/533272fd6c114969b9eb37f966cf912d/users/800456396f1c4347b3ad4557cc9bcc96/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.710451 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af5ad0-a440-4e45-b602-0d86f44e1749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8740cea7f324d248c18313c906aae22, user_id=d1c1bf4c8bac47129cbd0fb58eb29035, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.713707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af5ad0-a440-4e45-b602-0d86f44e1749 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.728774 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768148a6-0688-490e-abb8-bddbc58fa217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=533272fd6c114969b9eb37f966cf912d, user_id=800456396f1c4347b3ad4557cc9bcc96, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.734203 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768148a6-0688-490e-abb8-bddbc58fa217 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.750466 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 794/1606] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:24 2022] PUT /identity/v3/projects/c8740cea7f324d248c18313c906aae22/users/d1c1bf4c8bac47129cbd0fb58eb29035/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:24.751631 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af5ad0-a440-4e45-b602-0d86f44e1749 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.756208 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 813/1607] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:24 2022] PUT /identity/v3/projects/533272fd6c114969b9eb37f966cf912d/users/800456396f1c4347b3ad4557cc9bcc96/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:24.758608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5333c-d7c6-470f-8ec6-e46653436e1f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.759497 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5333c-d7c6-470f-8ec6-e46653436e1f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.759643 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5333c-d7c6-470f-8ec6-e46653436e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.787430 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:24.801077 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:24.841099 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-77a5333c-d7c6-470f-8ec6-e46653436e1f None None] MFA Rules not processed for user `9a5a533758ef495ba12ffd954fd47dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:24.842949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-77a5333c-d7c6-470f-8ec6-e46653436e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:24.892448 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af5ad0-a440-4e45-b602-0d86f44e1749 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.974171 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 814/1608] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:24.975626 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503d0eb-1bb6-4a77-97fe-0863193678a9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.975969 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503d0eb-1bb6-4a77-97fe-0863193678a9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.976870 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503d0eb-1bb6-4a77-97fe-0863193678a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.036797 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9503d0eb-1bb6-4a77-97fe-0863193678a9 None None] MFA Rules not processed for user `9b8c65549fed48918febbf873838f012`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:25.038036 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9503d0eb-1bb6-4a77-97fe-0863193678a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:25.038328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503293a1-21ac-4f73-8e09-35d139b89e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:25.040231 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503293a1-21ac-4f73-8e09-35d139b89e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.040534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503293a1-21ac-4f73-8e09-35d139b89e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.040836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503293a1-21ac-4f73-8e09-35d139b89e93 admin admin] PATH_INFO: `/v3/projects/09376bf1048d4dc489c93042d216f316/users/563b1c9d1951413baefe86ead2c1a955/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.172586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 815/1609] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:25.175733 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e322f6f-2311-453e-beab-95619c8e60ff None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.176534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e322f6f-2311-453e-beab-95619c8e60ff None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.177060 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e322f6f-2311-453e-beab-95619c8e60ff None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.178797 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 816/1610] 10.222.0.110 () {54 vars in 966 bytes} [Thu May 26 16:42:25 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:42:25.180463 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ef539-31d5-44fa-80b7-bf0ea7099c58 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.181308 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ef539-31d5-44fa-80b7-bf0ea7099c58 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.181760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ef539-31d5-44fa-80b7-bf0ea7099c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.213779 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2a0ef539-31d5-44fa-80b7-bf0ea7099c58 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:25.215187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2a0ef539-31d5-44fa-80b7-bf0ea7099c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:25.226455 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 817/1611] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:25.233388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49048e-230c-4f68-a262-37957229ee5c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.233891 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49048e-230c-4f68-a262-37957229ee5c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.234242 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49048e-230c-4f68-a262-37957229ee5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.245964 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503293a1-21ac-4f73-8e09-35d139b89e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09376bf1048d4dc489c93042d216f316, user_id=563b1c9d1951413baefe86ead2c1a955, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:25.249588 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503293a1-21ac-4f73-8e09-35d139b89e93 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:25.276414 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 795/1612] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:24 2022] PUT /identity/v3/projects/09376bf1048d4dc489c93042d216f316/users/563b1c9d1951413baefe86ead2c1a955/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:25.277261 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503293a1-21ac-4f73-8e09-35d139b89e93 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:25.288672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-cf49048e-230c-4f68-a262-37957229ee5c None None] MFA Rules not processed for user `800456396f1c4347b3ad4557cc9bcc96`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:25.289961 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cf49048e-230c-4f68-a262-37957229ee5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:25.407755 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503293a1-21ac-4f73-8e09-35d139b89e93 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:25.415839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313d00f-d270-4a8c-96ee-99ab8bed634f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:25.416532 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313d00f-d270-4a8c-96ee-99ab8bed634f admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.416815 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313d00f-d270-4a8c-96ee-99ab8bed634f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.417088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313d00f-d270-4a8c-96ee-99ab8bed634f admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.418184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313d00f-d270-4a8c-96ee-99ab8bed634f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:25.420632 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313d00f-d270-4a8c-96ee-99ab8bed634f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:25.427395 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 818/1613] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:25.428389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49048e-230c-4f68-a262-37957229ee5c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:25.450468 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:25.473331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 796/1614] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:25 2022] POST /identity/v3/projects => generated 374 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:25.475727 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54029ff0-2fe1-4d5d-b92b-bd4dc4e22ab9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.476500 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54029ff0-2fe1-4d5d-b92b-bd4dc4e22ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.477227 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54029ff0-2fe1-4d5d-b92b-bd4dc4e22ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.506047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-54029ff0-2fe1-4d5d-b92b-bd4dc4e22ab9 None None] MFA Rules not processed for user `0043a7d5877f41de905afe6bef355867`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:25.507631 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-54029ff0-2fe1-4d5d-b92b-bd4dc4e22ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:25.539940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49048e-230c-4f68-a262-37957229ee5c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:25.540161 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:25.601474 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce5f88-94d2-41cd-8ba8-ca3e91ac6d3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:25.602286 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce5f88-94d2-41cd-8ba8-ca3e91ac6d3f service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.602799 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce5f88-94d2-41cd-8ba8-ca3e91ac6d3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.603240 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce5f88-94d2-41cd-8ba8-ca3e91ac6d3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.635649 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 797/1615] 10.222.0.110 () {58 vars in 1063 bytes} [Thu May 26 16:42:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:25.636426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54029ff0-2fe1-4d5d-b92b-bd4dc4e22ab9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:25.642768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-54029ff0-2fe1-4d5d-b92b-bd4dc4e22ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:25.668606 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce5f88-94d2-41cd-8ba8-ca3e91ac6d3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:25.670208 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce5f88-94d2-41cd-8ba8-ca3e91ac6d3f service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:25.682180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 819/1616] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:25.683801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1901b-439c-4f18-ad82-2cc177686cdb None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.684179 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1901b-439c-4f18-ad82-2cc177686cdb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.684528 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1901b-439c-4f18-ad82-2cc177686cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.714459 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-dbb1901b-439c-4f18-ad82-2cc177686cdb None None] MFA Rules not processed for user `563b1c9d1951413baefe86ead2c1a955`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:25.716600 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dbb1901b-439c-4f18-ad82-2cc177686cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:25.800991 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 820/1617] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:25.803257 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a1359-4a77-4945-b44a-f1703bec021c None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.803605 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a1359-4a77-4945-b44a-f1703bec021c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.804091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a1359-4a77-4945-b44a-f1703bec021c None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.807308 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 821/1618] 10.222.0.110 () {54 vars in 966 bytes} [Thu May 26 16:42:25 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:42:25.808186 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a1359-4a77-4945-b44a-f1703bec021c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:25.827189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:25.848475 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54029ff0-2fe1-4d5d-b92b-bd4dc4e22ab9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:25.863330 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f0910-b749-478a-949a-f12fc1e07743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:25.864024 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f0910-b749-478a-949a-f12fc1e07743 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.864313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f0910-b749-478a-949a-f12fc1e07743 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.864591 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f0910-b749-478a-949a-f12fc1e07743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.899145 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a1359-4a77-4945-b44a-f1703bec021c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:25.911683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bffae-5693-4696-bd90-19b51e835173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:25.915077 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bffae-5693-4696-bd90-19b51e835173 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.915385 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bffae-5693-4696-bd90-19b51e835173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.915984 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bffae-5693-4696-bd90-19b51e835173 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.919555 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bffae-5693-4696-bd90-19b51e835173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:25.925130 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bffae-5693-4696-bd90-19b51e835173 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:25.974653 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 822/1619] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:25 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:25.977668 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bffae-5693-4696-bd90-19b51e835173 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.000720 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bffae-5693-4696-bd90-19b51e835173 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.012227 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd87cf-9fa6-4c4f-8c8e-587241d49af6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.013437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd87cf-9fa6-4c4f-8c8e-587241d49af6 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.016916 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd87cf-9fa6-4c4f-8c8e-587241d49af6 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.017369 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd87cf-9fa6-4c4f-8c8e-587241d49af6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.046808 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f0910-b749-478a-949a-f12fc1e07743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.048768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f0910-b749-478a-949a-f12fc1e07743 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.071078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 798/1620] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:26.072249 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f0910-b749-478a-949a-f12fc1e07743 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.093033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f0910-b749-478a-949a-f12fc1e07743 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.100406 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c278608-6627-4999-89e5-79a73825c4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.101429 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c278608-6627-4999-89e5-79a73825c4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.101894 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c278608-6627-4999-89e5-79a73825c4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.102225 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c278608-6627-4999-89e5-79a73825c4c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.103133 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c278608-6627-4999-89e5-79a73825c4c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.105471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c278608-6627-4999-89e5-79a73825c4c7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.148623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 799/1621] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:26 2022] POST /identity/v3/projects => generated 388 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:26.152776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b5977-06b2-4b39-9bb7-4918cc52f3ef None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.153852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b5977-06b2-4b39-9bb7-4918cc52f3ef None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.154196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b5977-06b2-4b39-9bb7-4918cc52f3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.154318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd87cf-9fa6-4c4f-8c8e-587241d49af6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.161942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd87cf-9fa6-4c4f-8c8e-587241d49af6 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.189662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 823/1622] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:26.193002 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd87cf-9fa6-4c4f-8c8e-587241d49af6 service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.214776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3f0b5977-06b2-4b39-9bb7-4918cc52f3ef None None] MFA Rules not processed for user `0043a7d5877f41de905afe6bef355867`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:26.216032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3f0b5977-06b2-4b39-9bb7-4918cc52f3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:26.217792 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd87cf-9fa6-4c4f-8c8e-587241d49af6 service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.314828 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:26.365654 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 800/1623] 10.222.0.110 () {58 vars in 1063 bytes} [Thu May 26 16:42:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:26.366508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b5977-06b2-4b39-9bb7-4918cc52f3ef None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.423661 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f457f-2799-43a8-9e14-4526f6e10fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.425482 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f457f-2799-43a8-9e14-4526f6e10fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.425817 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f457f-2799-43a8-9e14-4526f6e10fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.426095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f457f-2799-43a8-9e14-4526f6e10fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.430715 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f457f-2799-43a8-9e14-4526f6e10fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.434758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f457f-2799-43a8-9e14-4526f6e10fa2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.464794 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 824/1624] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:26 2022] GET /identity/v3/roles => generated 1427 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:26.465636 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f457f-2799-43a8-9e14-4526f6e10fa2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.500168 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b5977-06b2-4b39-9bb7-4918cc52f3ef None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.502713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f457f-2799-43a8-9e14-4526f6e10fa2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.513102 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4be176-0cec-4a91-8065-d8baa44c0603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.513815 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4be176-0cec-4a91-8065-d8baa44c0603 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.514646 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4be176-0cec-4a91-8065-d8baa44c0603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.514912 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4be176-0cec-4a91-8065-d8baa44c0603 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.517163 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4be176-0cec-4a91-8065-d8baa44c0603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.519209 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4be176-0cec-4a91-8065-d8baa44c0603 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.520172 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5822d-c764-4e90-829b-9edb10d6798d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.522173 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5822d-c764-4e90-829b-9edb10d6798d service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.522598 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5822d-c764-4e90-829b-9edb10d6798d service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.522948 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5822d-c764-4e90-829b-9edb10d6798d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.560290 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 801/1625] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:26 2022] POST /identity/v3/users => generated 301 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:26.560930 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4be176-0cec-4a91-8065-d8baa44c0603 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.584791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4be176-0cec-4a91-8065-d8baa44c0603 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.598631 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b10cc0-a953-41f5-a59e-ec5b061e4bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.599577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b10cc0-a953-41f5-a59e-ec5b061e4bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.599864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b10cc0-a953-41f5-a59e-ec5b061e4bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.600281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b10cc0-a953-41f5-a59e-ec5b061e4bb5 admin admin] PATH_INFO: `/v3/projects/bbdcaaf34f974c1eb74326b57ed62aaa/users/6fbaef99dce0496facc90a723a85f032/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.628257 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:26.634542 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b10cc0-a953-41f5-a59e-ec5b061e4bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbdcaaf34f974c1eb74326b57ed62aaa, user_id=6fbaef99dce0496facc90a723a85f032, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.643188 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b10cc0-a953-41f5-a59e-ec5b061e4bb5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.672047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 802/1626] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:26 2022] PUT /identity/v3/projects/bbdcaaf34f974c1eb74326b57ed62aaa/users/6fbaef99dce0496facc90a723a85f032/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:26.673307 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b10cc0-a953-41f5-a59e-ec5b061e4bb5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.720436 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5822d-c764-4e90-829b-9edb10d6798d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.722255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5822d-c764-4e90-829b-9edb10d6798d service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.761042 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 825/1627] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:26.765828 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5822d-c764-4e90-829b-9edb10d6798d service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.795621 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5822d-c764-4e90-829b-9edb10d6798d service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.810205 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b10cc0-a953-41f5-a59e-ec5b061e4bb5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.813209 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d9afd-fe25-412d-9d5d-0debe4d00851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.814205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d9afd-fe25-412d-9d5d-0debe4d00851 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.815208 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d9afd-fe25-412d-9d5d-0debe4d00851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.815703 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d9afd-fe25-412d-9d5d-0debe4d00851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.816862 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d9afd-fe25-412d-9d5d-0debe4d00851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.821319 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d9afd-fe25-412d-9d5d-0debe4d00851 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.831003 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34869d21-a7ba-4bf9-97d1-0703c902feb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.831708 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34869d21-a7ba-4bf9-97d1-0703c902feb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.831996 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34869d21-a7ba-4bf9-97d1-0703c902feb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.832272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34869d21-a7ba-4bf9-97d1-0703c902feb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.833403 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34869d21-a7ba-4bf9-97d1-0703c902feb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.841917 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34869d21-a7ba-4bf9-97d1-0703c902feb5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.847149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 826/1628] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:26 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:26.856457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b8b2a-3892-4d5e-bae0-5df386f49668 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.857190 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b8b2a-3892-4d5e-bae0-5df386f49668 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.857771 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b8b2a-3892-4d5e-bae0-5df386f49668 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.864887 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 827/1629] 10.222.0.110 () {54 vars in 917 bytes} [Thu May 26 16:42:26 2022] GET /identity => generated 271 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:42:26.866165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b8b2a-3892-4d5e-bae0-5df386f49668 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.875927 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 803/1630] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:26 2022] GET /identity/v3/roles => generated 1427 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:26.877687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ee90b-f653-41db-ae8a-f7cca4df5019 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.881411 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ee90b-f653-41db-ae8a-f7cca4df5019 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.881586 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ee90b-f653-41db-ae8a-f7cca4df5019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.914186 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b8b2a-3892-4d5e-bae0-5df386f49668 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.927544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbadcc1-4f1f-43d4-9cbf-2002c50ba34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.929964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbadcc1-4f1f-43d4-9cbf-2002c50ba34e admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.930704 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbadcc1-4f1f-43d4-9cbf-2002c50ba34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.931634 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbadcc1-4f1f-43d4-9cbf-2002c50ba34e admin admin] PATH_INFO: `/v3/projects/bbdcaaf34f974c1eb74326b57ed62aaa/users/6fbaef99dce0496facc90a723a85f032/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.941204 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbadcc1-4f1f-43d4-9cbf-2002c50ba34e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbdcaaf34f974c1eb74326b57ed62aaa, user_id=6fbaef99dce0496facc90a723a85f032, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.942534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-448ee90b-f653-41db-ae8a-f7cca4df5019 None None] MFA Rules not processed for user `0043a7d5877f41de905afe6bef355867`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:26.945672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbadcc1-4f1f-43d4-9cbf-2002c50ba34e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.947803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-448ee90b-f653-41db-ae8a-f7cca4df5019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:26.984295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 828/1631] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:26 2022] PUT /identity/v3/projects/bbdcaaf34f974c1eb74326b57ed62aaa/users/6fbaef99dce0496facc90a723a85f032/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:26.988734 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbadcc1-4f1f-43d4-9cbf-2002c50ba34e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.053817 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:27.140178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 804/1632] 10.222.0.110 () {58 vars in 1014 bytes} [Thu May 26 16:42:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:27.141616 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27349a-7dc1-4c6f-8867-289e48b2f0f1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.141908 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27349a-7dc1-4c6f-8867-289e48b2f0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.142184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27349a-7dc1-4c6f-8867-289e48b2f0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.162888 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbadcc1-4f1f-43d4-9cbf-2002c50ba34e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.182772 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4de5f-5712-4533-a1b9-23a5d227d5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:27.184549 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4de5f-5712-4533-a1b9-23a5d227d5fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.184835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4de5f-5712-4533-a1b9-23a5d227d5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.185114 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4de5f-5712-4533-a1b9-23a5d227d5fd admin admin] PATH_INFO: `/v3/projects/c665447bf3df4eef894a6aa2567bc210/users/d00cc8a76dae49c9afb2d50c017f0df0/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.223380 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1a27349a-7dc1-4c6f-8867-289e48b2f0f1 None None] MFA Rules not processed for user `6fbaef99dce0496facc90a723a85f032`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:27.224624 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1a27349a-7dc1-4c6f-8867-289e48b2f0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:27.226091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4de5f-5712-4533-a1b9-23a5d227d5fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c665447bf3df4eef894a6aa2567bc210, user_id=d00cc8a76dae49c9afb2d50c017f0df0, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:27.230433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4de5f-5712-4533-a1b9-23a5d227d5fd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:27.265110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 829/1633] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:26 2022] PUT /identity/v3/projects/c665447bf3df4eef894a6aa2567bc210/users/d00cc8a76dae49c9afb2d50c017f0df0/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:27.265110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4de5f-5712-4533-a1b9-23a5d227d5fd admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.363836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 805/1634] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:27.365029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27349a-7dc1-4c6f-8867-289e48b2f0f1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.391339 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27349a-7dc1-4c6f-8867-289e48b2f0f1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.433997 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4de5f-5712-4533-a1b9-23a5d227d5fd admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.447244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea7c6b-f983-4b03-8e96-44d304a6d0a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:27.448054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea7c6b-f983-4b03-8e96-44d304a6d0a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.448439 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea7c6b-f983-4b03-8e96-44d304a6d0a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.448817 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea7c6b-f983-4b03-8e96-44d304a6d0a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.569175 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96b692-2351-46bc-b2df-9783537d2794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:27.570087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96b692-2351-46bc-b2df-9783537d2794 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.570386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96b692-2351-46bc-b2df-9783537d2794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.571173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96b692-2351-46bc-b2df-9783537d2794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.571871 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96b692-2351-46bc-b2df-9783537d2794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:27.574437 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96b692-2351-46bc-b2df-9783537d2794 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:27.595008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 806/1635] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:27 2022] GET /identity/v3/roles => generated 1427 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:27.595965 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96b692-2351-46bc-b2df-9783537d2794 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.605917 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:27.633620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96b692-2351-46bc-b2df-9783537d2794 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.642141 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eaffb8-e764-4b7b-af3d-d85ae942dafd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:27.642992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaffb8-e764-4b7b-af3d-d85ae942dafd service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.643284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaffb8-e764-4b7b-af3d-d85ae942dafd service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.643612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaffb8-e764-4b7b-af3d-d85ae942dafd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.713674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea7c6b-f983-4b03-8e96-44d304a6d0a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:27.718984 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea7c6b-f983-4b03-8e96-44d304a6d0a5 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:27.732331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:27.753861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 830/1636] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:27.756206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd492c77-6056-4170-9824-67dff7c0c3ab None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.757137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eaffb8-e764-4b7b-af3d-d85ae942dafd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:27.757890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd492c77-6056-4170-9824-67dff7c0c3ab None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.758549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eaffb8-e764-4b7b-af3d-d85ae942dafd service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:27.759003 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd492c77-6056-4170-9824-67dff7c0c3ab None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.766002 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 831/1637] 10.222.0.110 () {54 vars in 917 bytes} [Thu May 26 16:42:27 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:42:27.767068 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd492c77-6056-4170-9824-67dff7c0c3ab None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.782993 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 807/1638] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:27.784487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27207a9-d9fa-4190-8440-8060bd68216f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.785231 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27207a9-d9fa-4190-8440-8060bd68216f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.785231 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27207a9-d9fa-4190-8440-8060bd68216f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.811843 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd492c77-6056-4170-9824-67dff7c0c3ab None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.823529 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e43d43-8ed0-47db-ae9c-754483467487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:27.824551 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e43d43-8ed0-47db-ae9c-754483467487 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.824842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e43d43-8ed0-47db-ae9c-754483467487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.825202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e43d43-8ed0-47db-ae9c-754483467487 admin admin] PATH_INFO: `/v3/projects/c665447bf3df4eef894a6aa2567bc210/users/d00cc8a76dae49c9afb2d50c017f0df0/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.828342 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e43d43-8ed0-47db-ae9c-754483467487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c665447bf3df4eef894a6aa2567bc210, user_id=d00cc8a76dae49c9afb2d50c017f0df0, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:27.829321 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c27207a9-d9fa-4190-8440-8060bd68216f None None] MFA Rules not processed for user `0043a7d5877f41de905afe6bef355867`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:27.833280 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c27207a9-d9fa-4190-8440-8060bd68216f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:27.835601 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e43d43-8ed0-47db-ae9c-754483467487 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:27.855342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 808/1639] 10.222.0.110 () {58 vars in 1014 bytes} [Thu May 26 16:42:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:27.879736 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27207a9-d9fa-4190-8440-8060bd68216f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.885192 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 832/1640] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:27 2022] PUT /identity/v3/projects/c665447bf3df4eef894a6aa2567bc210/users/d00cc8a76dae49c9afb2d50c017f0df0/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:27.893563 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27207a9-d9fa-4190-8440-8060bd68216f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.903977 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719f13e-c6ad-4565-8ea5-7b8aa422334c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.904586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719f13e-c6ad-4565-8ea5-7b8aa422334c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.905048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719f13e-c6ad-4565-8ea5-7b8aa422334c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.960432 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2719f13e-c6ad-4565-8ea5-7b8aa422334c None None] MFA Rules not processed for user `d00cc8a76dae49c9afb2d50c017f0df0`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:27.962034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2719f13e-c6ad-4565-8ea5-7b8aa422334c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:28.020118 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1feba68-6a31-408e-b875-9ffa290c89f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:28.023391 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1feba68-6a31-408e-b875-9ffa290c89f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:28.027527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1feba68-6a31-408e-b875-9ffa290c89f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:28.027527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1feba68-6a31-408e-b875-9ffa290c89f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:28.192869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 833/1641] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:27 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:28.278350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1feba68-6a31-408e-b875-9ffa290c89f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:28.281142 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1feba68-6a31-408e-b875-9ffa290c89f5 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:28.314059 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c23217-25cb-4212-91b1-124b17a0b217 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:28.314436 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c23217-25cb-4212-91b1-124b17a0b217 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:28.314857 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c23217-25cb-4212-91b1-124b17a0b217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:28.349944 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 809/1642] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:42:28.381226 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-19c23217-25cb-4212-91b1-124b17a0b217 None None] MFA Rules not processed for user `d1c1bf4c8bac47129cbd0fb58eb29035`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:28.383046 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-19c23217-25cb-4212-91b1-124b17a0b217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:28.541416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1feba68-6a31-408e-b875-9ffa290c89f5 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:28.562445 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1feba68-6a31-408e-b875-9ffa290c89f5 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:28.579646 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186b931-5b3c-4e6a-af20-45e13a553845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:28.581998 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186b931-5b3c-4e6a-af20-45e13a553845 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:28.582605 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186b931-5b3c-4e6a-af20-45e13a553845 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:28.582892 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186b931-5b3c-4e6a-af20-45e13a553845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:28.643935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186b931-5b3c-4e6a-af20-45e13a553845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:28.645561 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186b931-5b3c-4e6a-af20-45e13a553845 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:28.663356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 810/1643] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:28 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:28.729454 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 834/1644] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:28.732217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215322e-693d-45a9-8306-a57853a9861e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:28.732718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215322e-693d-45a9-8306-a57853a9861e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:28.732932 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215322e-693d-45a9-8306-a57853a9861e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:28.778859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c23217-25cb-4212-91b1-124b17a0b217 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:28.813372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4215322e-693d-45a9-8306-a57853a9861e None None] MFA Rules not processed for user `d1c1bf4c8bac47129cbd0fb58eb29035`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:28.816638 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4215322e-693d-45a9-8306-a57853a9861e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:28.858271 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 811/1645] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:28.921741 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215322e-693d-45a9-8306-a57853a9861e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:28.937786 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215322e-693d-45a9-8306-a57853a9861e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:28.939676 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:28.943639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386a9d5-a13d-486b-891a-2a58ff8f4ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:28.944339 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386a9d5-a13d-486b-891a-2a58ff8f4ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:28.944635 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386a9d5-a13d-486b-891a-2a58ff8f4ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:28.944917 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386a9d5-a13d-486b-891a-2a58ff8f4ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:29.035924 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c23217-25cb-4212-91b1-124b17a0b217 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:29.080548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72211d-237b-43d7-ab83-b4c41690bb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:29.083857 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72211d-237b-43d7-ab83-b4c41690bb9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:29.084468 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72211d-237b-43d7-ab83-b4c41690bb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:29.085833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72211d-237b-43d7-ab83-b4c41690bb9f admin admin] PATH_INFO: `/v3/users/563b1c9d1951413baefe86ead2c1a955` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:29.088676 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72211d-237b-43d7-ab83-b4c41690bb9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=563b1c9d1951413baefe86ead2c1a955)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:29.092375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-4d72211d-237b-43d7-ab83-b4c41690bb9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:42:29.092375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: warnings.warn(msg) May 26 16:42:29.092375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: May 26 16:42:29.097134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72211d-237b-43d7-ab83-b4c41690bb9f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:29.170167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386a9d5-a13d-486b-891a-2a58ff8f4ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:29.171674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386a9d5-a13d-486b-891a-2a58ff8f4ca4 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:29.220892 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 812/1646] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:42:29.224366 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386a9d5-a13d-486b-891a-2a58ff8f4ca4 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:29.261617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:29.283021 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4d72211d-237b-43d7-ab83-b4c41690bb9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '563b1c9d1951413baefe86ead2c1a955'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:29.289008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386a9d5-a13d-486b-891a-2a58ff8f4ca4 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:29.315178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fe6e6-c3ea-4882-8500-d1d0a9e2c062 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:29.315881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fe6e6-c3ea-4882-8500-d1d0a9e2c062 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:29.316168 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fe6e6-c3ea-4882-8500-d1d0a9e2c062 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:29.316447 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fe6e6-c3ea-4882-8500-d1d0a9e2c062 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:29.343267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4d72211d-237b-43d7-ab83-b4c41690bb9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '563b1c9d1951413baefe86ead2c1a955'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:29.345723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4d72211d-237b-43d7-ab83-b4c41690bb9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '563b1c9d1951413baefe86ead2c1a955'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:29.346772 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fe6e6-c3ea-4882-8500-d1d0a9e2c062 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:29.348543 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fe6e6-c3ea-4882-8500-d1d0a9e2c062 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:29.371700 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4d72211d-237b-43d7-ab83-b4c41690bb9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '563b1c9d1951413baefe86ead2c1a955'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:29.372395 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4d72211d-237b-43d7-ab83-b4c41690bb9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '563b1c9d1951413baefe86ead2c1a955'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:29.384701 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 813/1647] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:29.441132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 835/1648] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:42:28 2022] DELETE /identity/v3/users/563b1c9d1951413baefe86ead2c1a955 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:29.445546 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef52cf-4a09-409b-93f2-728eb2369d27 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:29.445897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef52cf-4a09-409b-93f2-728eb2369d27 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:29.446189 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef52cf-4a09-409b-93f2-728eb2369d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:29.486744 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-75ef52cf-4a09-409b-93f2-728eb2369d27 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:29.488808 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-75ef52cf-4a09-409b-93f2-728eb2369d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:29.660837 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 814/1649] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:29.708714 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72211d-237b-43d7-ab83-b4c41690bb9f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:29.711494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4d72211d-237b-43d7-ab83-b4c41690bb9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:29.764161 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef52cf-4a09-409b-93f2-728eb2369d27 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:29.766146 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-75ef52cf-4a09-409b-93f2-728eb2369d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:29.799134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef52cf-4a09-409b-93f2-728eb2369d27 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:29.805542 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b7cfb-bfa7-4206-9106-cb3af21fd3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:29.806543 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b7cfb-bfa7-4206-9106-cb3af21fd3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:29.806826 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b7cfb-bfa7-4206-9106-cb3af21fd3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:29.807104 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b7cfb-bfa7-4206-9106-cb3af21fd3b5 admin admin] PATH_INFO: `/v3/users/800456396f1c4347b3ad4557cc9bcc96` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:29.808432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b7cfb-bfa7-4206-9106-cb3af21fd3b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=800456396f1c4347b3ad4557cc9bcc96)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:29.811009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b7cfb-bfa7-4206-9106-cb3af21fd3b5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:29.921211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72211d-237b-43d7-ab83-b4c41690bb9f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:29.927694 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0c3b7cfb-bfa7-4206-9106-cb3af21fd3b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800456396f1c4347b3ad4557cc9bcc96'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:29.930908 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0c3b7cfb-bfa7-4206-9106-cb3af21fd3b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800456396f1c4347b3ad4557cc9bcc96'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:29.935756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ee6cb-eb7c-4086-b74e-c21b04b75d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:29.936460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee6cb-eb7c-4086-b74e-c21b04b75d50 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:29.936755 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee6cb-eb7c-4086-b74e-c21b04b75d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:29.937129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee6cb-eb7c-4086-b74e-c21b04b75d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:29.947070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-767ee6cb-eb7c-4086-b74e-c21b04b75d50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:29.971260 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0c3b7cfb-bfa7-4206-9106-cb3af21fd3b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800456396f1c4347b3ad4557cc9bcc96'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:29.976904 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0c3b7cfb-bfa7-4206-9106-cb3af21fd3b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800456396f1c4347b3ad4557cc9bcc96'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:29.986414 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ee6cb-eb7c-4086-b74e-c21b04b75d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:29.988553 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ee6cb-eb7c-4086-b74e-c21b04b75d50 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:29.993923 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0c3b7cfb-bfa7-4206-9106-cb3af21fd3b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800456396f1c4347b3ad4557cc9bcc96'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:30.019284 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 836/1650] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:30.045695 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 815/1651] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:42:29 2022] DELETE /identity/v3/users/800456396f1c4347b3ad4557cc9bcc96 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:30.050041 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc6bf0-1153-4990-8f6d-b8431557362d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:30.050340 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc6bf0-1153-4990-8f6d-b8431557362d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:30.050787 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc6bf0-1153-4990-8f6d-b8431557362d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:30.127922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-59fc6bf0-1153-4990-8f6d-b8431557362d None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:30.140559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-59fc6bf0-1153-4990-8f6d-b8431557362d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:30.293744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:30.331263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 837/1652] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:30.473964 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b7cfb-bfa7-4206-9106-cb3af21fd3b5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:30.476229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0c3b7cfb-bfa7-4206-9106-cb3af21fd3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:30.632012 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4dc55-97b7-48ee-8f82-11f199894203 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:30.632481 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4dc55-97b7-48ee-8f82-11f199894203 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:30.632936 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4dc55-97b7-48ee-8f82-11f199894203 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:30.636961 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 838/1653] 10.222.0.110 () {54 vars in 917 bytes} [Thu May 26 16:42:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:42:30.646050 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c8450-90de-4d06-a537-e8f2c8dfb019 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:30.646991 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c8450-90de-4d06-a537-e8f2c8dfb019 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:30.646991 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c8450-90de-4d06-a537-e8f2c8dfb019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:30.648961 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b7cfb-bfa7-4206-9106-cb3af21fd3b5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:30.655021 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e947b7b-cbd5-4c99-b012-245f3161aeec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:30.657619 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e947b7b-cbd5-4c99-b012-245f3161aeec service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:30.657942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e947b7b-cbd5-4c99-b012-245f3161aeec service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:30.658323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e947b7b-cbd5-4c99-b012-245f3161aeec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:30.690505 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e947b7b-cbd5-4c99-b012-245f3161aeec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:30.696148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e947b7b-cbd5-4c99-b012-245f3161aeec service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:30.722670 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 816/1654] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:30.763223 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b19c8450-90de-4d06-a537-e8f2c8dfb019 None None] MFA Rules not processed for user `f2411c1c780449e1a24fecb747cc3761`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:30.765122 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b19c8450-90de-4d06-a537-e8f2c8dfb019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:30.780065 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 839/1655] 10.222.0.110 () {58 vars in 1014 bytes} [Thu May 26 16:42:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:30.904308 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e947b7b-cbd5-4c99-b012-245f3161aeec service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:30.926600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:30.951342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e947b7b-cbd5-4c99-b012-245f3161aeec service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:30.964510 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650767f9-a70a-4c0c-b173-bd1365bbb1b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:30.964849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650767f9-a70a-4c0c-b173-bd1365bbb1b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:30.965347 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650767f9-a70a-4c0c-b173-bd1365bbb1b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:30.965626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650767f9-a70a-4c0c-b173-bd1365bbb1b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:30.995726 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650767f9-a70a-4c0c-b173-bd1365bbb1b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:30.999461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650767f9-a70a-4c0c-b173-bd1365bbb1b4 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:31.025184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 817/1656] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:32.384381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6381b-26c8-4a6b-be94-d779a6a8cc24 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:32.385312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6381b-26c8-4a6b-be94-d779a6a8cc24 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:32.385790 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6381b-26c8-4a6b-be94-d779a6a8cc24 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:32.388495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 840/1657] 10.222.0.110 () {54 vars in 965 bytes} [Thu May 26 16:42:32 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:42:32.393992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792349b-58c8-4767-9754-4cd15bb90cbd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:32.395128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792349b-58c8-4767-9754-4cd15bb90cbd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:32.395604 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792349b-58c8-4767-9754-4cd15bb90cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:32.433108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6792349b-58c8-4767-9754-4cd15bb90cbd None None] MFA Rules not processed for user `9ffef7640dd1487ab2ea91fc0f4be9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:32.438091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6792349b-58c8-4767-9754-4cd15bb90cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:32.529470 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6381b-26c8-4a6b-be94-d779a6a8cc24 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:32.534808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-aad6381b-26c8-4a6b-be94-d779a6a8cc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:32.601950 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 818/1658] 10.222.0.110 () {58 vars in 1062 bytes} [Thu May 26 16:42:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:32.602769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6381b-26c8-4a6b-be94-d779a6a8cc24 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:32.603884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792349b-58c8-4767-9754-4cd15bb90cbd None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:32.617489 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ed759-612d-4380-9b86-2e006ff43d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:32.620065 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ed759-612d-4380-9b86-2e006ff43d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:32.623895 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792349b-58c8-4767-9754-4cd15bb90cbd None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:32.624283 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ed759-612d-4380-9b86-2e006ff43d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:32.624908 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ed759-612d-4380-9b86-2e006ff43d48 admin admin] PATH_INFO: `/v3/projects/09376bf1048d4dc489c93042d216f316` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:32.627573 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ed759-612d-4380-9b86-2e006ff43d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09376bf1048d4dc489c93042d216f316)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:32.630075 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ed759-612d-4380-9b86-2e006ff43d48 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:32.636308 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdb3fd-4438-45d9-ab64-397479d11baa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ffef7640dd1487ab2ea91fc0f4be9e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:32.637246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdb3fd-4438-45d9-ab64-397479d11baa service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:32.637692 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdb3fd-4438-45d9-ab64-397479d11baa service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:32.641183 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdb3fd-4438-45d9-ab64-397479d11baa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:32.644519 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c4cdb3fd-4438-45d9-ab64-397479d11baa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:32.731327 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdb3fd-4438-45d9-ab64-397479d11baa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:32.735943 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdb3fd-4438-45d9-ab64-397479d11baa service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:32.745235 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-535ed759-612d-4380-9b86-2e006ff43d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09376bf1048d4dc489c93042d216f316', 'request_id': 'req-535ed759-612d-4380-9b86-2e006ff43d48'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:32.763767 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-535ed759-612d-4380-9b86-2e006ff43d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09376bf1048d4dc489c93042d216f316', 'request_id': 'req-535ed759-612d-4380-9b86-2e006ff43d48'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:32.774654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-535ed759-612d-4380-9b86-2e006ff43d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09376bf1048d4dc489c93042d216f316', 'request_id': 'req-535ed759-612d-4380-9b86-2e006ff43d48'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:32.805340 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 819/1659] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:32.807166 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-535ed759-612d-4380-9b86-2e006ff43d48 admin admin] The token cache is being invalidate because project 09376bf1048d4dc489c93042d216f316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:32.807462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-535ed759-612d-4380-9b86-2e006ff43d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:32.807943 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdb3fd-4438-45d9-ab64-397479d11baa service placement] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:32.809008 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-535ed759-612d-4380-9b86-2e006ff43d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:32.810586 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c4cdb3fd-4438-45d9-ab64-397479d11baa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:32.814178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 841/1660] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:42:32 2022] DELETE /identity/v3/projects/09376bf1048d4dc489c93042d216f316 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:32.815189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ed759-612d-4380-9b86-2e006ff43d48 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:32.816777 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-535ed759-612d-4380-9b86-2e006ff43d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:32.849165 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdb3fd-4438-45d9-ab64-397479d11baa service placement] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:32.928381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ed759-612d-4380-9b86-2e006ff43d48 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:32.945625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be6f1a-c91c-489f-84a1-50e360964469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:32.948118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be6f1a-c91c-489f-84a1-50e360964469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:32.948780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be6f1a-c91c-489f-84a1-50e360964469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:32.949454 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be6f1a-c91c-489f-84a1-50e360964469 admin admin] PATH_INFO: `/v3/users/d00cc8a76dae49c9afb2d50c017f0df0` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:32.952329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be6f1a-c91c-489f-84a1-50e360964469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d00cc8a76dae49c9afb2d50c017f0df0)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:32.954505 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be6f1a-c91c-489f-84a1-50e360964469 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:33.030007 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86088eca-c5ea-47af-964c-4a3a330d6567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:33.031672 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86088eca-c5ea-47af-964c-4a3a330d6567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:33.032409 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86088eca-c5ea-47af-964c-4a3a330d6567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:33.033339 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86088eca-c5ea-47af-964c-4a3a330d6567 admin admin] PATH_INFO: `/v3/projects/533272fd6c114969b9eb37f966cf912d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:33.050221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86088eca-c5ea-47af-964c-4a3a330d6567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=533272fd6c114969b9eb37f966cf912d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:33.051018 dv-cinder-836072-5-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-86088eca-c5ea-47af-964c-4a3a330d6567 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:42:33.051018 dv-cinder-836072-5-smb devstack@keystone.service[80419]: warnings.warn(msg) May 26 16:42:33.051018 dv-cinder-836072-5-smb devstack@keystone.service[80419]: May 26 16:42:33.055074 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86088eca-c5ea-47af-964c-4a3a330d6567 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:33.081076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-83be6f1a-c91c-489f-84a1-50e360964469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd00cc8a76dae49c9afb2d50c017f0df0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:33.113456 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:33.119166 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-83be6f1a-c91c-489f-84a1-50e360964469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd00cc8a76dae49c9afb2d50c017f0df0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:33.120355 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-83be6f1a-c91c-489f-84a1-50e360964469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd00cc8a76dae49c9afb2d50c017f0df0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:33.142859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-83be6f1a-c91c-489f-84a1-50e360964469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd00cc8a76dae49c9afb2d50c017f0df0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:33.143687 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-83be6f1a-c91c-489f-84a1-50e360964469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd00cc8a76dae49c9afb2d50c017f0df0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:33.177608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 842/1661] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:42:32 2022] DELETE /identity/v3/users/d00cc8a76dae49c9afb2d50c017f0df0 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:33.214331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-86088eca-c5ea-47af-964c-4a3a330d6567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '533272fd6c114969b9eb37f966cf912d', 'request_id': 'req-86088eca-c5ea-47af-964c-4a3a330d6567'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:33.235922 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-86088eca-c5ea-47af-964c-4a3a330d6567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '533272fd6c114969b9eb37f966cf912d', 'request_id': 'req-86088eca-c5ea-47af-964c-4a3a330d6567'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:33.330017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-86088eca-c5ea-47af-964c-4a3a330d6567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '533272fd6c114969b9eb37f966cf912d', 'request_id': 'req-86088eca-c5ea-47af-964c-4a3a330d6567'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:33.398086 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-86088eca-c5ea-47af-964c-4a3a330d6567 admin admin] The token cache is being invalidate because project 533272fd6c114969b9eb37f966cf912d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:33.399449 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-86088eca-c5ea-47af-964c-4a3a330d6567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:33.400850 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-86088eca-c5ea-47af-964c-4a3a330d6567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:33.407961 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 820/1662] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:42:32 2022] DELETE /identity/v3/projects/533272fd6c114969b9eb37f966cf912d => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:33.414784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058e7a9-417a-4203-9dd9-2f153a0fd937 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:33.416324 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058e7a9-417a-4203-9dd9-2f153a0fd937 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:33.416960 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058e7a9-417a-4203-9dd9-2f153a0fd937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:33.476610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d058e7a9-417a-4203-9dd9-2f153a0fd937 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:33.484177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d058e7a9-417a-4203-9dd9-2f153a0fd937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:33.769774 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 843/1663] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:33.774963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b7422-4205-47a2-85f2-b8c2d040cc93 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:33.775250 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b7422-4205-47a2-85f2-b8c2d040cc93 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:33.775593 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b7422-4205-47a2-85f2-b8c2d040cc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:33.793814 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:33.844433 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a33b7422-4205-47a2-85f2-b8c2d040cc93 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:33.845737 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a33b7422-4205-47a2-85f2-b8c2d040cc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:33.880332 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 821/1664] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:33.882022 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058e7a9-417a-4203-9dd9-2f153a0fd937 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:33.904776 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058e7a9-417a-4203-9dd9-2f153a0fd937 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:33.917530 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91196bb6-d806-4e12-8981-865f80f7d116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:33.918383 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91196bb6-d806-4e12-8981-865f80f7d116 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:33.921302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91196bb6-d806-4e12-8981-865f80f7d116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:33.921712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91196bb6-d806-4e12-8981-865f80f7d116 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:33.922605 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91196bb6-d806-4e12-8981-865f80f7d116 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:33.923031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91196bb6-d806-4e12-8981-865f80f7d116 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:33.926821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91196bb6-d806-4e12-8981-865f80f7d116 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:33.994221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b7422-4205-47a2-85f2-b8c2d040cc93 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:33.995470 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 844/1665] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:42:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:34.017592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b7422-4205-47a2-85f2-b8c2d040cc93 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:34.048578 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60466f99-367e-4f61-ae28-46397bfb0dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:34.053476 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60466f99-367e-4f61-ae28-46397bfb0dea admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.055279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60466f99-367e-4f61-ae28-46397bfb0dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.055897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60466f99-367e-4f61-ae28-46397bfb0dea admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.071633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60466f99-367e-4f61-ae28-46397bfb0dea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:34.072145 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91196bb6-d806-4e12-8981-865f80f7d116 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:34.075135 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-91196bb6-d806-4e12-8981-865f80f7d116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:34.075285 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60466f99-367e-4f61-ae28-46397bfb0dea admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:34.100736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91196bb6-d806-4e12-8981-865f80f7d116 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:34.130964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f0884-c242-4f8a-a42c-de83f862989c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:34.131965 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f0884-c242-4f8a-a42c-de83f862989c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.132260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f0884-c242-4f8a-a42c-de83f862989c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.133053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f0884-c242-4f8a-a42c-de83f862989c admin admin] PATH_INFO: `/v3/users/db949532cadf4a65a86e24d86e937426` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.136749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f0884-c242-4f8a-a42c-de83f862989c admin admin] RBAC: Authorizing `identity:delete_user(user_id=db949532cadf4a65a86e24d86e937426)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:34.140437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f0884-c242-4f8a-a42c-de83f862989c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:34.183145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 822/1666] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:33 2022] POST /identity/v3/projects => generated 404 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:34.184282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60466f99-367e-4f61-ae28-46397bfb0dea admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:34.201979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-60466f99-367e-4f61-ae28-46397bfb0dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:34.374306 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60466f99-367e-4f61-ae28-46397bfb0dea admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:34.380445 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbecfc7-c9e8-4e9c-9e8d-e9967988a05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:34.382123 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbecfc7-c9e8-4e9c-9e8d-e9967988a05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.382669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbecfc7-c9e8-4e9c-9e8d-e9967988a05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.383351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbecfc7-c9e8-4e9c-9e8d-e9967988a05a admin admin] PATH_INFO: `/v3/projects/c665447bf3df4eef894a6aa2567bc210` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.385464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbecfc7-c9e8-4e9c-9e8d-e9967988a05a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c665447bf3df4eef894a6aa2567bc210)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:34.389677 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbecfc7-c9e8-4e9c-9e8d-e9967988a05a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:34.455253 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-869f0884-c242-4f8a-a42c-de83f862989c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db949532cadf4a65a86e24d86e937426'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.476477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4cbecfc7-c9e8-4e9c-9e8d-e9967988a05a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c665447bf3df4eef894a6aa2567bc210', 'request_id': 'req-4cbecfc7-c9e8-4e9c-9e8d-e9967988a05a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.478721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-869f0884-c242-4f8a-a42c-de83f862989c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db949532cadf4a65a86e24d86e937426'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.479807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-869f0884-c242-4f8a-a42c-de83f862989c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db949532cadf4a65a86e24d86e937426'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.487130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4cbecfc7-c9e8-4e9c-9e8d-e9967988a05a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c665447bf3df4eef894a6aa2567bc210', 'request_id': 'req-4cbecfc7-c9e8-4e9c-9e8d-e9967988a05a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.489748 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-869f0884-c242-4f8a-a42c-de83f862989c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db949532cadf4a65a86e24d86e937426'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.490754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-869f0884-c242-4f8a-a42c-de83f862989c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db949532cadf4a65a86e24d86e937426'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.514870 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4cbecfc7-c9e8-4e9c-9e8d-e9967988a05a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c665447bf3df4eef894a6aa2567bc210', 'request_id': 'req-4cbecfc7-c9e8-4e9c-9e8d-e9967988a05a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.542425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 845/1667] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:42:34 2022] DELETE /identity/v3/users/db949532cadf4a65a86e24d86e937426 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:34.547694 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f0884-c242-4f8a-a42c-de83f862989c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:34.550408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-869f0884-c242-4f8a-a42c-de83f862989c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:34.567806 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4cbecfc7-c9e8-4e9c-9e8d-e9967988a05a admin admin] The token cache is being invalidate because project c665447bf3df4eef894a6aa2567bc210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:34.568518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4cbecfc7-c9e8-4e9c-9e8d-e9967988a05a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.569834 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4cbecfc7-c9e8-4e9c-9e8d-e9967988a05a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.574807 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 823/1668] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:42:34 2022] DELETE /identity/v3/projects/c665447bf3df4eef894a6aa2567bc210 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:34.574807 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce04d4-4dd9-43bf-8bb4-b5ee796f4c6b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.575006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce04d4-4dd9-43bf-8bb4-b5ee796f4c6b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.575307 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce04d4-4dd9-43bf-8bb4-b5ee796f4c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.611699 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-55ce04d4-4dd9-43bf-8bb4-b5ee796f4c6b None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:34.617185 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-55ce04d4-4dd9-43bf-8bb4-b5ee796f4c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:34.670995 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:34.713566 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f0884-c242-4f8a-a42c-de83f862989c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:34.743202 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2da15-b2f8-4551-921e-2624b1b72bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:34.743917 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2da15-b2f8-4551-921e-2624b1b72bcf admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.744473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2da15-b2f8-4551-921e-2624b1b72bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.744743 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2da15-b2f8-4551-921e-2624b1b72bcf admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.745517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2da15-b2f8-4551-921e-2624b1b72bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:34.747612 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2da15-b2f8-4551-921e-2624b1b72bcf admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:34.842170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 846/1669] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:34 2022] POST /identity/v3/users => generated 303 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:34.843579 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5df7e-5041-45a6-9816-255fc677dabf None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.843871 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5df7e-5041-45a6-9816-255fc677dabf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.844150 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5df7e-5041-45a6-9816-255fc677dabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.866919 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 824/1670] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:34.866919 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce04d4-4dd9-43bf-8bb4-b5ee796f4c6b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:34.867766 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-55ce04d4-4dd9-43bf-8bb4-b5ee796f4c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:34.883084 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c7c5df7e-5041-45a6-9816-255fc677dabf None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:34.886599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c7c5df7e-5041-45a6-9816-255fc677dabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:34.918623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce04d4-4dd9-43bf-8bb4-b5ee796f4c6b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:34.920260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 847/1671] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:34.921370 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5df7e-5041-45a6-9816-255fc677dabf None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:34.923483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c7c5df7e-5041-45a6-9816-255fc677dabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:34.951478 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e85fab-ab1e-40e5-973f-1463bf5ba860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:34.952456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e85fab-ab1e-40e5-973f-1463bf5ba860 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.955394 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e85fab-ab1e-40e5-973f-1463bf5ba860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.959605 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e85fab-ab1e-40e5-973f-1463bf5ba860 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.960580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e85fab-ab1e-40e5-973f-1463bf5ba860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:34.966878 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e85fab-ab1e-40e5-973f-1463bf5ba860 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:34.973311 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:34.994257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 825/1672] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:34 2022] GET /identity/v3/roles => generated 1427 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:34.996412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f486472-0dc0-4791-9999-fc404d81797e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.996715 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f486472-0dc0-4791-9999-fc404d81797e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.997006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f486472-0dc0-4791-9999-fc404d81797e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.045817 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4f486472-0dc0-4791-9999-fc404d81797e None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:35.050781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4f486472-0dc0-4791-9999-fc404d81797e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:35.079762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 826/1673] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:35.080799 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f486472-0dc0-4791-9999-fc404d81797e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:35.083898 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5df7e-5041-45a6-9816-255fc677dabf None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:35.096099 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820fc19-96a4-4c60-b1f4-6d30be0d1315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:35.096803 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820fc19-96a4-4c60-b1f4-6d30be0d1315 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.097422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f486472-0dc0-4791-9999-fc404d81797e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:35.097631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820fc19-96a4-4c60-b1f4-6d30be0d1315 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.097923 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820fc19-96a4-4c60-b1f4-6d30be0d1315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.112449 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef813e7-e089-40e7-8974-a8281d644764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:35.112965 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef813e7-e089-40e7-8974-a8281d644764 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.113583 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef813e7-e089-40e7-8974-a8281d644764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.113897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef813e7-e089-40e7-8974-a8281d644764 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.114701 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef813e7-e089-40e7-8974-a8281d644764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:35.116649 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef813e7-e089-40e7-8974-a8281d644764 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:35.120023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820fc19-96a4-4c60-b1f4-6d30be0d1315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:35.123526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820fc19-96a4-4c60-b1f4-6d30be0d1315 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:35.146092 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 827/1674] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:35 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:35.147258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef813e7-e089-40e7-8974-a8281d644764 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:35.153112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 848/1675] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:35.161963 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820fc19-96a4-4c60-b1f4-6d30be0d1315 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:35.178938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820fc19-96a4-4c60-b1f4-6d30be0d1315 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:35.184271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13134a-4623-4d07-98a6-3a82f89fad9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:35.185224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13134a-4623-4d07-98a6-3a82f89fad9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.185506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13134a-4623-4d07-98a6-3a82f89fad9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.185778 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13134a-4623-4d07-98a6-3a82f89fad9a admin admin] PATH_INFO: `/v3/projects/bf707a2c409145af98e66bf572a9f27d/users/08c2251428f44f6090b5f1a972148161/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.189377 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef813e7-e089-40e7-8974-a8281d644764 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:35.203778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537324c-72ab-49df-96cf-63725d237b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:35.204673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537324c-72ab-49df-96cf-63725d237b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.205629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537324c-72ab-49df-96cf-63725d237b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.206062 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537324c-72ab-49df-96cf-63725d237b52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.206998 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537324c-72ab-49df-96cf-63725d237b52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:35.207316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537324c-72ab-49df-96cf-63725d237b52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:35.209534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13134a-4623-4d07-98a6-3a82f89fad9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf707a2c409145af98e66bf572a9f27d, user_id=08c2251428f44f6090b5f1a972148161, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:35.213543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13134a-4623-4d07-98a6-3a82f89fad9a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:35.232666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537324c-72ab-49df-96cf-63725d237b52 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:35.257978 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 849/1676] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:35 2022] PUT /identity/v3/projects/bf707a2c409145af98e66bf572a9f27d/users/08c2251428f44f6090b5f1a972148161/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:35.273523 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97b264-a872-4936-b5ad-dec5338c8190 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.274186 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97b264-a872-4936-b5ad-dec5338c8190 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.274944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97b264-a872-4936-b5ad-dec5338c8190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.297060 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 828/1677] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:42:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:35.298802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537324c-72ab-49df-96cf-63725d237b52 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:35.316426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537324c-72ab-49df-96cf-63725d237b52 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:35.370611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ec97b264-a872-4936-b5ad-dec5338c8190 None None] MFA Rules not processed for user `08c2251428f44f6090b5f1a972148161`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:35.372616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ec97b264-a872-4936-b5ad-dec5338c8190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:35.462407 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b735c-d54c-4b79-88b5-b0da9d3aed09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:35.463138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b735c-d54c-4b79-88b5-b0da9d3aed09 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.463615 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b735c-d54c-4b79-88b5-b0da9d3aed09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.463892 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b735c-d54c-4b79-88b5-b0da9d3aed09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.464594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b735c-d54c-4b79-88b5-b0da9d3aed09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:35.494216 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b735c-d54c-4b79-88b5-b0da9d3aed09 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:35.538216 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 850/1678] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:35 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:35.540571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97b264-a872-4936-b5ad-dec5338c8190 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:35.585578 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97b264-a872-4936-b5ad-dec5338c8190 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:35.590044 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 829/1679] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:35 2022] POST /identity/v3/projects => generated 392 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:35.592145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b735c-d54c-4b79-88b5-b0da9d3aed09 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:35.638463 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:35.722104 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94578e4e-837f-401b-944c-ee76a4ff47a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:35.723319 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94578e4e-837f-401b-944c-ee76a4ff47a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.723828 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94578e4e-837f-401b-944c-ee76a4ff47a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.724359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94578e4e-837f-401b-944c-ee76a4ff47a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.725822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94578e4e-837f-401b-944c-ee76a4ff47a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:35.728173 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94578e4e-837f-401b-944c-ee76a4ff47a4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:35.799189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 851/1680] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:35 2022] POST /identity/v3/projects => generated 404 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:35.800666 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94578e4e-837f-401b-944c-ee76a4ff47a4 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:35.891989 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b735c-d54c-4b79-88b5-b0da9d3aed09 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:36.018000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94578e4e-837f-401b-944c-ee76a4ff47a4 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:36.032758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9199fd-a5be-4ca5-9eb3-624cfe8ebd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:36.033613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9199fd-a5be-4ca5-9eb3-624cfe8ebd47 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.034140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9199fd-a5be-4ca5-9eb3-624cfe8ebd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.034540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9199fd-a5be-4ca5-9eb3-624cfe8ebd47 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.035368 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9199fd-a5be-4ca5-9eb3-624cfe8ebd47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:36.039920 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:36.041274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9199fd-a5be-4ca5-9eb3-624cfe8ebd47 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:36.051613 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f8dd6-3935-42c0-b3ca-5e834a8d87ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:36.053128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f8dd6-3935-42c0-b3ca-5e834a8d87ae admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.053516 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f8dd6-3935-42c0-b3ca-5e834a8d87ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.053802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f8dd6-3935-42c0-b3ca-5e834a8d87ae admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.054595 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f8dd6-3935-42c0-b3ca-5e834a8d87ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:36.057483 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f8dd6-3935-42c0-b3ca-5e834a8d87ae admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:36.087114 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 830/1681] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:35 2022] POST /identity/v3/users => generated 297 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:36.088559 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f8dd6-3935-42c0-b3ca-5e834a8d87ae admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.092758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2a4f8dd6-3935-42c0-b3ca-5e834a8d87ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:36.094921 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 852/1682] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:35 2022] POST /identity/v3/users => generated 309 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:36.097383 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9199fd-a5be-4ca5-9eb3-624cfe8ebd47 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.126087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9199fd-a5be-4ca5-9eb3-624cfe8ebd47 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:36.131518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f8dd6-3935-42c0-b3ca-5e834a8d87ae admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:36.136977 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7b1ed-3318-4705-b7da-2b96371b96fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:36.137670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7b1ed-3318-4705-b7da-2b96371b96fe admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.138019 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7b1ed-3318-4705-b7da-2b96371b96fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.138311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7b1ed-3318-4705-b7da-2b96371b96fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.140689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7b1ed-3318-4705-b7da-2b96371b96fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:36.143307 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7b1ed-3318-4705-b7da-2b96371b96fe admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:36.145999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854aa7b-0864-4dad-94fa-5520b8395594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:36.146956 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854aa7b-0864-4dad-94fa-5520b8395594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.147244 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854aa7b-0864-4dad-94fa-5520b8395594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.147522 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854aa7b-0864-4dad-94fa-5520b8395594 admin admin] PATH_INFO: `/v3/projects/29039bf5c693468da5048c840ffe09f2` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.152789 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854aa7b-0864-4dad-94fa-5520b8395594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29039bf5c693468da5048c840ffe09f2)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:36.158778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854aa7b-0864-4dad-94fa-5520b8395594 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:36.175583 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 853/1683] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:36 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:36.176627 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7b1ed-3318-4705-b7da-2b96371b96fe admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.235211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7b1ed-3318-4705-b7da-2b96371b96fe admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:36.259173 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9936220-c60a-4d88-8de2-ed8b6966af3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:36.260818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9936220-c60a-4d88-8de2-ed8b6966af3c admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.261269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9936220-c60a-4d88-8de2-ed8b6966af3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.261567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9936220-c60a-4d88-8de2-ed8b6966af3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.262460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9936220-c60a-4d88-8de2-ed8b6966af3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:36.264499 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9936220-c60a-4d88-8de2-ed8b6966af3c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:36.302411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 854/1684] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:36 2022] GET /identity/v3/roles => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:36.308007 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9936220-c60a-4d88-8de2-ed8b6966af3c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.368407 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d854aa7b-0864-4dad-94fa-5520b8395594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29039bf5c693468da5048c840ffe09f2', 'request_id': 'req-d854aa7b-0864-4dad-94fa-5520b8395594'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:36.369388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9936220-c60a-4d88-8de2-ed8b6966af3c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:36.392806 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d854aa7b-0864-4dad-94fa-5520b8395594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29039bf5c693468da5048c840ffe09f2', 'request_id': 'req-d854aa7b-0864-4dad-94fa-5520b8395594'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:36.427699 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d854aa7b-0864-4dad-94fa-5520b8395594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29039bf5c693468da5048c840ffe09f2', 'request_id': 'req-d854aa7b-0864-4dad-94fa-5520b8395594'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:36.472969 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d854aa7b-0864-4dad-94fa-5520b8395594 admin admin] The token cache is being invalidate because project 29039bf5c693468da5048c840ffe09f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:36.473850 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d854aa7b-0864-4dad-94fa-5520b8395594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:36.476439 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d854aa7b-0864-4dad-94fa-5520b8395594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:36.489530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 831/1685] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:42:36 2022] DELETE /identity/v3/projects/29039bf5c693468da5048c840ffe09f2 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:36.490845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854aa7b-0864-4dad-94fa-5520b8395594 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.494027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d854aa7b-0864-4dad-94fa-5520b8395594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:36.577945 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b161d3-ab13-4ef4-93ca-28cccbd56b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:36.578676 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b161d3-ab13-4ef4-93ca-28cccbd56b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.578968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b161d3-ab13-4ef4-93ca-28cccbd56b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.592608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b161d3-ab13-4ef4-93ca-28cccbd56b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.594017 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b161d3-ab13-4ef4-93ca-28cccbd56b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:36.598488 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b161d3-ab13-4ef4-93ca-28cccbd56b0e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:36.629179 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 855/1686] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:36 2022] GET /identity/v3/roles => generated 1427 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:36.630590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efc9d8-d95b-4b9d-9b47-8cce9b623692 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.630877 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efc9d8-d95b-4b9d-9b47-8cce9b623692 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.631158 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efc9d8-d95b-4b9d-9b47-8cce9b623692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.690436 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854aa7b-0864-4dad-94fa-5520b8395594 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:36.697309 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-34efc9d8-d95b-4b9d-9b47-8cce9b623692 None None] MFA Rules not processed for user `7535a906d3884263b6f031080c72cc6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:36.700117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-34efc9d8-d95b-4b9d-9b47-8cce9b623692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:36.703151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34537bb7-00e6-4a8a-940a-e804bd10399b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:36.704596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34537bb7-00e6-4a8a-940a-e804bd10399b admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.705278 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34537bb7-00e6-4a8a-940a-e804bd10399b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.705563 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34537bb7-00e6-4a8a-940a-e804bd10399b admin admin] PATH_INFO: `/v3/projects/d92290f45664486eac09c6e295b3f71f/users/0debf657960041c78ca426505a822dca/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.712522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:36.743318 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34537bb7-00e6-4a8a-940a-e804bd10399b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92290f45664486eac09c6e295b3f71f, user_id=0debf657960041c78ca426505a822dca, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:36.750834 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34537bb7-00e6-4a8a-940a-e804bd10399b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:36.780891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 832/1687] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:36 2022] PUT /identity/v3/projects/d92290f45664486eac09c6e295b3f71f/users/0debf657960041c78ca426505a822dca/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:36.784570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a124a-def9-4b79-87b3-9ac621721f8c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.785106 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a124a-def9-4b79-87b3-9ac621721f8c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.786132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a124a-def9-4b79-87b3-9ac621721f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.823815 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-df1a124a-def9-4b79-87b3-9ac621721f8c None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:36.825132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-df1a124a-def9-4b79-87b3-9ac621721f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:36.924072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 856/1688] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:36.925310 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efc9d8-d95b-4b9d-9b47-8cce9b623692 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.933532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-34efc9d8-d95b-4b9d-9b47-8cce9b623692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:36.963247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efc9d8-d95b-4b9d-9b47-8cce9b623692 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.008947 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:37.055299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 833/1689] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:37.056524 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a124a-def9-4b79-87b3-9ac621721f8c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.071250 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a124a-def9-4b79-87b3-9ac621721f8c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.093985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc135af3-68ff-45ad-a38f-7054208cc1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.094836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc135af3-68ff-45ad-a38f-7054208cc1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.095031 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc135af3-68ff-45ad-a38f-7054208cc1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.095465 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc135af3-68ff-45ad-a38f-7054208cc1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.096228 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc135af3-68ff-45ad-a38f-7054208cc1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.099471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc135af3-68ff-45ad-a38f-7054208cc1e2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.109795 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5977f99-8e90-404e-b4dd-262a3be5679d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.110367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5977f99-8e90-404e-b4dd-262a3be5679d admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.110971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5977f99-8e90-404e-b4dd-262a3be5679d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.111259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5977f99-8e90-404e-b4dd-262a3be5679d admin admin] PATH_INFO: `/v3/projects/903ec96df92c42208d37eb573148cc87/users/19295a71f1c64b4590a81d1d7305731f/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.132018 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 834/1690] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:37 2022] GET /identity/v3/roles => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:37.132972 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc135af3-68ff-45ad-a38f-7054208cc1e2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.137183 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5977f99-8e90-404e-b4dd-262a3be5679d admin admin] RBAC: Authorizing `identity:create_grant(project_id=903ec96df92c42208d37eb573148cc87, user_id=19295a71f1c64b4590a81d1d7305731f, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.138752 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bc135af3-68ff-45ad-a38f-7054208cc1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:37.141071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5977f99-8e90-404e-b4dd-262a3be5679d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.175078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 857/1691] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:36 2022] PUT /identity/v3/projects/903ec96df92c42208d37eb573148cc87/users/19295a71f1c64b4590a81d1d7305731f/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:37.175078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8c3c6-3999-4197-898c-7dfce37fa441 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.175078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8c3c6-3999-4197-898c-7dfce37fa441 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.175078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8c3c6-3999-4197-898c-7dfce37fa441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.215280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-aaf8c3c6-3999-4197-898c-7dfce37fa441 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:37.217350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-aaf8c3c6-3999-4197-898c-7dfce37fa441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:37.366275 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc135af3-68ff-45ad-a38f-7054208cc1e2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.376701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 858/1692] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:37.377623 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8c3c6-3999-4197-898c-7dfce37fa441 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.412647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8c3c6-3999-4197-898c-7dfce37fa441 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.431942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17508e24-57b8-4f3c-bd88-758113beb654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.435570 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17508e24-57b8-4f3c-bd88-758113beb654 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.436167 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17508e24-57b8-4f3c-bd88-758113beb654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.437643 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17508e24-57b8-4f3c-bd88-758113beb654 admin admin] PATH_INFO: `/v3/projects/d92290f45664486eac09c6e295b3f71f/users/0debf657960041c78ca426505a822dca/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.447587 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17508e24-57b8-4f3c-bd88-758113beb654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92290f45664486eac09c6e295b3f71f, user_id=0debf657960041c78ca426505a822dca, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.461414 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17508e24-57b8-4f3c-bd88-758113beb654 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.523912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 859/1693] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:37 2022] PUT /identity/v3/projects/d92290f45664486eac09c6e295b3f71f/users/0debf657960041c78ca426505a822dca/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:37.523912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db18725-c546-48fd-99d3-bbb12720536d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.523912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db18725-c546-48fd-99d3-bbb12720536d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.523912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db18725-c546-48fd-99d3-bbb12720536d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.586290 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be16484-08ac-4292-ab63-a56f8af4673b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.587177 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be16484-08ac-4292-ab63-a56f8af4673b service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.587471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be16484-08ac-4292-ab63-a56f8af4673b service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.587753 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be16484-08ac-4292-ab63-a56f8af4673b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.597734 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0db18725-c546-48fd-99d3-bbb12720536d None None] MFA Rules not processed for user `19295a71f1c64b4590a81d1d7305731f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:37.599070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0db18725-c546-48fd-99d3-bbb12720536d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:37.609512 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:37.815800 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 860/1694] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:37.816510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db18725-c546-48fd-99d3-bbb12720536d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.818998 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be16484-08ac-4292-ab63-a56f8af4673b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.825180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be16484-08ac-4292-ab63-a56f8af4673b service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.866022 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 835/1695] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 733 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:37.868437 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08053fb4-9494-413a-8159-48e0afa5c9e3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.871819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08053fb4-9494-413a-8159-48e0afa5c9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.875132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08053fb4-9494-413a-8159-48e0afa5c9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.980951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-08053fb4-9494-413a-8159-48e0afa5c9e3 None None] MFA Rules not processed for user `0debf657960041c78ca426505a822dca`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:37.983470 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-08053fb4-9494-413a-8159-48e0afa5c9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:37.990046 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:38.023044 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db18725-c546-48fd-99d3-bbb12720536d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.050429 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2025e4-ad1a-4e38-ac7f-2d380e0ea4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:38.051356 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2025e4-ad1a-4e38-ac7f-2d380e0ea4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.051791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2025e4-ad1a-4e38-ac7f-2d380e0ea4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.052275 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2025e4-ad1a-4e38-ac7f-2d380e0ea4a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.053996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2025e4-ad1a-4e38-ac7f-2d380e0ea4a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:38.054402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2025e4-ad1a-4e38-ac7f-2d380e0ea4a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:38.057829 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2025e4-ad1a-4e38-ac7f-2d380e0ea4a9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:38.099274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 861/1696] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:42:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:38.103484 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c9e19-60e1-48f3-b480-f186f98d30a1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.110897 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c9e19-60e1-48f3-b480-f186f98d30a1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.113863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c9e19-60e1-48f3-b480-f186f98d30a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.181469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-644c9e19-60e1-48f3-b480-f186f98d30a1 None None] MFA Rules not processed for user `ebf3257328b94092b544cb0dadb789c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:38.188019 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-644c9e19-60e1-48f3-b480-f186f98d30a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:38.191600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 836/1697] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:37 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:38.193676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08053fb4-9494-413a-8159-48e0afa5c9e3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:38.221048 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08053fb4-9494-413a-8159-48e0afa5c9e3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.235526 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281014b-1910-4d4a-877a-fc4572620eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:38.236227 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281014b-1910-4d4a-877a-fc4572620eab admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.236508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281014b-1910-4d4a-877a-fc4572620eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.236788 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281014b-1910-4d4a-877a-fc4572620eab admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.237504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281014b-1910-4d4a-877a-fc4572620eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:38.239503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281014b-1910-4d4a-877a-fc4572620eab admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:38.306241 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 837/1698] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:38 2022] POST /identity/v3/projects => generated 394 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:38.310797 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef4ebb-2806-4285-ba61-0212680331f5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.311091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef4ebb-2806-4285-ba61-0212680331f5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.314665 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef4ebb-2806-4285-ba61-0212680331f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.336164 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 862/1699] 10.222.0.110 () {58 vars in 1014 bytes} [Thu May 26 16:42:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:38.337330 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c9e19-60e1-48f3-b480-f186f98d30a1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:38.380145 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c9e19-60e1-48f3-b480-f186f98d30a1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.397972 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-49ef4ebb-2806-4285-ba61-0212680331f5 None None] MFA Rules not processed for user `01d3da9345ed40f396730e41ccdda091`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:38.399304 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-49ef4ebb-2806-4285-ba61-0212680331f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:38.536696 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:38.576036 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5358c-4923-4667-95cd-804630a0a44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:38.579606 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5358c-4923-4667-95cd-804630a0a44d admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.580186 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5358c-4923-4667-95cd-804630a0a44d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.580480 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5358c-4923-4667-95cd-804630a0a44d admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.583590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5358c-4923-4667-95cd-804630a0a44d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:38.588645 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5358c-4923-4667-95cd-804630a0a44d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:38.681639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 838/1700] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:38.681639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef4ebb-2806-4285-ba61-0212680331f5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:38.681639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-49ef4ebb-2806-4285-ba61-0212680331f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:38.705618 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 863/1701] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:38 2022] POST /identity/v3/projects => generated 388 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:38.705618 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5358c-4923-4667-95cd-804630a0a44d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:38.866333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef4ebb-2806-4285-ba61-0212680331f5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.874902 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5358c-4923-4667-95cd-804630a0a44d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.881198 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514bfff-933e-4e9a-92e5-1aaf356f7c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:38.882802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514bfff-933e-4e9a-92e5-1aaf356f7c04 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.883168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514bfff-933e-4e9a-92e5-1aaf356f7c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.883529 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514bfff-933e-4e9a-92e5-1aaf356f7c04 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.884527 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514bfff-933e-4e9a-92e5-1aaf356f7c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:38.887529 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514bfff-933e-4e9a-92e5-1aaf356f7c04 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:38.919156 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:38.943231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 864/1702] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:38 2022] POST /identity/v3/users => generated 304 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:38.943231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514bfff-933e-4e9a-92e5-1aaf356f7c04 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:38.948598 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f514bfff-933e-4e9a-92e5-1aaf356f7c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:38.964456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3f74e-d526-4617-b632-423868f5a991 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:38.965395 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3f74e-d526-4617-b632-423868f5a991 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.965760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3f74e-d526-4617-b632-423868f5a991 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.966093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3f74e-d526-4617-b632-423868f5a991 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.075476 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3f74e-d526-4617-b632-423868f5a991 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:39.077266 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3f74e-d526-4617-b632-423868f5a991 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:39.095367 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 839/1703] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:38 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:39.096095 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3f74e-d526-4617-b632-423868f5a991 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:39.102383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0ca3f74e-d526-4617-b632-423868f5a991 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:39.254509 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514bfff-933e-4e9a-92e5-1aaf356f7c04 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:39.271067 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e954d6f-d8ab-4f2c-839a-7e243de5289e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4502c57e324c31a8bce12770a92371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:39.273436 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e954d6f-d8ab-4f2c-839a-7e243de5289e service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:39.273734 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e954d6f-d8ab-4f2c-839a-7e243de5289e service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:39.274021 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e954d6f-d8ab-4f2c-839a-7e243de5289e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.315674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3f74e-d526-4617-b632-423868f5a991 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:39.329921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5608a-3252-4565-a6ee-a6f580f74c97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:39.330648 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5608a-3252-4565-a6ee-a6f580f74c97 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:39.330937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5608a-3252-4565-a6ee-a6f580f74c97 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:39.331232 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5608a-3252-4565-a6ee-a6f580f74c97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.534302 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5608a-3252-4565-a6ee-a6f580f74c97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:39.534886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e954d6f-d8ab-4f2c-839a-7e243de5289e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:39.534886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e954d6f-d8ab-4f2c-839a-7e243de5289e service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:39.535080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5608a-3252-4565-a6ee-a6f580f74c97 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:39.556142 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 840/1704] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:39.564513 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 865/1705] 10.222.0.110 () {60 vars in 1389 bytes} [Thu May 26 16:42:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:42:39.565625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e954d6f-d8ab-4f2c-839a-7e243de5289e service swift] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:39.579903 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5608a-3252-4565-a6ee-a6f580f74c97 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:39.593659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:39.607096 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e954d6f-d8ab-4f2c-839a-7e243de5289e service swift] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:39.614881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5608a-3252-4565-a6ee-a6f580f74c97 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:39.628410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae813edf-f914-4a14-a0c1-d1504a44b852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:39.630238 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7792d24-7f21-4880-a4a8-87ae44572937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:39.631009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7792d24-7f21-4880-a4a8-87ae44572937 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:39.631303 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7792d24-7f21-4880-a4a8-87ae44572937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:39.631545 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7792d24-7f21-4880-a4a8-87ae44572937 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.632491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7792d24-7f21-4880-a4a8-87ae44572937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:39.634398 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7792d24-7f21-4880-a4a8-87ae44572937 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:39.646795 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae813edf-f914-4a14-a0c1-d1504a44b852 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:39.647210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae813edf-f914-4a14-a0c1-d1504a44b852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:39.647504 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae813edf-f914-4a14-a0c1-d1504a44b852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.648376 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae813edf-f914-4a14-a0c1-d1504a44b852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:39.650189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae813edf-f914-4a14-a0c1-d1504a44b852 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:39.657159 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:39.681008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 841/1706] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:39 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:39.682121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7792d24-7f21-4880-a4a8-87ae44572937 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:39.685755 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 866/1707] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:39 2022] GET /identity/v3/roles => generated 1427 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:39.686960 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae813edf-f914-4a14-a0c1-d1504a44b852 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:39.704035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7792d24-7f21-4880-a4a8-87ae44572937 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:39.709760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae813edf-f914-4a14-a0c1-d1504a44b852 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:39.724550 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026241bd-67f0-4070-a9df-d20b3752fe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:39.725651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026241bd-67f0-4070-a9df-d20b3752fe8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:39.725942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026241bd-67f0-4070-a9df-d20b3752fe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:39.726232 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026241bd-67f0-4070-a9df-d20b3752fe8d admin admin] PATH_INFO: `/v3/projects/1d189a1a76ba467180e93cdaf662102a/users/44aa3fdf1e1548579eb62285b6e365d7/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.726358 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa23c4b-cab8-43a7-bcaa-cdefe26b1eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:39.728151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa23c4b-cab8-43a7-bcaa-cdefe26b1eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:39.728676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa23c4b-cab8-43a7-bcaa-cdefe26b1eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:39.733645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa23c4b-cab8-43a7-bcaa-cdefe26b1eb0 admin admin] PATH_INFO: `/v3/users/08c2251428f44f6090b5f1a972148161` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.761087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa23c4b-cab8-43a7-bcaa-cdefe26b1eb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08c2251428f44f6090b5f1a972148161)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:39.763845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa23c4b-cab8-43a7-bcaa-cdefe26b1eb0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:39.797713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026241bd-67f0-4070-a9df-d20b3752fe8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d189a1a76ba467180e93cdaf662102a, user_id=44aa3fdf1e1548579eb62285b6e365d7, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:39.817891 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026241bd-67f0-4070-a9df-d20b3752fe8d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:39.871778 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 867/1708] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:39 2022] PUT /identity/v3/projects/1d189a1a76ba467180e93cdaf662102a/users/44aa3fdf1e1548579eb62285b6e365d7/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:39.879583 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026241bd-67f0-4070-a9df-d20b3752fe8d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:39.966921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7fa23c4b-cab8-43a7-bcaa-cdefe26b1eb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08c2251428f44f6090b5f1a972148161'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:39.971374 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7fa23c4b-cab8-43a7-bcaa-cdefe26b1eb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08c2251428f44f6090b5f1a972148161'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:39.996118 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7fa23c4b-cab8-43a7-bcaa-cdefe26b1eb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08c2251428f44f6090b5f1a972148161'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:39.997713 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7fa23c4b-cab8-43a7-bcaa-cdefe26b1eb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08c2251428f44f6090b5f1a972148161'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:40.014120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7fa23c4b-cab8-43a7-bcaa-cdefe26b1eb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08c2251428f44f6090b5f1a972148161'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:40.081063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 842/1709] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:42:39 2022] DELETE /identity/v3/users/08c2251428f44f6090b5f1a972148161 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:40.082713 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa23c4b-cab8-43a7-bcaa-cdefe26b1eb0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:40.092849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7fa23c4b-cab8-43a7-bcaa-cdefe26b1eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:40.182664 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026241bd-67f0-4070-a9df-d20b3752fe8d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:40.420961 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa23c4b-cab8-43a7-bcaa-cdefe26b1eb0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:40.446509 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f991b-a7b5-47f9-a816-2d213d6bc431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:40.448033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f991b-a7b5-47f9-a816-2d213d6bc431 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:40.448590 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f991b-a7b5-47f9-a816-2d213d6bc431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:40.449147 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f991b-a7b5-47f9-a816-2d213d6bc431 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:40.450978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f991b-a7b5-47f9-a816-2d213d6bc431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:40.457923 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f991b-a7b5-47f9-a816-2d213d6bc431 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:40.497125 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01636d83-d1df-439e-ba8e-7f1743d6c7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:40.497912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01636d83-d1df-439e-ba8e-7f1743d6c7bb admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:40.498460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01636d83-d1df-439e-ba8e-7f1743d6c7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:40.498924 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01636d83-d1df-439e-ba8e-7f1743d6c7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:40.501045 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01636d83-d1df-439e-ba8e-7f1743d6c7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:40.513253 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 843/1710] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:40 2022] GET /identity/v3/roles => generated 1427 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:40.518692 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01636d83-d1df-439e-ba8e-7f1743d6c7bb admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:40.527230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fe067-bee1-4440-949b-cd34cebb1cc8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:40.527615 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fe067-bee1-4440-949b-cd34cebb1cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:40.529449 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fe067-bee1-4440-949b-cd34cebb1cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:40.578753 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 868/1711] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:39 2022] GET /identity/v3/roles => generated 1427 bytes in 706 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:40.587061 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01636d83-d1df-439e-ba8e-7f1743d6c7bb admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:40.602548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-01636d83-d1df-439e-ba8e-7f1743d6c7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:40.643083 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4e2fe067-bee1-4440-949b-cd34cebb1cc8 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:40.655716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4e2fe067-bee1-4440-949b-cd34cebb1cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:40.703571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01636d83-d1df-439e-ba8e-7f1743d6c7bb admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:40.714656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 844/1712] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:40.721791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fe067-bee1-4440-949b-cd34cebb1cc8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:40.742532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdbade-bf7e-45ca-836c-7600d57bf671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:40.749086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdbade-bf7e-45ca-836c-7600d57bf671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:40.749086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdbade-bf7e-45ca-836c-7600d57bf671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:40.749086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdbade-bf7e-45ca-836c-7600d57bf671 admin admin] PATH_INFO: `/v3/users/9b8c65549fed48918febbf873838f012` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:40.754168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdbade-bf7e-45ca-836c-7600d57bf671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b8c65549fed48918febbf873838f012)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:40.758600 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdbade-bf7e-45ca-836c-7600d57bf671 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:40.771210 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fe067-bee1-4440-949b-cd34cebb1cc8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:40.797009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725837f-7903-403c-907b-461f8995b851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:40.799728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725837f-7903-403c-907b-461f8995b851 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:40.801240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725837f-7903-403c-907b-461f8995b851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:40.802195 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725837f-7903-403c-907b-461f8995b851 admin admin] PATH_INFO: `/v3/projects/1d189a1a76ba467180e93cdaf662102a/users/44aa3fdf1e1548579eb62285b6e365d7/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:40.815067 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725837f-7903-403c-907b-461f8995b851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d189a1a76ba467180e93cdaf662102a, user_id=44aa3fdf1e1548579eb62285b6e365d7, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:40.820618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725837f-7903-403c-907b-461f8995b851 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:40.859621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 845/1713] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:40 2022] PUT /identity/v3/projects/1d189a1a76ba467180e93cdaf662102a/users/44aa3fdf1e1548579eb62285b6e365d7/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:40.860851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725837f-7903-403c-907b-461f8995b851 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:40.873567 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c725837f-7903-403c-907b-461f8995b851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:40.942201 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-44bdbade-bf7e-45ca-836c-7600d57bf671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b8c65549fed48918febbf873838f012'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:40.988951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-44bdbade-bf7e-45ca-836c-7600d57bf671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b8c65549fed48918febbf873838f012'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:40.989928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-44bdbade-bf7e-45ca-836c-7600d57bf671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b8c65549fed48918febbf873838f012'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:40.993621 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:41.007384 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-44bdbade-bf7e-45ca-836c-7600d57bf671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b8c65549fed48918febbf873838f012'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:41.008386 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-44bdbade-bf7e-45ca-836c-7600d57bf671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b8c65549fed48918febbf873838f012'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:41.045510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 869/1714] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:42:40 2022] DELETE /identity/v3/users/9b8c65549fed48918febbf873838f012 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:41.047147 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdbade-bf7e-45ca-836c-7600d57bf671 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:41.048817 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:41.053900 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-44bdbade-bf7e-45ca-836c-7600d57bf671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:41.116418 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725837f-7903-403c-907b-461f8995b851 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:41.265407 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdbade-bf7e-45ca-836c-7600d57bf671 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:41.281958 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f9e85-d54d-4d7f-998d-640a043d71c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:41.283757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f9e85-d54d-4d7f-998d-640a043d71c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:41.285812 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f9e85-d54d-4d7f-998d-640a043d71c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:41.286453 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f9e85-d54d-4d7f-998d-640a043d71c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:41.295261 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-071f9e85-d54d-4d7f-998d-640a043d71c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:41.386306 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ef885-b7de-4714-bb5c-a397e159e910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:41.388763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef885-b7de-4714-bb5c-a397e159e910 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:41.389235 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef885-b7de-4714-bb5c-a397e159e910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:41.389721 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef885-b7de-4714-bb5c-a397e159e910 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:41.391777 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ef885-b7de-4714-bb5c-a397e159e910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:41.398144 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ef885-b7de-4714-bb5c-a397e159e910 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:41.438741 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 846/1715] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:40 2022] GET /identity/v3/roles => generated 1427 bytes in 578 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:41.447645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2f341-1b46-4b5e-805e-052f9f357e54 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:41.450097 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2f341-1b46-4b5e-805e-052f9f357e54 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:41.453505 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2f341-1b46-4b5e-805e-052f9f357e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:41.538985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-def2f341-1b46-4b5e-805e-052f9f357e54 None None] MFA Rules not processed for user `f2411c1c780449e1a24fecb747cc3761`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:41.543357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-def2f341-1b46-4b5e-805e-052f9f357e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:41.601076 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 847/1716] 10.222.0.117 () {58 vars in 1020 bytes} [Thu May 26 16:42:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:41.609663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d80808-2c98-4b8a-a5c4-c11ef7a88313 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:41.610302 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d80808-2c98-4b8a-a5c4-c11ef7a88313 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:41.610994 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d80808-2c98-4b8a-a5c4-c11ef7a88313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:41.634189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f9e85-d54d-4d7f-998d-640a043d71c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:41.639342 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f9e85-d54d-4d7f-998d-640a043d71c3 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:41.710964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 870/1717] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:41.715005 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3640d-b901-46b2-b186-dcf20905fbf4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:41.716073 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3640d-b901-46b2-b186-dcf20905fbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:41.716462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3640d-b901-46b2-b186-dcf20905fbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:41.752271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-00f3640d-b901-46b2-b186-dcf20905fbf4 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:41.759061 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-00f3640d-b901-46b2-b186-dcf20905fbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:41.782264 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c1d80808-2c98-4b8a-a5c4-c11ef7a88313 None None] MFA Rules not processed for user `44aa3fdf1e1548579eb62285b6e365d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:41.783972 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c1d80808-2c98-4b8a-a5c4-c11ef7a88313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:41.789136 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 871/1718] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:41.792280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3640d-b901-46b2-b186-dcf20905fbf4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:41.797921 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-00f3640d-b901-46b2-b186-dcf20905fbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:41.835046 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3640d-b901-46b2-b186-dcf20905fbf4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:41.854950 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abc77d-8b3a-4bec-896e-02444a8c4c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:41.859932 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abc77d-8b3a-4bec-896e-02444a8c4c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:41.860496 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abc77d-8b3a-4bec-896e-02444a8c4c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:41.860941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abc77d-8b3a-4bec-896e-02444a8c4c66 admin admin] PATH_INFO: `/v3/projects/c7ffc69801b44ad6917c598d49cc1fe9/users/c7aa69b42b3c4703ba3d1e0a7566fc22/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:41.909156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8abc77d-8b3a-4bec-896e-02444a8c4c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ffc69801b44ad6917c598d49cc1fe9, user_id=c7aa69b42b3c4703ba3d1e0a7566fc22, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:41.912913 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8abc77d-8b3a-4bec-896e-02444a8c4c66 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:41.954655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 872/1719] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:41 2022] PUT /identity/v3/projects/c7ffc69801b44ad6917c598d49cc1fe9/users/c7aa69b42b3c4703ba3d1e0a7566fc22/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:41.954655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abc77d-8b3a-4bec-896e-02444a8c4c66 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:41.959015 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d8abc77d-8b3a-4bec-896e-02444a8c4c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:42.092560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 848/1720] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:41 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:42.094254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d80808-2c98-4b8a-a5c4-c11ef7a88313 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:42.123998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abc77d-8b3a-4bec-896e-02444a8c4c66 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:42.125723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d80808-2c98-4b8a-a5c4-c11ef7a88313 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:42.135407 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8afa3-9764-463c-ae43-06cc4472f34e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:42.136102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8afa3-9764-463c-ae43-06cc4472f34e service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:42.136394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8afa3-9764-463c-ae43-06cc4472f34e service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:42.136677 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8afa3-9764-463c-ae43-06cc4472f34e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:42.141792 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fbce6-65ab-4470-bc36-c136e450857c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:42.142491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fbce6-65ab-4470-bc36-c136e450857c service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:42.142812 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fbce6-65ab-4470-bc36-c136e450857c service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:42.143095 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fbce6-65ab-4470-bc36-c136e450857c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:42.170653 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8afa3-9764-463c-ae43-06cc4472f34e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:42.172147 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8afa3-9764-463c-ae43-06cc4472f34e service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:42.210861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 873/1721] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:42.212353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02507db3-00c4-4777-9114-200345546887 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:42.212930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02507db3-00c4-4777-9114-200345546887 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:42.213301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02507db3-00c4-4777-9114-200345546887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:42.224578 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:42.301745 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-02507db3-00c4-4777-9114-200345546887 None None] MFA Rules not processed for user `c7aa69b42b3c4703ba3d1e0a7566fc22`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:42.303659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-02507db3-00c4-4777-9114-200345546887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:42.326883 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fbce6-65ab-4470-bc36-c136e450857c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:42.329334 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fbce6-65ab-4470-bc36-c136e450857c service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:42.355835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:42.378111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 849/1722] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:42.379068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fbce6-65ab-4470-bc36-c136e450857c service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:42.384070 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fd2fbce6-65ab-4470-bc36-c136e450857c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:42.497427 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 874/1723] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:42.502773 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02507db3-00c4-4777-9114-200345546887 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:42.534057 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02507db3-00c4-4777-9114-200345546887 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:42.553362 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9c9af-27fd-47cd-92aa-3cae1f94a13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:42.554064 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9c9af-27fd-47cd-92aa-3cae1f94a13e admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:42.554349 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9c9af-27fd-47cd-92aa-3cae1f94a13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:42.554657 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9c9af-27fd-47cd-92aa-3cae1f94a13e admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:42.555368 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9c9af-27fd-47cd-92aa-3cae1f94a13e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:42.561433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9c9af-27fd-47cd-92aa-3cae1f94a13e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:42.573071 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fbce6-65ab-4470-bc36-c136e450857c service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:42.592259 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d2d70-04b6-4edb-b891-57be2adec478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:42.593345 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d2d70-04b6-4edb-b891-57be2adec478 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:42.593639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d2d70-04b6-4edb-b891-57be2adec478 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:42.593918 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d2d70-04b6-4edb-b891-57be2adec478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:42.635466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 875/1724] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:42 2022] POST /identity/v3/projects => generated 386 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:42.658917 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9c9af-27fd-47cd-92aa-3cae1f94a13e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:42.788987 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d2d70-04b6-4edb-b891-57be2adec478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:42.792233 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d2d70-04b6-4edb-b891-57be2adec478 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:42.818489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 850/1725] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:42 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:42.819596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d2d70-04b6-4edb-b891-57be2adec478 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:42.825285 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7d8d2d70-04b6-4edb-b891-57be2adec478 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:42.854032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d2d70-04b6-4edb-b891-57be2adec478 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:42.941718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9c9af-27fd-47cd-92aa-3cae1f94a13e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:42.958633 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79f1d4-ce48-4c49-922a-d0e8236cbe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:42.961056 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79f1d4-ce48-4c49-922a-d0e8236cbe04 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:42.965192 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79f1d4-ce48-4c49-922a-d0e8236cbe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:42.965732 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79f1d4-ce48-4c49-922a-d0e8236cbe04 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:42.968097 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79f1d4-ce48-4c49-922a-d0e8236cbe04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:42.976199 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79f1d4-ce48-4c49-922a-d0e8236cbe04 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:43.072580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60d689-861e-45c5-ace0-accfb6ae6046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:43.075539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60d689-861e-45c5-ace0-accfb6ae6046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:43.076280 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60d689-861e-45c5-ace0-accfb6ae6046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:43.077039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60d689-861e-45c5-ace0-accfb6ae6046 admin admin] PATH_INFO: `/v3/projects/bf707a2c409145af98e66bf572a9f27d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:43.080592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60d689-861e-45c5-ace0-accfb6ae6046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf707a2c409145af98e66bf572a9f27d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:43.084369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60d689-861e-45c5-ace0-accfb6ae6046 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:43.187574 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 876/1726] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:42 2022] POST /identity/v3/users => generated 300 bytes in 544 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:43.192105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79f1d4-ce48-4c49-922a-d0e8236cbe04 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:43.234063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ed60d689-861e-45c5-ace0-accfb6ae6046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf707a2c409145af98e66bf572a9f27d', 'request_id': 'req-ed60d689-861e-45c5-ace0-accfb6ae6046'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:43.243387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:43.257309 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ed60d689-861e-45c5-ace0-accfb6ae6046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf707a2c409145af98e66bf572a9f27d', 'request_id': 'req-ed60d689-861e-45c5-ace0-accfb6ae6046'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:43.271325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ed60d689-861e-45c5-ace0-accfb6ae6046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf707a2c409145af98e66bf572a9f27d', 'request_id': 'req-ed60d689-861e-45c5-ace0-accfb6ae6046'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:43.304709 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ed60d689-861e-45c5-ace0-accfb6ae6046 admin admin] The token cache is being invalidate because project bf707a2c409145af98e66bf572a9f27d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:43.304993 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ed60d689-861e-45c5-ace0-accfb6ae6046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:43.307695 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ed60d689-861e-45c5-ace0-accfb6ae6046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:43.317180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 851/1727] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:42:42 2022] DELETE /identity/v3/projects/bf707a2c409145af98e66bf572a9f27d => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:43.317180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60d689-861e-45c5-ace0-accfb6ae6046 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:43.318257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ed60d689-861e-45c5-ace0-accfb6ae6046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:43.416853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79f1d4-ce48-4c49-922a-d0e8236cbe04 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:43.452237 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:43.504864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60d689-861e-45c5-ace0-accfb6ae6046 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:43.515688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9115b3f-af40-47db-b800-c2ef544affcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:43.517556 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9115b3f-af40-47db-b800-c2ef544affcc admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:43.518050 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9115b3f-af40-47db-b800-c2ef544affcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:43.518502 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9115b3f-af40-47db-b800-c2ef544affcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:43.519812 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9115b3f-af40-47db-b800-c2ef544affcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:43.522062 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9115b3f-af40-47db-b800-c2ef544affcc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:43.535725 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 852/1728] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:43 2022] GET /identity/v3/roles => generated 1427 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:43.537475 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9115b3f-af40-47db-b800-c2ef544affcc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:43.540336 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e9115b3f-af40-47db-b800-c2ef544affcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:43.558761 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9115b3f-af40-47db-b800-c2ef544affcc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:43.562761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12077974-063d-4c3c-b785-9f26becb3acb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:43.566085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12077974-063d-4c3c-b785-9f26becb3acb service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:43.566333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d5450-c676-4cb0-a0a5-a01cc4c458ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:43.566509 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12077974-063d-4c3c-b785-9f26becb3acb service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:43.568075 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12077974-063d-4c3c-b785-9f26becb3acb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:43.568255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d5450-c676-4cb0-a0a5-a01cc4c458ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:43.568702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d5450-c676-4cb0-a0a5-a01cc4c458ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:43.569058 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d5450-c676-4cb0-a0a5-a01cc4c458ae admin admin] PATH_INFO: `/v3/users/0debf657960041c78ca426505a822dca` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:43.571548 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d5450-c676-4cb0-a0a5-a01cc4c458ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=0debf657960041c78ca426505a822dca)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:43.574193 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d5450-c676-4cb0-a0a5-a01cc4c458ae admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:43.576981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-12077974-063d-4c3c-b785-9f26becb3acb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:43.683039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d70d5450-c676-4cb0-a0a5-a01cc4c458ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0debf657960041c78ca426505a822dca'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:43.687445 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d70d5450-c676-4cb0-a0a5-a01cc4c458ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0debf657960041c78ca426505a822dca'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:43.703894 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d70d5450-c676-4cb0-a0a5-a01cc4c458ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0debf657960041c78ca426505a822dca'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:43.706172 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d70d5450-c676-4cb0-a0a5-a01cc4c458ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0debf657960041c78ca426505a822dca'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:43.731928 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d70d5450-c676-4cb0-a0a5-a01cc4c458ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0debf657960041c78ca426505a822dca'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:43.765586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12077974-063d-4c3c-b785-9f26becb3acb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:43.767443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12077974-063d-4c3c-b785-9f26becb3acb service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:43.823742 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 853/1729] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:42:43 2022] DELETE /identity/v3/users/0debf657960041c78ca426505a822dca => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:43.826466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 877/1730] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:43.826820 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d5450-c676-4cb0-a0a5-a01cc4c458ae admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:43.828774 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d70d5450-c676-4cb0-a0a5-a01cc4c458ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:43.914900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:43.973345 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d5450-c676-4cb0-a0a5-a01cc4c458ae admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:43.987257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae0482-4789-473b-a38d-19d21e8f515f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:43.988262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae0482-4789-473b-a38d-19d21e8f515f admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:43.988560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae0482-4789-473b-a38d-19d21e8f515f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:43.988864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae0482-4789-473b-a38d-19d21e8f515f admin admin] PATH_INFO: `/v3/projects/41b10a2741764fcbb7ac5387a9c839c6/users/5d863960630a470f9d0335fc12424b2a/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:44.054330 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae0482-4789-473b-a38d-19d21e8f515f admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b10a2741764fcbb7ac5387a9c839c6, user_id=5d863960630a470f9d0335fc12424b2a, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:44.057211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae0482-4789-473b-a38d-19d21e8f515f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:44.101782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12077974-063d-4c3c-b785-9f26becb3acb service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:44.107595 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 854/1731] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:43 2022] PUT /identity/v3/projects/41b10a2741764fcbb7ac5387a9c839c6/users/5d863960630a470f9d0335fc12424b2a/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:44.148954 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12077974-063d-4c3c-b785-9f26becb3acb service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:44.295273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae0482-4789-473b-a38d-19d21e8f515f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:44.298285 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e3ae0482-4789-473b-a38d-19d21e8f515f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:44.451261 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0e39c-e175-4543-a89a-225291f90aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:44.453235 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0e39c-e175-4543-a89a-225291f90aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:44.454984 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0e39c-e175-4543-a89a-225291f90aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:44.455493 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0e39c-e175-4543-a89a-225291f90aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:44.462446 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0e39c-e175-4543-a89a-225291f90aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:44.472232 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0e39c-e175-4543-a89a-225291f90aa0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:44.518922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 878/1732] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:44 2022] GET /identity/v3/roles => generated 1427 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:44.528762 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0e39c-e175-4543-a89a-225291f90aa0 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:44.546212 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0e39c-e175-4543-a89a-225291f90aa0 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:44.573131 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a776771-f156-4ca5-8422-d71f906f7340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:44.574244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a776771-f156-4ca5-8422-d71f906f7340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:44.574679 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a776771-f156-4ca5-8422-d71f906f7340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:44.575016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a776771-f156-4ca5-8422-d71f906f7340 admin admin] PATH_INFO: `/v3/projects/41b10a2741764fcbb7ac5387a9c839c6/users/5d863960630a470f9d0335fc12424b2a/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:44.579994 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a776771-f156-4ca5-8422-d71f906f7340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b10a2741764fcbb7ac5387a9c839c6, user_id=5d863960630a470f9d0335fc12424b2a, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:44.589939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a776771-f156-4ca5-8422-d71f906f7340 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:44.629912 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae0482-4789-473b-a38d-19d21e8f515f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:44.647384 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 879/1733] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:44 2022] PUT /identity/v3/projects/41b10a2741764fcbb7ac5387a9c839c6/users/5d863960630a470f9d0335fc12424b2a/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:44.649137 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4b67e-5ab0-4ae6-960b-f69fffd5193c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:44.649529 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4b67e-5ab0-4ae6-960b-f69fffd5193c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:44.650037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4b67e-5ab0-4ae6-960b-f69fffd5193c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:44.766199 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0cd4b67e-5ab0-4ae6-960b-f69fffd5193c None None] MFA Rules not processed for user `5d863960630a470f9d0335fc12424b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:44.773933 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0cd4b67e-5ab0-4ae6-960b-f69fffd5193c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:44.910682 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fc962-7f7c-4531-9d8e-dfa9d35530b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:44.913633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fc962-7f7c-4531-9d8e-dfa9d35530b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:44.916014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fc962-7f7c-4531-9d8e-dfa9d35530b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:44.916541 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fc962-7f7c-4531-9d8e-dfa9d35530b2 admin admin] PATH_INFO: `/v3/projects/ada391c74ce149c8a8a82268510ca054` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:44.926021 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fc962-7f7c-4531-9d8e-dfa9d35530b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada391c74ce149c8a8a82268510ca054)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:44.940590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:44.942137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fc962-7f7c-4531-9d8e-dfa9d35530b2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:45.082481 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 880/1734] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:45.086013 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f96fc962-7f7c-4531-9d8e-dfa9d35530b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada391c74ce149c8a8a82268510ca054', 'request_id': 'req-f96fc962-7f7c-4531-9d8e-dfa9d35530b2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.098755 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4b67e-5ab0-4ae6-960b-f69fffd5193c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:45.101635 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0cd4b67e-5ab0-4ae6-960b-f69fffd5193c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:45.119292 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f96fc962-7f7c-4531-9d8e-dfa9d35530b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada391c74ce149c8a8a82268510ca054', 'request_id': 'req-f96fc962-7f7c-4531-9d8e-dfa9d35530b2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.145252 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f96fc962-7f7c-4531-9d8e-dfa9d35530b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada391c74ce149c8a8a82268510ca054', 'request_id': 'req-f96fc962-7f7c-4531-9d8e-dfa9d35530b2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.179082 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f96fc962-7f7c-4531-9d8e-dfa9d35530b2 admin admin] The token cache is being invalidate because project ada391c74ce149c8a8a82268510ca054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:45.179584 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f96fc962-7f7c-4531-9d8e-dfa9d35530b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.181466 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f96fc962-7f7c-4531-9d8e-dfa9d35530b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.191886 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 855/1735] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:42:44 2022] DELETE /identity/v3/projects/ada391c74ce149c8a8a82268510ca054 => generated 0 bytes in 892 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:45.194634 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea0c3d-c5f6-4393-afd0-0cfc31bfc209 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.195050 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea0c3d-c5f6-4393-afd0-0cfc31bfc209 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.195603 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea0c3d-c5f6-4393-afd0-0cfc31bfc209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.232467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cdea0c3d-c5f6-4393-afd0-0cfc31bfc209 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:45.235390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cdea0c3d-c5f6-4393-afd0-0cfc31bfc209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:45.243957 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:45.283833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4b67e-5ab0-4ae6-960b-f69fffd5193c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:45.381034 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 856/1736] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:45.392596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3e55e-d3a3-4838-8b9f-8e256d462b9a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.416710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3e55e-d3a3-4838-8b9f-8e256d462b9a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.417728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3e55e-d3a3-4838-8b9f-8e256d462b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.470274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6ee3e55e-d3a3-4838-8b9f-8e256d462b9a None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:45.472223 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6ee3e55e-d3a3-4838-8b9f-8e256d462b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:45.490285 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 857/1737] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:45.491445 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3e55e-d3a3-4838-8b9f-8e256d462b9a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:45.491726 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a984c-5916-4db9-8212-3a0f37dfd05c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:45.492700 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a984c-5916-4db9-8212-3a0f37dfd05c service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.493189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a984c-5916-4db9-8212-3a0f37dfd05c service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.493885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a984c-5916-4db9-8212-3a0f37dfd05c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.496568 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-579a984c-5916-4db9-8212-3a0f37dfd05c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:45.505508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3e55e-d3a3-4838-8b9f-8e256d462b9a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:45.513816 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a6a71-9dc7-462d-a0a6-bd8e3e888a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:45.515609 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a6a71-9dc7-462d-a0a6-bd8e3e888a2c admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.515750 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a6a71-9dc7-462d-a0a6-bd8e3e888a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.515970 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a6a71-9dc7-462d-a0a6-bd8e3e888a2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.516887 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a6a71-9dc7-462d-a0a6-bd8e3e888a2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:45.517258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a6a71-9dc7-462d-a0a6-bd8e3e888a2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:45.519731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a6a71-9dc7-462d-a0a6-bd8e3e888a2c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:45.545604 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 858/1738] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:42:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:45.546822 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a6a71-9dc7-462d-a0a6-bd8e3e888a2c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:45.561463 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a6a71-9dc7-462d-a0a6-bd8e3e888a2c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:45.570853 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d3ce6-5479-4f38-b9f4-76470fde5c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:45.571801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d3ce6-5479-4f38-b9f4-76470fde5c54 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.572089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d3ce6-5479-4f38-b9f4-76470fde5c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.572365 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d3ce6-5479-4f38-b9f4-76470fde5c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.573761 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d3ce6-5479-4f38-b9f4-76470fde5c54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:45.578356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d3ce6-5479-4f38-b9f4-76470fde5c54 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:45.666330 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a984c-5916-4db9-8212-3a0f37dfd05c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:45.668977 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a984c-5916-4db9-8212-3a0f37dfd05c service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:45.671881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 859/1739] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:45 2022] POST /identity/v3/projects => generated 364 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:45.673450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d3ce6-5479-4f38-b9f4-76470fde5c54 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:45.677254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bb6d3ce6-5479-4f38-b9f4-76470fde5c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:45.699749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 881/1740] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:45.700972 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a984c-5916-4db9-8212-3a0f37dfd05c service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:45.754329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a984c-5916-4db9-8212-3a0f37dfd05c service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:45.928323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d3ce6-5479-4f38-b9f4-76470fde5c54 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:45.935017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262b783-617b-43bc-88f0-d8a114046a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:45.937025 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262b783-617b-43bc-88f0-d8a114046a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.937980 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262b783-617b-43bc-88f0-d8a114046a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.938523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262b783-617b-43bc-88f0-d8a114046a8f admin admin] PATH_INFO: `/v3/projects/d92290f45664486eac09c6e295b3f71f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.940358 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262b783-617b-43bc-88f0-d8a114046a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d92290f45664486eac09c6e295b3f71f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:45.945176 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262b783-617b-43bc-88f0-d8a114046a8f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:45.995632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:46.059789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aea58d-6543-441c-93d2-f3cc00118196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.061364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aea58d-6543-441c-93d2-f3cc00118196 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.074959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aea58d-6543-441c-93d2-f3cc00118196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.077810 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aea58d-6543-441c-93d2-f3cc00118196 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.084717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aea58d-6543-441c-93d2-f3cc00118196 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.094318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aea58d-6543-441c-93d2-f3cc00118196 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.198294 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e262b783-617b-43bc-88f0-d8a114046a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd92290f45664486eac09c6e295b3f71f', 'request_id': 'req-e262b783-617b-43bc-88f0-d8a114046a8f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:46.209593 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 882/1741] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:45 2022] POST /identity/v3/users => generated 283 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:46.211782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aea58d-6543-441c-93d2-f3cc00118196 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.218140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-30aea58d-6543-441c-93d2-f3cc00118196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:46.227665 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e262b783-617b-43bc-88f0-d8a114046a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd92290f45664486eac09c6e295b3f71f', 'request_id': 'req-e262b783-617b-43bc-88f0-d8a114046a8f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:46.251760 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e262b783-617b-43bc-88f0-d8a114046a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd92290f45664486eac09c6e295b3f71f', 'request_id': 'req-e262b783-617b-43bc-88f0-d8a114046a8f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:46.279796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aea58d-6543-441c-93d2-f3cc00118196 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.296072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:46.323686 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e262b783-617b-43bc-88f0-d8a114046a8f admin admin] The token cache is being invalidate because project d92290f45664486eac09c6e295b3f71f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:46.324057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e262b783-617b-43bc-88f0-d8a114046a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:46.325470 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e262b783-617b-43bc-88f0-d8a114046a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:46.341870 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 860/1742] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:42:45 2022] DELETE /identity/v3/projects/d92290f45664486eac09c6e295b3f71f => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:46.350292 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262b783-617b-43bc-88f0-d8a114046a8f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.360482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e262b783-617b-43bc-88f0-d8a114046a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:46.501281 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcadf1-9996-4619-bd0e-070f2dbda5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.503873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcadf1-9996-4619-bd0e-070f2dbda5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.503873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcadf1-9996-4619-bd0e-070f2dbda5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.505800 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcadf1-9996-4619-bd0e-070f2dbda5e3 admin admin] PATH_INFO: `/v3/users/c7aa69b42b3c4703ba3d1e0a7566fc22` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.512798 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dcadf1-9996-4619-bd0e-070f2dbda5e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7aa69b42b3c4703ba3d1e0a7566fc22)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.520693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dcadf1-9996-4619-bd0e-070f2dbda5e3 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.580061 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262b783-617b-43bc-88f0-d8a114046a8f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.602554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fc1af-dfdc-4e9c-8f50-164e606e228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.605862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fc1af-dfdc-4e9c-8f50-164e606e228e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.606730 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fc1af-dfdc-4e9c-8f50-164e606e228e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.608262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fc1af-dfdc-4e9c-8f50-164e606e228e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.612658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fc1af-dfdc-4e9c-8f50-164e606e228e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.624691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fc1af-dfdc-4e9c-8f50-164e606e228e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.675157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 861/1743] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/roles => generated 1427 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:46.681111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a54b77-5c07-4607-9cc8-8ba90e9502bf None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.683416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a54b77-5c07-4607-9cc8-8ba90e9502bf None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.684674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a54b77-5c07-4607-9cc8-8ba90e9502bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.699342 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-35dcadf1-9996-4619-bd0e-070f2dbda5e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7aa69b42b3c4703ba3d1e0a7566fc22'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:46.751023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-35dcadf1-9996-4619-bd0e-070f2dbda5e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7aa69b42b3c4703ba3d1e0a7566fc22'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:46.754530 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-35dcadf1-9996-4619-bd0e-070f2dbda5e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7aa69b42b3c4703ba3d1e0a7566fc22'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:46.758905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-88a54b77-5c07-4607-9cc8-8ba90e9502bf None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:46.766076 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-88a54b77-5c07-4607-9cc8-8ba90e9502bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:46.772269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-35dcadf1-9996-4619-bd0e-070f2dbda5e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7aa69b42b3c4703ba3d1e0a7566fc22'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:46.773135 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-35dcadf1-9996-4619-bd0e-070f2dbda5e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7aa69b42b3c4703ba3d1e0a7566fc22'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:46.801484 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 862/1744] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:46.808544 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a54b77-5c07-4607-9cc8-8ba90e9502bf None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.820507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-88a54b77-5c07-4607-9cc8-8ba90e9502bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:46.830646 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 883/1745] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:42:46 2022] DELETE /identity/v3/users/c7aa69b42b3c4703ba3d1e0a7566fc22 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:46.832340 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518837a-b780-4813-895e-85b54289a71e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.833200 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518837a-b780-4813-895e-85b54289a71e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.833718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518837a-b780-4813-895e-85b54289a71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.837614 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a54b77-5c07-4607-9cc8-8ba90e9502bf None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.903420 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1518837a-b780-4813-895e-85b54289a71e None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:46.905597 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1518837a-b780-4813-895e-85b54289a71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:47.124640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:47.185491 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 884/1746] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:47.190957 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d604f-c278-4e79-a3b2-9dee81cfd550 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.191255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d604f-c278-4e79-a3b2-9dee81cfd550 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.191521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d604f-c278-4e79-a3b2-9dee81cfd550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.238328 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-668d604f-c278-4e79-a3b2-9dee81cfd550 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:47.239630 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-668d604f-c278-4e79-a3b2-9dee81cfd550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:47.272875 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 885/1747] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:47.273736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d604f-c278-4e79-a3b2-9dee81cfd550 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:47.300169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9993b-9770-4c97-b158-3e8b77819653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:47.301933 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9993b-9770-4c97-b158-3e8b77819653 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.303349 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9993b-9770-4c97-b158-3e8b77819653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.305683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9993b-9770-4c97-b158-3e8b77819653 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.309725 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d604f-c278-4e79-a3b2-9dee81cfd550 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:47.320753 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9993b-9770-4c97-b158-3e8b77819653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:47.321787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9993b-9770-4c97-b158-3e8b77819653 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:47.323365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9d4a2-c93a-4b9f-a8e4-246baad0a95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:47.324596 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9d4a2-c93a-4b9f-a8e4-246baad0a95a admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.324890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9d4a2-c93a-4b9f-a8e4-246baad0a95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.325193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9d4a2-c93a-4b9f-a8e4-246baad0a95a admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.325916 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9d4a2-c93a-4b9f-a8e4-246baad0a95a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:47.326227 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9d4a2-c93a-4b9f-a8e4-246baad0a95a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:47.328074 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9d4a2-c93a-4b9f-a8e4-246baad0a95a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:47.377281 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 886/1748] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:42:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:47.377779 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9d4a2-c93a-4b9f-a8e4-246baad0a95a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:47.392927 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3db9d4a2-c93a-4b9f-a8e4-246baad0a95a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:47.406443 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 863/1749] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/roles => generated 1427 bytes in 600 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:47.424204 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9993b-9770-4c97-b158-3e8b77819653 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:47.484171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9993b-9770-4c97-b158-3e8b77819653 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:47.503430 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac3d9c-34d0-43fe-8bc7-d373566f6c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:47.515006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac3d9c-34d0-43fe-8bc7-d373566f6c3c admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.516632 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac3d9c-34d0-43fe-8bc7-d373566f6c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.517470 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac3d9c-34d0-43fe-8bc7-d373566f6c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.518222 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac3d9c-34d0-43fe-8bc7-d373566f6c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:47.525569 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac3d9c-34d0-43fe-8bc7-d373566f6c3c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:47.575238 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9d4a2-c93a-4b9f-a8e4-246baad0a95a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:47.601639 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49ba23-10ce-4417-ae0d-cd1a113947a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:47.602150 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49ba23-10ce-4417-ae0d-cd1a113947a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.602440 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49ba23-10ce-4417-ae0d-cd1a113947a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.602756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49ba23-10ce-4417-ae0d-cd1a113947a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.675349 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49ba23-10ce-4417-ae0d-cd1a113947a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:47.676025 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 864/1750] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:47 2022] POST /identity/v3/projects => generated 356 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:47.680654 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac3d9c-34d0-43fe-8bc7-d373566f6c3c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:47.681874 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49ba23-10ce-4417-ae0d-cd1a113947a7 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:47.723134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 887/1751] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:47.729083 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3f7df-985d-43e5-bad8-a2fc13f29566 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.729380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3f7df-985d-43e5-bad8-a2fc13f29566 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.729661 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3f7df-985d-43e5-bad8-a2fc13f29566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.872893 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ffb3f7df-985d-43e5-bad8-a2fc13f29566 None None] MFA Rules not processed for user `01d3da9345ed40f396730e41ccdda091`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:47.885783 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ffb3f7df-985d-43e5-bad8-a2fc13f29566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:47.954916 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac3d9c-34d0-43fe-8bc7-d373566f6c3c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:47.975325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f1a0e-90ab-4a6b-8efc-5456c838d602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:47.976805 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f1a0e-90ab-4a6b-8efc-5456c838d602 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.977097 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f1a0e-90ab-4a6b-8efc-5456c838d602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.977378 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f1a0e-90ab-4a6b-8efc-5456c838d602 admin admin] PATH_INFO: `/v3/projects/761dbf4447b64178bc75ead01f2dd47c/users/0aa8f0da8339447c9396e4de4f09f7f3/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.991773 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:48.064410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f1a0e-90ab-4a6b-8efc-5456c838d602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=761dbf4447b64178bc75ead01f2dd47c, user_id=0aa8f0da8339447c9396e4de4f09f7f3, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:48.077421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f1a0e-90ab-4a6b-8efc-5456c838d602 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:48.131672 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 865/1752] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:47 2022] PUT /identity/v3/projects/761dbf4447b64178bc75ead01f2dd47c/users/0aa8f0da8339447c9396e4de4f09f7f3/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:48.132703 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f1a0e-90ab-4a6b-8efc-5456c838d602 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:48.212524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 888/1753] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:48.224354 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2117571-d27e-4057-a70d-78bb3c9a5b80 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:48.224668 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2117571-d27e-4057-a70d-78bb3c9a5b80 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:48.224918 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2117571-d27e-4057-a70d-78bb3c9a5b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:48.369078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a2117571-d27e-4057-a70d-78bb3c9a5b80 None None] MFA Rules not processed for user `0aa8f0da8339447c9396e4de4f09f7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:48.370358 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a2117571-d27e-4057-a70d-78bb3c9a5b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:48.411444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f1a0e-90ab-4a6b-8efc-5456c838d602 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:48.433267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee78c81-4278-4dff-8ff7-5126f34837b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:48.435580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee78c81-4278-4dff-8ff7-5126f34837b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:48.435886 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee78c81-4278-4dff-8ff7-5126f34837b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:48.436153 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee78c81-4278-4dff-8ff7-5126f34837b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:48.460313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee78c81-4278-4dff-8ff7-5126f34837b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:48.463035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee78c81-4278-4dff-8ff7-5126f34837b4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:48.541027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 866/1754] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:48 2022] POST /identity/v3/users => generated 279 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:48.542952 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee78c81-4278-4dff-8ff7-5126f34837b4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:48.564034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 889/1755] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:48.565677 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2117571-d27e-4057-a70d-78bb3c9a5b80 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:48.578548 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee78c81-4278-4dff-8ff7-5126f34837b4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:48.583113 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2117571-d27e-4057-a70d-78bb3c9a5b80 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:48.597503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519034d2-6481-4271-bf1e-c52b285f5e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:48.598215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519034d2-6481-4271-bf1e-c52b285f5e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:48.598503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519034d2-6481-4271-bf1e-c52b285f5e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:48.598874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519034d2-6481-4271-bf1e-c52b285f5e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:48.599577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519034d2-6481-4271-bf1e-c52b285f5e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:48.601421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519034d2-6481-4271-bf1e-c52b285f5e47 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:48.615786 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c72e3-5f97-42b3-a0c5-96385726a61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:48.616937 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c72e3-5f97-42b3-a0c5-96385726a61b admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:48.619412 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c72e3-5f97-42b3-a0c5-96385726a61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:48.620613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c72e3-5f97-42b3-a0c5-96385726a61b admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:48.623341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c72e3-5f97-42b3-a0c5-96385726a61b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:48.628279 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c72e3-5f97-42b3-a0c5-96385726a61b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:48.655367 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 867/1756] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:48 2022] GET /identity/v3/roles => generated 1427 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:48.668962 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:48.670327 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519034d2-6481-4271-bf1e-c52b285f5e47 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:48.696887 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519034d2-6481-4271-bf1e-c52b285f5e47 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:48.718328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e587db-dda7-477d-b7e1-68be621c6cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:48.719203 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e587db-dda7-477d-b7e1-68be621c6cae admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:48.719668 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e587db-dda7-477d-b7e1-68be621c6cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:48.720171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e587db-dda7-477d-b7e1-68be621c6cae admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:48.721048 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e587db-dda7-477d-b7e1-68be621c6cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:48.723167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e587db-dda7-477d-b7e1-68be621c6cae admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:48.741647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 868/1757] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:48 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:48.746263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e587db-dda7-477d-b7e1-68be621c6cae admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:48.765376 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e587db-dda7-477d-b7e1-68be621c6cae admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:48.789790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f2dd6-c89a-40ce-94a0-62e7a2990bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:48.791931 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f2dd6-c89a-40ce-94a0-62e7a2990bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:48.792618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f2dd6-c89a-40ce-94a0-62e7a2990bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:48.793729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f2dd6-c89a-40ce-94a0-62e7a2990bbc admin admin] PATH_INFO: `/v3/projects/1208f5ab7a7944b291050e3f11d9ca79/users/31bcaab7686548af9b231f9f32834b33/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:48.820858 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 890/1758] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:48 2022] POST /identity/v3/projects => generated 366 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:48.822651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c72e3-5f97-42b3-a0c5-96385726a61b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:48.831041 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f2dd6-c89a-40ce-94a0-62e7a2990bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1208f5ab7a7944b291050e3f11d9ca79, user_id=31bcaab7686548af9b231f9f32834b33, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:48.849008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f2dd6-c89a-40ce-94a0-62e7a2990bbc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:48.888592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 869/1759] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:48 2022] PUT /identity/v3/projects/1208f5ab7a7944b291050e3f11d9ca79/users/31bcaab7686548af9b231f9f32834b33/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:48.900880 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71ad8-2437-4e43-8eec-0e255502593f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:48.901536 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71ad8-2437-4e43-8eec-0e255502593f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:48.901964 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71ad8-2437-4e43-8eec-0e255502593f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:49.000369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-67e71ad8-2437-4e43-8eec-0e255502593f None None] MFA Rules not processed for user `31bcaab7686548af9b231f9f32834b33`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:49.018252 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-67e71ad8-2437-4e43-8eec-0e255502593f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:49.095399 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c72e3-5f97-42b3-a0c5-96385726a61b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:49.257939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373ab4d-b4d0-4ee1-8af1-2bf01ac8ee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:49.260478 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373ab4d-b4d0-4ee1-8af1-2bf01ac8ee56 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:49.261593 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373ab4d-b4d0-4ee1-8af1-2bf01ac8ee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:49.261932 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373ab4d-b4d0-4ee1-8af1-2bf01ac8ee56 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:49.263955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373ab4d-b4d0-4ee1-8af1-2bf01ac8ee56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:49.269645 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373ab4d-b4d0-4ee1-8af1-2bf01ac8ee56 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:49.303169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 870/1760] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:49.307670 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e71ad8-2437-4e43-8eec-0e255502593f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:49.311605 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-67e71ad8-2437-4e43-8eec-0e255502593f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:49.341096 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 891/1761] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:48 2022] POST /identity/v3/users => generated 290 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:49.349268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373ab4d-b4d0-4ee1-8af1-2bf01ac8ee56 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:49.359703 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e71ad8-2437-4e43-8eec-0e255502593f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:49.372822 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef968b2-490d-4143-ac31-9f688fd62f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:49.372822 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef968b2-490d-4143-ac31-9f688fd62f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:49.372822 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef968b2-490d-4143-ac31-9f688fd62f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:49.372822 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef968b2-490d-4143-ac31-9f688fd62f9e admin admin] PATH_INFO: `/v3/projects/c7ffc69801b44ad6917c598d49cc1fe9` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:49.376146 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef968b2-490d-4143-ac31-9f688fd62f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ffc69801b44ad6917c598d49cc1fe9)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:49.382325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef968b2-490d-4143-ac31-9f688fd62f9e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:49.433581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:49.441594 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373ab4d-b4d0-4ee1-8af1-2bf01ac8ee56 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:49.476720 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc66d2-1576-4108-ab9c-0ff70138debc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:49.496891 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc66d2-1576-4108-ab9c-0ff70138debc admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:49.497500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc66d2-1576-4108-ab9c-0ff70138debc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:49.498058 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc66d2-1576-4108-ab9c-0ff70138debc admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:49.499572 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc66d2-1576-4108-ab9c-0ff70138debc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:49.509961 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc66d2-1576-4108-ab9c-0ff70138debc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:49.553554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fef968b2-490d-4143-ac31-9f688fd62f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ffc69801b44ad6917c598d49cc1fe9', 'request_id': 'req-fef968b2-490d-4143-ac31-9f688fd62f9e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:49.578945 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fef968b2-490d-4143-ac31-9f688fd62f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ffc69801b44ad6917c598d49cc1fe9', 'request_id': 'req-fef968b2-490d-4143-ac31-9f688fd62f9e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:49.615595 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fef968b2-490d-4143-ac31-9f688fd62f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ffc69801b44ad6917c598d49cc1fe9', 'request_id': 'req-fef968b2-490d-4143-ac31-9f688fd62f9e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:49.626169 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 892/1762] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:49 2022] POST /identity/v3/projects => generated 356 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:49.627985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc66d2-1576-4108-ab9c-0ff70138debc admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:49.689325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fef968b2-490d-4143-ac31-9f688fd62f9e admin admin] The token cache is being invalidate because project c7ffc69801b44ad6917c598d49cc1fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:49.689698 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fef968b2-490d-4143-ac31-9f688fd62f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:49.693820 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fef968b2-490d-4143-ac31-9f688fd62f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:49.697935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 871/1763] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:42:49 2022] DELETE /identity/v3/projects/c7ffc69801b44ad6917c598d49cc1fe9 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:49.700728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bd85f-a3d3-4767-a805-4485485d5f5a None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:49.701019 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bd85f-a3d3-4767-a805-4485485d5f5a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:49.701576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bd85f-a3d3-4767-a805-4485485d5f5a None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:49.721260 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 872/1764] 10.222.0.110 () {54 vars in 926 bytes} [Thu May 26 16:42:49 2022] GET /identity => generated 271 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:42:49.721943 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bd85f-a3d3-4767-a805-4485485d5f5a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:49.723860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fb3bd85f-a3d3-4767-a805-4485485d5f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:49.776320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc66d2-1576-4108-ab9c-0ff70138debc admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:49.789015 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b1ce4-c99e-40d0-b6ea-a215b6ba340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:49.790045 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b1ce4-c99e-40d0-b6ea-a215b6ba340d admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:49.790447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b1ce4-c99e-40d0-b6ea-a215b6ba340d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:49.790877 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b1ce4-c99e-40d0-b6ea-a215b6ba340d admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:49.791829 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b1ce4-c99e-40d0-b6ea-a215b6ba340d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:49.798124 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b1ce4-c99e-40d0-b6ea-a215b6ba340d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:49.823564 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 893/1765] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:49 2022] GET /identity/v3/roles => generated 1427 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:49.826241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b1ce4-c99e-40d0-b6ea-a215b6ba340d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:49.829684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-666b1ce4-c99e-40d0-b6ea-a215b6ba340d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:49.851383 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:49.867251 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b1ce4-c99e-40d0-b6ea-a215b6ba340d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:49.877326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8f3e6-af4e-43a3-849a-deb1190e5352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:49.878751 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8f3e6-af4e-43a3-849a-deb1190e5352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:49.879210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8f3e6-af4e-43a3-849a-deb1190e5352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:49.879601 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8f3e6-af4e-43a3-849a-deb1190e5352 admin admin] PATH_INFO: `/v3/users/5d863960630a470f9d0335fc12424b2a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:49.881043 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8f3e6-af4e-43a3-849a-deb1190e5352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d863960630a470f9d0335fc12424b2a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:49.884454 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8f3e6-af4e-43a3-849a-deb1190e5352 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:49.909764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bd85f-a3d3-4767-a805-4485485d5f5a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:49.916595 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b7c88-51da-425c-aa21-ba60236a0734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:49.921521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b7c88-51da-425c-aa21-ba60236a0734 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:49.922180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b7c88-51da-425c-aa21-ba60236a0734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:49.922757 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b7c88-51da-425c-aa21-ba60236a0734 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:49.923963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b7c88-51da-425c-aa21-ba60236a0734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:49.928495 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b7c88-51da-425c-aa21-ba60236a0734 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:49.983332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5ea8f3e6-af4e-43a3-849a-deb1190e5352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d863960630a470f9d0335fc12424b2a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:49.986918 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 873/1766] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:49 2022] POST /identity/v3/users => generated 285 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:49.988293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b7c88-51da-425c-aa21-ba60236a0734 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:49.993529 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2f1b7c88-51da-425c-aa21-ba60236a0734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:50.010611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5ea8f3e6-af4e-43a3-849a-deb1190e5352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d863960630a470f9d0335fc12424b2a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:50.016290 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b7c88-51da-425c-aa21-ba60236a0734 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:50.017801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5ea8f3e6-af4e-43a3-849a-deb1190e5352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d863960630a470f9d0335fc12424b2a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:50.024967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c177e-4744-4138-8455-e7d86e49c12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:50.026467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c177e-4744-4138-8455-e7d86e49c12e admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.027142 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c177e-4744-4138-8455-e7d86e49c12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.027493 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c177e-4744-4138-8455-e7d86e49c12e admin admin] PATH_INFO: `/v3/projects/c4ad9d0430b34d5caf1351e8f1e0bf1d/users/4061b42638b6406fae73f8e4b22ee469/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:50.031753 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5ea8f3e6-af4e-43a3-849a-deb1190e5352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d863960630a470f9d0335fc12424b2a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:50.032979 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5ea8f3e6-af4e-43a3-849a-deb1190e5352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d863960630a470f9d0335fc12424b2a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:50.052787 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 894/1767] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:42:49 2022] DELETE /identity/v3/users/5d863960630a470f9d0335fc12424b2a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:50.055105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53fb51-04ea-4c7f-a7ed-6ca304eebd41 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.055748 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53fb51-04ea-4c7f-a7ed-6ca304eebd41 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.056355 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53fb51-04ea-4c7f-a7ed-6ca304eebd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:50.058036 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c177e-4744-4138-8455-e7d86e49c12e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ad9d0430b34d5caf1351e8f1e0bf1d, user_id=4061b42638b6406fae73f8e4b22ee469, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:50.061479 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c177e-4744-4138-8455-e7d86e49c12e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:50.084539 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-5a53fb51-04ea-4c7f-a7ed-6ca304eebd41 None None] MFA Rules not processed for user `0043a7d5877f41de905afe6bef355867`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:50.086333 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5a53fb51-04ea-4c7f-a7ed-6ca304eebd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:50.111567 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 874/1768] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:49 2022] PUT /identity/v3/projects/c4ad9d0430b34d5caf1351e8f1e0bf1d/users/4061b42638b6406fae73f8e4b22ee469/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:50.112913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c177e-4744-4138-8455-e7d86e49c12e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:50.116293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d45c177e-4744-4138-8455-e7d86e49c12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:50.300141 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c177e-4744-4138-8455-e7d86e49c12e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:50.307691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc48b5-ed08-4e00-93cb-d20829e93acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:50.309631 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc48b5-ed08-4e00-93cb-d20829e93acb admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.310074 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc48b5-ed08-4e00-93cb-d20829e93acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.310542 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc48b5-ed08-4e00-93cb-d20829e93acb admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:50.311704 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc48b5-ed08-4e00-93cb-d20829e93acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:50.314252 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc48b5-ed08-4e00-93cb-d20829e93acb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:50.334341 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 875/1769] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:50 2022] GET /identity/v3/roles => generated 1427 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:50.336455 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc48b5-ed08-4e00-93cb-d20829e93acb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:50.338468 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6acc48b5-ed08-4e00-93cb-d20829e93acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:50.349266 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:50.369867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 895/1770] 10.222.0.110 () {58 vars in 1023 bytes} [Thu May 26 16:42:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:50.373947 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53fb51-04ea-4c7f-a7ed-6ca304eebd41 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:50.381479 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc48b5-ed08-4e00-93cb-d20829e93acb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:50.394343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88c5c3-bf47-4cf8-b484-fc3efd225590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:50.396034 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88c5c3-bf47-4cf8-b484-fc3efd225590 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.396972 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88c5c3-bf47-4cf8-b484-fc3efd225590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.397524 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88c5c3-bf47-4cf8-b484-fc3efd225590 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:50.412382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88c5c3-bf47-4cf8-b484-fc3efd225590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:50.422075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88c5c3-bf47-4cf8-b484-fc3efd225590 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:50.465499 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 876/1771] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:50 2022] GET /identity/v3/roles => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:50.473411 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88c5c3-bf47-4cf8-b484-fc3efd225590 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:50.540852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88c5c3-bf47-4cf8-b484-fc3efd225590 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:50.570659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53fb51-04ea-4c7f-a7ed-6ca304eebd41 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:50.572347 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bbc0f-905d-4f1a-acaf-ff3b2ecf1a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:50.575168 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bbc0f-905d-4f1a-acaf-ff3b2ecf1a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.578178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bbc0f-905d-4f1a-acaf-ff3b2ecf1a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.579828 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bbc0f-905d-4f1a-acaf-ff3b2ecf1a1c admin admin] PATH_INFO: `/v3/projects/c4ad9d0430b34d5caf1351e8f1e0bf1d/users/4061b42638b6406fae73f8e4b22ee469/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:50.587235 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad539573-9601-4728-9362-5b5fd1cfac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:50.588554 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad539573-9601-4728-9362-5b5fd1cfac77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.589106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad539573-9601-4728-9362-5b5fd1cfac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.589704 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad539573-9601-4728-9362-5b5fd1cfac77 admin admin] PATH_INFO: `/v3/projects/132f0e00402144b8802d942dafede41e/users/944c90063228489d8b1d946effa2ba18/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:50.590160 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bbc0f-905d-4f1a-acaf-ff3b2ecf1a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ad9d0430b34d5caf1351e8f1e0bf1d, user_id=4061b42638b6406fae73f8e4b22ee469, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:50.605635 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bbc0f-905d-4f1a-acaf-ff3b2ecf1a1c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:50.620274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:50.627312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad539573-9601-4728-9362-5b5fd1cfac77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=132f0e00402144b8802d942dafede41e, user_id=944c90063228489d8b1d946effa2ba18, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:50.631118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad539573-9601-4728-9362-5b5fd1cfac77 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:50.658187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 877/1772] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:50 2022] PUT /identity/v3/projects/c4ad9d0430b34d5caf1351e8f1e0bf1d/users/4061b42638b6406fae73f8e4b22ee469/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:50.658187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bbc0f-905d-4f1a-acaf-ff3b2ecf1a1c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:50.658187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-524bbc0f-905d-4f1a-acaf-ff3b2ecf1a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:50.666063 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 896/1773] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:50 2022] PUT /identity/v3/projects/132f0e00402144b8802d942dafede41e/users/944c90063228489d8b1d946effa2ba18/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:50.668441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb415eec-ea06-4aed-ae98-c4e3907d3aec None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.671387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb415eec-ea06-4aed-ae98-c4e3907d3aec None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.673919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb415eec-ea06-4aed-ae98-c4e3907d3aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:50.743047 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-cb415eec-ea06-4aed-ae98-c4e3907d3aec None None] MFA Rules not processed for user `4061b42638b6406fae73f8e4b22ee469`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:50.744856 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cb415eec-ea06-4aed-ae98-c4e3907d3aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:50.951980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 897/1774] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:50.952363 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb415eec-ea06-4aed-ae98-c4e3907d3aec None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:50.969814 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bbc0f-905d-4f1a-acaf-ff3b2ecf1a1c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:51.152601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4475e-f0a7-4527-8922-d90595ac8129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:51.155082 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4475e-f0a7-4527-8922-d90595ac8129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.155521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4475e-f0a7-4527-8922-d90595ac8129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.156080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4475e-f0a7-4527-8922-d90595ac8129 admin admin] PATH_INFO: `/v3/users/19295a71f1c64b4590a81d1d7305731f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.158225 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4475e-f0a7-4527-8922-d90595ac8129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19295a71f1c64b4590a81d1d7305731f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:51.160990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb415eec-ea06-4aed-ae98-c4e3907d3aec None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:51.161953 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4475e-f0a7-4527-8922-d90595ac8129 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:51.178063 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aedb19-787a-4488-9890-0adae9c952b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:51.179884 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aedb19-787a-4488-9890-0adae9c952b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.179884 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aedb19-787a-4488-9890-0adae9c952b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.179884 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aedb19-787a-4488-9890-0adae9c952b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.180176 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aedb19-787a-4488-9890-0adae9c952b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:51.181900 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aedb19-787a-4488-9890-0adae9c952b3 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:51.222554 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 898/1775] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:50 2022] GET /identity/v3/roles => generated 1427 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:51.224183 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8080b-58a1-429a-af80-8d0fd7cb763f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.224477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8080b-58a1-429a-af80-8d0fd7cb763f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.224797 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8080b-58a1-429a-af80-8d0fd7cb763f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.279245 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8eb8080b-58a1-429a-af80-8d0fd7cb763f None None] MFA Rules not processed for user `7535a906d3884263b6f031080c72cc6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:51.281389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8eb8080b-58a1-429a-af80-8d0fd7cb763f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:51.300427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-91e4475e-f0a7-4527-8922-d90595ac8129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19295a71f1c64b4590a81d1d7305731f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:51.301702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-91e4475e-f0a7-4527-8922-d90595ac8129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19295a71f1c64b4590a81d1d7305731f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:51.326602 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-91e4475e-f0a7-4527-8922-d90595ac8129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19295a71f1c64b4590a81d1d7305731f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:51.327736 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-91e4475e-f0a7-4527-8922-d90595ac8129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19295a71f1c64b4590a81d1d7305731f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:51.351125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-91e4475e-f0a7-4527-8922-d90595ac8129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19295a71f1c64b4590a81d1d7305731f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:51.420945 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 878/1776] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:42:50 2022] DELETE /identity/v3/users/19295a71f1c64b4590a81d1d7305731f => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:51.423519 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4475e-f0a7-4527-8922-d90595ac8129 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:51.432722 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-91e4475e-f0a7-4527-8922-d90595ac8129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:51.449263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 899/1777] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:51.450641 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8080b-58a1-429a-af80-8d0fd7cb763f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:51.456672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8eb8080b-58a1-429a-af80-8d0fd7cb763f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:51.458348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:51.503770 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8080b-58a1-429a-af80-8d0fd7cb763f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:51.533628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:51.703608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb0936-cc6f-48fc-825d-ae7790d77802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:51.705078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb0936-cc6f-48fc-825d-ae7790d77802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.705586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb0936-cc6f-48fc-825d-ae7790d77802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.710542 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb0936-cc6f-48fc-825d-ae7790d77802 admin admin] PATH_INFO: `/v3/projects/41b10a2741764fcbb7ac5387a9c839c6` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.715784 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4475e-f0a7-4527-8922-d90595ac8129 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:51.717583 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb0936-cc6f-48fc-825d-ae7790d77802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41b10a2741764fcbb7ac5387a9c839c6)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:51.727440 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb0936-cc6f-48fc-825d-ae7790d77802 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:51.739898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ee060-3405-45fd-b511-9009654c81f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:51.741419 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ee060-3405-45fd-b511-9009654c81f7 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.742075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ee060-3405-45fd-b511-9009654c81f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.744313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ee060-3405-45fd-b511-9009654c81f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.757182 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e14ee060-3405-45fd-b511-9009654c81f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:51.784731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ee060-3405-45fd-b511-9009654c81f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:51.796763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ee060-3405-45fd-b511-9009654c81f7 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:51.822710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 879/1778] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:51.827541 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ee060-3405-45fd-b511-9009654c81f7 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:51.833965 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e14ee060-3405-45fd-b511-9009654c81f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:51.872834 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-26cb0936-cc6f-48fc-825d-ae7790d77802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41b10a2741764fcbb7ac5387a9c839c6', 'request_id': 'req-26cb0936-cc6f-48fc-825d-ae7790d77802'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:51.887455 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-26cb0936-cc6f-48fc-825d-ae7790d77802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41b10a2741764fcbb7ac5387a9c839c6', 'request_id': 'req-26cb0936-cc6f-48fc-825d-ae7790d77802'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:51.902330 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-26cb0936-cc6f-48fc-825d-ae7790d77802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41b10a2741764fcbb7ac5387a9c839c6', 'request_id': 'req-26cb0936-cc6f-48fc-825d-ae7790d77802'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:51.924337 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-26cb0936-cc6f-48fc-825d-ae7790d77802 admin admin] The token cache is being invalidate because project 41b10a2741764fcbb7ac5387a9c839c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:51.936266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-26cb0936-cc6f-48fc-825d-ae7790d77802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:51.938265 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-26cb0936-cc6f-48fc-825d-ae7790d77802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:51.944408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 900/1779] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:42:51 2022] DELETE /identity/v3/projects/41b10a2741764fcbb7ac5387a9c839c6 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:51.946010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb0936-cc6f-48fc-825d-ae7790d77802 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:51.949729 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-26cb0936-cc6f-48fc-825d-ae7790d77802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:51.965072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ee060-3405-45fd-b511-9009654c81f7 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:52.145797 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb0936-cc6f-48fc-825d-ae7790d77802 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:52.158139 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d3548-22fe-4cab-8b21-02c4f8763ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:52.159089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d3548-22fe-4cab-8b21-02c4f8763ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.159372 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d3548-22fe-4cab-8b21-02c4f8763ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.159647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d3548-22fe-4cab-8b21-02c4f8763ad2 admin admin] PATH_INFO: `/v3/projects/132f0e00402144b8802d942dafede41e/users/944c90063228489d8b1d946effa2ba18/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.162741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d3548-22fe-4cab-8b21-02c4f8763ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=132f0e00402144b8802d942dafede41e, user_id=944c90063228489d8b1d946effa2ba18, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:52.166117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d3548-22fe-4cab-8b21-02c4f8763ad2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:52.170251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2b475-2dba-405b-a0a2-7334ef6c4a1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:52.170962 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2b475-2dba-405b-a0a2-7334ef6c4a1a service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.171399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2b475-2dba-405b-a0a2-7334ef6c4a1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.171675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2b475-2dba-405b-a0a2-7334ef6c4a1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.175451 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-20e2b475-2dba-405b-a0a2-7334ef6c4a1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:52.186446 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 901/1780] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:51 2022] PUT /identity/v3/projects/132f0e00402144b8802d942dafede41e/users/944c90063228489d8b1d946effa2ba18/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:52.188370 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c4902-044a-4429-a277-c18e869cc585 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.188886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c4902-044a-4429-a277-c18e869cc585 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.189546 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c4902-044a-4429-a277-c18e869cc585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.224216 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4a7c4902-044a-4429-a277-c18e869cc585 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:52.226235 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4a7c4902-044a-4429-a277-c18e869cc585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:52.306638 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:52.391371 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:52.395320 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2b475-2dba-405b-a0a2-7334ef6c4a1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:52.399176 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2b475-2dba-405b-a0a2-7334ef6c4a1a service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:52.404688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 902/1781] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:52.416729 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf9a7d-fde3-4288-a5cf-25a1061b6137 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.418719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 880/1782] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:52.419748 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf9a7d-fde3-4288-a5cf-25a1061b6137 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.420366 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefc365-c2fa-4230-811e-35b97414fd4d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.420758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefc365-c2fa-4230-811e-35b97414fd4d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.421139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefc365-c2fa-4230-811e-35b97414fd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.421327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf9a7d-fde3-4288-a5cf-25a1061b6137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.462770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4fefc365-c2fa-4230-811e-35b97414fd4d None None] MFA Rules not processed for user `944c90063228489d8b1d946effa2ba18`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:52.464939 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4fefc365-c2fa-4230-811e-35b97414fd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:52.538433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9acf9a7d-fde3-4288-a5cf-25a1061b6137 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:52.543579 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9acf9a7d-fde3-4288-a5cf-25a1061b6137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:52.601339 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 903/1783] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:52.603084 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf9a7d-fde3-4288-a5cf-25a1061b6137 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:52.607779 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9acf9a7d-fde3-4288-a5cf-25a1061b6137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:52.725002 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf9a7d-fde3-4288-a5cf-25a1061b6137 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:52.734603 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251495c3-1bb1-4753-a1e7-3c0a61b662e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:52.738666 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251495c3-1bb1-4753-a1e7-3c0a61b662e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.739025 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251495c3-1bb1-4753-a1e7-3c0a61b662e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.739317 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251495c3-1bb1-4753-a1e7-3c0a61b662e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.764387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251495c3-1bb1-4753-a1e7-3c0a61b662e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:52.766729 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251495c3-1bb1-4753-a1e7-3c0a61b662e3 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:52.770793 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 881/1784] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:52.774231 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefc365-c2fa-4230-811e-35b97414fd4d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:52.781275 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4fefc365-c2fa-4230-811e-35b97414fd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:52.799167 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 904/1785] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:52.800633 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db4a76-daf8-465c-b18d-f4ba3c8d5b37 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.800975 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db4a76-daf8-465c-b18d-f4ba3c8d5b37 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.801220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db4a76-daf8-465c-b18d-f4ba3c8d5b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.852959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-65db4a76-daf8-465c-b18d-f4ba3c8d5b37 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:52.854420 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-65db4a76-daf8-465c-b18d-f4ba3c8d5b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:52.887343 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 905/1786] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:52.887343 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db4a76-daf8-465c-b18d-f4ba3c8d5b37 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:52.890925 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-65db4a76-daf8-465c-b18d-f4ba3c8d5b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:52.987253 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefc365-c2fa-4230-811e-35b97414fd4d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:53.003521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071db3b-7ac3-4755-a141-d2ef2b3d61d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:53.009134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071db3b-7ac3-4755-a141-d2ef2b3d61d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:53.009507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071db3b-7ac3-4755-a141-d2ef2b3d61d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:53.009793 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071db3b-7ac3-4755-a141-d2ef2b3d61d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:53.017217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6071db3b-7ac3-4755-a141-d2ef2b3d61d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:53.097934 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db4a76-daf8-465c-b18d-f4ba3c8d5b37 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:53.109470 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a128d2a-fa82-44cb-a22d-63125c7ba161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:53.110174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a128d2a-fa82-44cb-a22d-63125c7ba161 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:53.112782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a128d2a-fa82-44cb-a22d-63125c7ba161 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:53.114596 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a128d2a-fa82-44cb-a22d-63125c7ba161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:53.143605 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a128d2a-fa82-44cb-a22d-63125c7ba161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:53.145439 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a128d2a-fa82-44cb-a22d-63125c7ba161 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:53.169755 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 906/1787] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:53.190209 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a128d2a-fa82-44cb-a22d-63125c7ba161 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:53.247543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a128d2a-fa82-44cb-a22d-63125c7ba161 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:53.303194 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114a2c4-e5f4-4012-83d6-e06fd28fb091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:53.303194 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114a2c4-e5f4-4012-83d6-e06fd28fb091 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:53.306379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114a2c4-e5f4-4012-83d6-e06fd28fb091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:53.308410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114a2c4-e5f4-4012-83d6-e06fd28fb091 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:53.318728 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114a2c4-e5f4-4012-83d6-e06fd28fb091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:53.318728 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114a2c4-e5f4-4012-83d6-e06fd28fb091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:53.331778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071db3b-7ac3-4755-a141-d2ef2b3d61d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:53.332701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114a2c4-e5f4-4012-83d6-e06fd28fb091 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:53.335094 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071db3b-7ac3-4755-a141-d2ef2b3d61d4 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:53.361827 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 882/1788] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:53.427046 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071db3b-7ac3-4755-a141-d2ef2b3d61d4 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:53.428808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 907/1789] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:42:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:53.458870 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071db3b-7ac3-4755-a141-d2ef2b3d61d4 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:53.483010 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c29977-b136-48b3-b2ce-533974d2529a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:53.484143 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c29977-b136-48b3-b2ce-533974d2529a admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:53.484705 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c29977-b136-48b3-b2ce-533974d2529a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:53.485210 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c29977-b136-48b3-b2ce-533974d2529a admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:53.486428 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c29977-b136-48b3-b2ce-533974d2529a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:53.488812 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c29977-b136-48b3-b2ce-533974d2529a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:53.537489 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114a2c4-e5f4-4012-83d6-e06fd28fb091 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:53.568553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 883/1790] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:53 2022] POST /identity/v3/projects => generated 374 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:53.573106 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c29977-b136-48b3-b2ce-533974d2529a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:53.583748 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114a2c4-e5f4-4012-83d6-e06fd28fb091 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:53.643997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:53.835423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c29977-b136-48b3-b2ce-533974d2529a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:53.868774 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e9075-0f27-4dd5-a191-d07c7cb2bf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:53.873073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e9075-0f27-4dd5-a191-d07c7cb2bf9e admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:53.880516 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e9075-0f27-4dd5-a191-d07c7cb2bf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:53.882626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e9075-0f27-4dd5-a191-d07c7cb2bf9e admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:53.883624 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e9075-0f27-4dd5-a191-d07c7cb2bf9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:53.889886 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e9075-0f27-4dd5-a191-d07c7cb2bf9e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:53.903426 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fb045-af93-4fbf-8989-696df528b6c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:53.904539 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fb045-af93-4fbf-8989-696df528b6c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:53.904539 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fb045-af93-4fbf-8989-696df528b6c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:53.905088 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fb045-af93-4fbf-8989-696df528b6c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:53.906934 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6d1fb045-af93-4fbf-8989-696df528b6c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:53.937686 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 884/1791] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:53 2022] POST /identity/v3/users => generated 288 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:53.939941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e9075-0f27-4dd5-a191-d07c7cb2bf9e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:53.943504 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:53.957030 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8b4e9075-0f27-4dd5-a191-d07c7cb2bf9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:53.985535 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e9075-0f27-4dd5-a191-d07c7cb2bf9e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:53.998845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b05da5-c5bc-45cd-8a77-ae29168cf879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:53.999679 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b05da5-c5bc-45cd-8a77-ae29168cf879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:53.999973 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b05da5-c5bc-45cd-8a77-ae29168cf879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:54.000253 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b05da5-c5bc-45cd-8a77-ae29168cf879 admin admin] PATH_INFO: `/v3/projects/903ec96df92c42208d37eb573148cc87` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:54.003373 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b05da5-c5bc-45cd-8a77-ae29168cf879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=903ec96df92c42208d37eb573148cc87)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:54.008874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b05da5-c5bc-45cd-8a77-ae29168cf879 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:54.070821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fb045-af93-4fbf-8989-696df528b6c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:54.074917 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fb045-af93-4fbf-8989-696df528b6c4 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:54.116688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 908/1792] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:42:54.118687 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fb045-af93-4fbf-8989-696df528b6c4 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:54.140509 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fb045-af93-4fbf-8989-696df528b6c4 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:54.144754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-99b05da5-c5bc-45cd-8a77-ae29168cf879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903ec96df92c42208d37eb573148cc87', 'request_id': 'req-99b05da5-c5bc-45cd-8a77-ae29168cf879'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:54.172198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-99b05da5-c5bc-45cd-8a77-ae29168cf879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903ec96df92c42208d37eb573148cc87', 'request_id': 'req-99b05da5-c5bc-45cd-8a77-ae29168cf879'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:54.206715 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-99b05da5-c5bc-45cd-8a77-ae29168cf879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903ec96df92c42208d37eb573148cc87', 'request_id': 'req-99b05da5-c5bc-45cd-8a77-ae29168cf879'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:54.286762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-99b05da5-c5bc-45cd-8a77-ae29168cf879 admin admin] The token cache is being invalidate because project 903ec96df92c42208d37eb573148cc87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:54.287766 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-99b05da5-c5bc-45cd-8a77-ae29168cf879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:54.289541 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-99b05da5-c5bc-45cd-8a77-ae29168cf879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:54.295550 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 885/1793] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:42:53 2022] DELETE /identity/v3/projects/903ec96df92c42208d37eb573148cc87 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:54.300991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b05da5-c5bc-45cd-8a77-ae29168cf879 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:54.304551 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-99b05da5-c5bc-45cd-8a77-ae29168cf879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:54.352170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5a86a-d8ee-48ef-a96d-304d2797e423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:54.354031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5a86a-d8ee-48ef-a96d-304d2797e423 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:54.355887 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5a86a-d8ee-48ef-a96d-304d2797e423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:54.360373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5a86a-d8ee-48ef-a96d-304d2797e423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:54.363074 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5a86a-d8ee-48ef-a96d-304d2797e423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:54.368349 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5a86a-d8ee-48ef-a96d-304d2797e423 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:54.475498 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 909/1794] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:54 2022] GET /identity/v3/roles => generated 1427 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:54.479602 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5a86a-d8ee-48ef-a96d-304d2797e423 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:54.492157 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-49a5a86a-d8ee-48ef-a96d-304d2797e423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:54.532696 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b05da5-c5bc-45cd-8a77-ae29168cf879 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:54.533833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5a86a-d8ee-48ef-a96d-304d2797e423 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:54.541460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51b085-d110-46b5-b811-a79f0df6cf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:54.542225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51b085-d110-46b5-b811-a79f0df6cf56 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:54.542696 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51b085-d110-46b5-b811-a79f0df6cf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:54.542911 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51b085-d110-46b5-b811-a79f0df6cf56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:54.543740 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51b085-d110-46b5-b811-a79f0df6cf56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:54.547273 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51b085-d110-46b5-b811-a79f0df6cf56 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:54.551217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c38b3-6a32-41b5-adc4-ea5262c1dd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:54.553259 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c38b3-6a32-41b5-adc4-ea5262c1dd63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:54.553911 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c38b3-6a32-41b5-adc4-ea5262c1dd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:54.555689 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c38b3-6a32-41b5-adc4-ea5262c1dd63 admin admin] PATH_INFO: `/v3/users/44aa3fdf1e1548579eb62285b6e365d7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:54.569441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 910/1795] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:54 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:54.570763 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51b085-d110-46b5-b811-a79f0df6cf56 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:54.571496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c38b3-6a32-41b5-adc4-ea5262c1dd63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44aa3fdf1e1548579eb62285b6e365d7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:54.576063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c38b3-6a32-41b5-adc4-ea5262c1dd63 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:54.600495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51b085-d110-46b5-b811-a79f0df6cf56 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:54.609315 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029f977-7110-4a88-990c-4ca201ea2fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:54.610297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029f977-7110-4a88-990c-4ca201ea2fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:54.610601 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029f977-7110-4a88-990c-4ca201ea2fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:54.610891 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029f977-7110-4a88-990c-4ca201ea2fd9 admin admin] PATH_INFO: `/v3/projects/6d0913158bb94346b0885f8b42be3c54/users/f2d78730896c4d3e8deb9082c83688f0/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:54.661619 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:54.669657 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029f977-7110-4a88-990c-4ca201ea2fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0913158bb94346b0885f8b42be3c54, user_id=f2d78730896c4d3e8deb9082c83688f0, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:54.672530 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029f977-7110-4a88-990c-4ca201ea2fd9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:54.716541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 911/1796] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:54 2022] PUT /identity/v3/projects/6d0913158bb94346b0885f8b42be3c54/users/f2d78730896c4d3e8deb9082c83688f0/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:54.719308 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabd2da-1574-4eb4-843b-2f59d43cbbd5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:54.719608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabd2da-1574-4eb4-843b-2f59d43cbbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:54.719890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabd2da-1574-4eb4-843b-2f59d43cbbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:54.764853 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2a6c38b3-6a32-41b5-adc4-ea5262c1dd63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44aa3fdf1e1548579eb62285b6e365d7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:54.767844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2a6c38b3-6a32-41b5-adc4-ea5262c1dd63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44aa3fdf1e1548579eb62285b6e365d7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:54.781921 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8eabd2da-1574-4eb4-843b-2f59d43cbbd5 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:54.783547 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8eabd2da-1574-4eb4-843b-2f59d43cbbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:54.825845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2a6c38b3-6a32-41b5-adc4-ea5262c1dd63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44aa3fdf1e1548579eb62285b6e365d7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:54.828844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2a6c38b3-6a32-41b5-adc4-ea5262c1dd63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44aa3fdf1e1548579eb62285b6e365d7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:54.858993 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2a6c38b3-6a32-41b5-adc4-ea5262c1dd63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44aa3fdf1e1548579eb62285b6e365d7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:54.938303 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 886/1797] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:42:54 2022] DELETE /identity/v3/users/44aa3fdf1e1548579eb62285b6e365d7 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:54.986721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 912/1798] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:54.999655 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c38b3-6a32-41b5-adc4-ea5262c1dd63 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:55.001528 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2a6c38b3-6a32-41b5-adc4-ea5262c1dd63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:55.108154 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c38b3-6a32-41b5-adc4-ea5262c1dd63 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:55.113533 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d323c0-4efb-49c6-808e-4cc849515a1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:55.114237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d323c0-4efb-49c6-808e-4cc849515a1d service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:55.114531 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d323c0-4efb-49c6-808e-4cc849515a1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:55.115405 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d323c0-4efb-49c6-808e-4cc849515a1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:55.250204 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d323c0-4efb-49c6-808e-4cc849515a1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:55.252375 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d323c0-4efb-49c6-808e-4cc849515a1d service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:55.266623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 887/1799] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:55.668402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabd2da-1574-4eb4-843b-2f59d43cbbd5 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:55.671850 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8eabd2da-1574-4eb4-843b-2f59d43cbbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:55.706275 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabd2da-1574-4eb4-843b-2f59d43cbbd5 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:55.717466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fff7d-97cc-472c-bf9b-b4582e647f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:55.719631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fff7d-97cc-472c-bf9b-b4582e647f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:55.721958 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fff7d-97cc-472c-bf9b-b4582e647f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:55.723278 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fff7d-97cc-472c-bf9b-b4582e647f84 admin admin] PATH_INFO: `/v3/projects/1d189a1a76ba467180e93cdaf662102a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:55.727266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fff7d-97cc-472c-bf9b-b4582e647f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d189a1a76ba467180e93cdaf662102a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:55.734318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fff7d-97cc-472c-bf9b-b4582e647f84 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:55.787567 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:55.858498 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-473fff7d-97cc-472c-bf9b-b4582e647f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d189a1a76ba467180e93cdaf662102a', 'request_id': 'req-473fff7d-97cc-472c-bf9b-b4582e647f84'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:55.870883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-473fff7d-97cc-472c-bf9b-b4582e647f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d189a1a76ba467180e93cdaf662102a', 'request_id': 'req-473fff7d-97cc-472c-bf9b-b4582e647f84'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:55.880431 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-473fff7d-97cc-472c-bf9b-b4582e647f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d189a1a76ba467180e93cdaf662102a', 'request_id': 'req-473fff7d-97cc-472c-bf9b-b4582e647f84'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:55.902643 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-473fff7d-97cc-472c-bf9b-b4582e647f84 admin admin] The token cache is being invalidate because project 1d189a1a76ba467180e93cdaf662102a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:55.903062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-473fff7d-97cc-472c-bf9b-b4582e647f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:55.903758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-473fff7d-97cc-472c-bf9b-b4582e647f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:55.905853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 913/1800] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:42:55 2022] DELETE /identity/v3/projects/1d189a1a76ba467180e93cdaf662102a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:55.920823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c403e3c-1635-4644-bc75-d46095d8b385 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:55.922319 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c403e3c-1635-4644-bc75-d46095d8b385 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:55.923309 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c403e3c-1635-4644-bc75-d46095d8b385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:55.956138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2c403e3c-1635-4644-bc75-d46095d8b385 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:55.958155 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2c403e3c-1635-4644-bc75-d46095d8b385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:56.058309 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:56.097524 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 888/1801] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:56.099879 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070771f8-e70a-466f-b8e6-a859a4f4b57d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.100850 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070771f8-e70a-466f-b8e6-a859a4f4b57d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.102437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070771f8-e70a-466f-b8e6-a859a4f4b57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.135361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-070771f8-e70a-466f-b8e6-a859a4f4b57d None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:56.135878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-070771f8-e70a-466f-b8e6-a859a4f4b57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:56.145903 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 914/1802] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:56.151086 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c403e3c-1635-4644-bc75-d46095d8b385 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:56.166713 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c403e3c-1635-4644-bc75-d46095d8b385 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:56.174095 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4243a-e1db-4e5c-a947-2bf205c36753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:56.175179 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4243a-e1db-4e5c-a947-2bf205c36753 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.175790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4243a-e1db-4e5c-a947-2bf205c36753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.176293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4243a-e1db-4e5c-a947-2bf205c36753 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.177410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4243a-e1db-4e5c-a947-2bf205c36753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:56.178063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4243a-e1db-4e5c-a947-2bf205c36753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:56.181334 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4243a-e1db-4e5c-a947-2bf205c36753 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:56.201348 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070771f8-e70a-466f-b8e6-a859a4f4b57d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:56.209267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 889/1803] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:42:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:56.212437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070771f8-e70a-466f-b8e6-a859a4f4b57d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:56.218630 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9a140-b305-4137-bb20-b6f130b92f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:56.219333 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9a140-b305-4137-bb20-b6f130b92f34 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.219623 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9a140-b305-4137-bb20-b6f130b92f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.219902 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9a140-b305-4137-bb20-b6f130b92f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.220613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9a140-b305-4137-bb20-b6f130b92f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:56.222563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9a140-b305-4137-bb20-b6f130b92f34 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:56.258115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 915/1804] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:56 2022] POST /identity/v3/projects => generated 380 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:56.259834 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4243a-e1db-4e5c-a947-2bf205c36753 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:56.278177 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4243a-e1db-4e5c-a947-2bf205c36753 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:56.354209 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f5d7f-2a0a-4112-9bd7-e78a42427822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:56.355097 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f5d7f-2a0a-4112-9bd7-e78a42427822 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.355277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f5d7f-2a0a-4112-9bd7-e78a42427822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.355558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f5d7f-2a0a-4112-9bd7-e78a42427822 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.356292 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f5d7f-2a0a-4112-9bd7-e78a42427822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:56.358331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f5d7f-2a0a-4112-9bd7-e78a42427822 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:56.398178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 890/1805] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:56 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:56.403498 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9a140-b305-4137-bb20-b6f130b92f34 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:56.424022 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9a140-b305-4137-bb20-b6f130b92f34 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:56.430780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ac275-b881-445d-9aa3-0582dc6416da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:56.431448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ac275-b881-445d-9aa3-0582dc6416da admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.431735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ac275-b881-445d-9aa3-0582dc6416da admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.432015 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ac275-b881-445d-9aa3-0582dc6416da admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.433346 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ac275-b881-445d-9aa3-0582dc6416da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:56.435050 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ac275-b881-445d-9aa3-0582dc6416da admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:56.450219 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 916/1806] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:56 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:56.455621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f5d7f-2a0a-4112-9bd7-e78a42427822 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:56.471521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f5d7f-2a0a-4112-9bd7-e78a42427822 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:56.477839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54aa833-509d-44ba-8b33-276d8ac3f383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:56.486654 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54aa833-509d-44ba-8b33-276d8ac3f383 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.486654 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54aa833-509d-44ba-8b33-276d8ac3f383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.486654 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54aa833-509d-44ba-8b33-276d8ac3f383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.486654 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54aa833-509d-44ba-8b33-276d8ac3f383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:56.486654 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54aa833-509d-44ba-8b33-276d8ac3f383 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:56.489518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a319ae-8737-432e-8d4d-b618a9503f86 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.489897 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a319ae-8737-432e-8d4d-b618a9503f86 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.490275 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a319ae-8737-432e-8d4d-b618a9503f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.494497 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 891/1807] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:56 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:56.499878 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54aa833-509d-44ba-8b33-276d8ac3f383 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:56.513274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54aa833-509d-44ba-8b33-276d8ac3f383 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:56.519198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ce838-bbed-4589-996c-47377d6f75e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:56.520124 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce838-bbed-4589-996c-47377d6f75e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.520827 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce838-bbed-4589-996c-47377d6f75e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.520827 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce838-bbed-4589-996c-47377d6f75e7 admin admin] PATH_INFO: `/v3/projects/af68872a3cae4662a6218f7c0720cf78/users/25855c3371424db9af38ac1cd60994dd/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.528208 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-55a319ae-8737-432e-8d4d-b618a9503f86 None None] MFA Rules not processed for user `f2d78730896c4d3e8deb9082c83688f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:56.529927 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-55a319ae-8737-432e-8d4d-b618a9503f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:56.539386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ce838-bbed-4589-996c-47377d6f75e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af68872a3cae4662a6218f7c0720cf78, user_id=25855c3371424db9af38ac1cd60994dd, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:56.544023 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ce838-bbed-4589-996c-47377d6f75e7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:56.577621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 892/1808] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:56 2022] PUT /identity/v3/projects/af68872a3cae4662a6218f7c0720cf78/users/25855c3371424db9af38ac1cd60994dd/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:56.593871 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dd320-9f6c-4d15-9b35-b0b863e77159 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.594637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dd320-9f6c-4d15-9b35-b0b863e77159 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.594918 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dd320-9f6c-4d15-9b35-b0b863e77159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.645100 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ae4dd320-9f6c-4d15-9b35-b0b863e77159 None None] MFA Rules not processed for user `25855c3371424db9af38ac1cd60994dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:56.647087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ae4dd320-9f6c-4d15-9b35-b0b863e77159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:56.647286 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 917/1809] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:56.653171 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a319ae-8737-432e-8d4d-b618a9503f86 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:56.654718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-55a319ae-8737-432e-8d4d-b618a9503f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:56.675993 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a319ae-8737-432e-8d4d-b618a9503f86 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:56.739085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 893/1810] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:56.744716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dd320-9f6c-4d15-9b35-b0b863e77159 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:56.762618 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:56.795039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14234d-2b78-406e-8af5-84d0788e6f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:56.795753 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14234d-2b78-406e-8af5-84d0788e6f1d admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.796039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14234d-2b78-406e-8af5-84d0788e6f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.796321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14234d-2b78-406e-8af5-84d0788e6f1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.797334 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14234d-2b78-406e-8af5-84d0788e6f1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:56.798096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:56.800987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14234d-2b78-406e-8af5-84d0788e6f1d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:56.858623 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 918/1811] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:56 2022] POST /identity/v3/projects => generated 374 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:56.860055 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14234d-2b78-406e-8af5-84d0788e6f1d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:56.890695 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dd320-9f6c-4d15-9b35-b0b863e77159 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.009649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14234d-2b78-406e-8af5-84d0788e6f1d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.039858 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a059bfe-1519-48fd-8393-5fd14e68fbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:57.041139 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a059bfe-1519-48fd-8393-5fd14e68fbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.041714 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a059bfe-1519-48fd-8393-5fd14e68fbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.043337 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a059bfe-1519-48fd-8393-5fd14e68fbf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.045123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a059bfe-1519-48fd-8393-5fd14e68fbf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:57.050160 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a059bfe-1519-48fd-8393-5fd14e68fbf1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.092844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e156a-1f5b-4d07-a7a5-3f2d91dbc988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:57.095731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e156a-1f5b-4d07-a7a5-3f2d91dbc988 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.096357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e156a-1f5b-4d07-a7a5-3f2d91dbc988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.096864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e156a-1f5b-4d07-a7a5-3f2d91dbc988 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.098916 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e156a-1f5b-4d07-a7a5-3f2d91dbc988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:57.104006 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 919/1812] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:56 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:57.118930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a059bfe-1519-48fd-8393-5fd14e68fbf1 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:57.119035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e156a-1f5b-4d07-a7a5-3f2d91dbc988 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.127563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a059bfe-1519-48fd-8393-5fd14e68fbf1 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.136286 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3bb8c-5584-4232-9838-fab732cbd5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:57.138049 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3bb8c-5584-4232-9838-fab732cbd5eb admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.138461 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3bb8c-5584-4232-9838-fab732cbd5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.140010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3bb8c-5584-4232-9838-fab732cbd5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.142142 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3bb8c-5584-4232-9838-fab732cbd5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:57.145132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3bb8c-5584-4232-9838-fab732cbd5eb admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.165373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 920/1813] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:57 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:57.169563 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 894/1814] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:56 2022] POST /identity/v3/projects => generated 378 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:57.174197 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3bb8c-5584-4232-9838-fab732cbd5eb admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:57.174423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e156a-1f5b-4d07-a7a5-3f2d91dbc988 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:57.190356 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3bb8c-5584-4232-9838-fab732cbd5eb admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.313038 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a7ed9-32eb-48d1-90bf-5049181de128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:57.316042 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a7ed9-32eb-48d1-90bf-5049181de128 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.317126 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a7ed9-32eb-48d1-90bf-5049181de128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.317765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a7ed9-32eb-48d1-90bf-5049181de128 admin admin] PATH_INFO: `/v3/projects/ebc7000e202947c7bb269e7457bf6a3a/users/5826cbef64ba441c8d26bb3c697cf349/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.362198 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a7ed9-32eb-48d1-90bf-5049181de128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc7000e202947c7bb269e7457bf6a3a, user_id=5826cbef64ba441c8d26bb3c697cf349, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:57.366294 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a7ed9-32eb-48d1-90bf-5049181de128 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.388663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e156a-1f5b-4d07-a7a5-3f2d91dbc988 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.398800 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 921/1815] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:57 2022] PUT /identity/v3/projects/ebc7000e202947c7bb269e7457bf6a3a/users/5826cbef64ba441c8d26bb3c697cf349/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:57.405028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a7ed9-32eb-48d1-90bf-5049181de128 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:57.409749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8d3a7ed9-32eb-48d1-90bf-5049181de128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:57.531678 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:57.572566 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94554637-f4cd-4f3b-8ef3-c712262ec2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:57.573666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94554637-f4cd-4f3b-8ef3-c712262ec2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.574200 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94554637-f4cd-4f3b-8ef3-c712262ec2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.574362 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94554637-f4cd-4f3b-8ef3-c712262ec2a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.575019 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94554637-f4cd-4f3b-8ef3-c712262ec2a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:57.577521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94554637-f4cd-4f3b-8ef3-c712262ec2a0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.590844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:57.623115 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 895/1816] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:57 2022] POST /identity/v3/users => generated 290 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:57.625888 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94554637-f4cd-4f3b-8ef3-c712262ec2a0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:57.640090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a7ed9-32eb-48d1-90bf-5049181de128 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.650300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133aac14-d667-442a-a7e8-7486732e3914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:57.652380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aac14-d667-442a-a7e8-7486732e3914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.653910 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aac14-d667-442a-a7e8-7486732e3914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.654272 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aac14-d667-442a-a7e8-7486732e3914 admin admin] PATH_INFO: `/v3/users/0aa8f0da8339447c9396e4de4f09f7f3` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.655452 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94554637-f4cd-4f3b-8ef3-c712262ec2a0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.659675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133aac14-d667-442a-a7e8-7486732e3914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa8f0da8339447c9396e4de4f09f7f3)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:57.662307 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133aac14-d667-442a-a7e8-7486732e3914 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.672976 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6210057-925e-4f6f-b427-600c0ecdef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:57.674033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6210057-925e-4f6f-b427-600c0ecdef6a admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.674512 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6210057-925e-4f6f-b427-600c0ecdef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.675037 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6210057-925e-4f6f-b427-600c0ecdef6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.676013 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6210057-925e-4f6f-b427-600c0ecdef6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:57.677875 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6210057-925e-4f6f-b427-600c0ecdef6a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.694379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 896/1817] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:57 2022] GET /identity/v3/roles => generated 1427 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:57.695727 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6210057-925e-4f6f-b427-600c0ecdef6a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:57.709615 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6210057-925e-4f6f-b427-600c0ecdef6a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.718736 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0531e46-5bab-4be7-b1b9-dccf3b1790b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:57.719869 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0531e46-5bab-4be7-b1b9-dccf3b1790b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.720406 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0531e46-5bab-4be7-b1b9-dccf3b1790b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.720981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0531e46-5bab-4be7-b1b9-dccf3b1790b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.722359 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0531e46-5bab-4be7-b1b9-dccf3b1790b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:57.730537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0531e46-5bab-4be7-b1b9-dccf3b1790b0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.761652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 897/1818] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:57 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:57.762656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0531e46-5bab-4be7-b1b9-dccf3b1790b0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:57.770184 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-133aac14-d667-442a-a7e8-7486732e3914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa8f0da8339447c9396e4de4f09f7f3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:57.776704 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0531e46-5bab-4be7-b1b9-dccf3b1790b0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.784042 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7dd89-24fe-4243-bd53-fd45150c7ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:57.785454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7dd89-24fe-4243-bd53-fd45150c7ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.785930 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7dd89-24fe-4243-bd53-fd45150c7ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.786606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7dd89-24fe-4243-bd53-fd45150c7ba3 admin admin] PATH_INFO: `/v3/projects/ebc7000e202947c7bb269e7457bf6a3a/users/5826cbef64ba441c8d26bb3c697cf349/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.813882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7dd89-24fe-4243-bd53-fd45150c7ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc7000e202947c7bb269e7457bf6a3a, user_id=5826cbef64ba441c8d26bb3c697cf349, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:57.816501 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-133aac14-d667-442a-a7e8-7486732e3914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa8f0da8339447c9396e4de4f09f7f3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:57.818048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-133aac14-d667-442a-a7e8-7486732e3914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa8f0da8339447c9396e4de4f09f7f3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:57.821029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7dd89-24fe-4243-bd53-fd45150c7ba3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.834657 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-133aac14-d667-442a-a7e8-7486732e3914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa8f0da8339447c9396e4de4f09f7f3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:57.835543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-133aac14-d667-442a-a7e8-7486732e3914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa8f0da8339447c9396e4de4f09f7f3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:57.845071 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 898/1819] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:57 2022] PUT /identity/v3/projects/ebc7000e202947c7bb269e7457bf6a3a/users/5826cbef64ba441c8d26bb3c697cf349/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:57.846417 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7dd89-24fe-4243-bd53-fd45150c7ba3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:57.849938 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-85f7dd89-24fe-4243-bd53-fd45150c7ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:57.894902 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 922/1820] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:42:57 2022] DELETE /identity/v3/users/0aa8f0da8339447c9396e4de4f09f7f3 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:57.899590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be4a80-7eab-43cb-b117-a51cd73ef799 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.900030 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be4a80-7eab-43cb-b117-a51cd73ef799 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.900473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be4a80-7eab-43cb-b117-a51cd73ef799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.935260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-21be4a80-7eab-43cb-b117-a51cd73ef799 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:57.937756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-21be4a80-7eab-43cb-b117-a51cd73ef799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:57.992835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7dd89-24fe-4243-bd53-fd45150c7ba3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:58.043633 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 923/1821] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:58.063417 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be4a80-7eab-43cb-b117-a51cd73ef799 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:58.065338 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-21be4a80-7eab-43cb-b117-a51cd73ef799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:58.096009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81517729-d1b6-4a0a-920e-27763d556612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:58.097112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81517729-d1b6-4a0a-920e-27763d556612 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:58.097469 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81517729-d1b6-4a0a-920e-27763d556612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:58.097817 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81517729-d1b6-4a0a-920e-27763d556612 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:58.100292 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81517729-d1b6-4a0a-920e-27763d556612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:58.104885 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81517729-d1b6-4a0a-920e-27763d556612 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:58.136780 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 899/1822] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:57 2022] GET /identity/v3/roles => generated 1427 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:58.142246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81517729-d1b6-4a0a-920e-27763d556612 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:58.185417 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81517729-d1b6-4a0a-920e-27763d556612 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:58.209698 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf900afd-bc7f-4f93-978e-d44e78ce1dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:58.211276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf900afd-bc7f-4f93-978e-d44e78ce1dca admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:58.211751 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf900afd-bc7f-4f93-978e-d44e78ce1dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:58.212220 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf900afd-bc7f-4f93-978e-d44e78ce1dca admin admin] PATH_INFO: `/v3/projects/cb000246d17e415f88ce5a7305d34859/users/277c129482674733a86f829875f12b67/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:58.247398 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be4a80-7eab-43cb-b117-a51cd73ef799 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:58.260508 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2af65e-6dd3-4d96-a5cc-d4b1234ffd89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:58.261544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2af65e-6dd3-4d96-a5cc-d4b1234ffd89 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:58.262023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2af65e-6dd3-4d96-a5cc-d4b1234ffd89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:58.262491 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2af65e-6dd3-4d96-a5cc-d4b1234ffd89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:58.298676 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2af65e-6dd3-4d96-a5cc-d4b1234ffd89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:58.302185 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2af65e-6dd3-4d96-a5cc-d4b1234ffd89 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:58.302667 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf900afd-bc7f-4f93-978e-d44e78ce1dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb000246d17e415f88ce5a7305d34859, user_id=277c129482674733a86f829875f12b67, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:58.306495 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf900afd-bc7f-4f93-978e-d44e78ce1dca admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:58.310452 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:58.331304 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 924/1823] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:42:58.343963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 900/1824] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:58 2022] PUT /identity/v3/projects/cb000246d17e415f88ce5a7305d34859/users/277c129482674733a86f829875f12b67/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:58.363030 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b342d33-75c7-4221-8151-d0348981dec7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:58.363524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b342d33-75c7-4221-8151-d0348981dec7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:58.364014 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b342d33-75c7-4221-8151-d0348981dec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:58.445396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6b342d33-75c7-4221-8151-d0348981dec7 None None] MFA Rules not processed for user `277c129482674733a86f829875f12b67`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:58.450845 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6b342d33-75c7-4221-8151-d0348981dec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:58.574327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 925/1825] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:58.583572 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf900afd-bc7f-4f93-978e-d44e78ce1dca admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:58.732583 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:58.822587 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf900afd-bc7f-4f93-978e-d44e78ce1dca admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:58.832789 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a5234-f3db-4889-9ae0-fd206d09398a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:58.833516 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a5234-f3db-4889-9ae0-fd206d09398a admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:58.833930 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a5234-f3db-4889-9ae0-fd206d09398a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:58.834220 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a5234-f3db-4889-9ae0-fd206d09398a admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:58.836050 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a5234-f3db-4889-9ae0-fd206d09398a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:58.839389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a5234-f3db-4889-9ae0-fd206d09398a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:58.914777 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 901/1826] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:42:58 2022] POST /identity/v3/projects => generated 380 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:58.920721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b342d33-75c7-4221-8151-d0348981dec7 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:58.941388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b342d33-75c7-4221-8151-d0348981dec7 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:59.046816 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604598d4-4436-4d41-996b-a2547217b2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:59.048688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604598d4-4436-4d41-996b-a2547217b2dd admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:59.048688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604598d4-4436-4d41-996b-a2547217b2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:59.048943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604598d4-4436-4d41-996b-a2547217b2dd admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:59.049782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604598d4-4436-4d41-996b-a2547217b2dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:59.052811 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604598d4-4436-4d41-996b-a2547217b2dd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:59.100270 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 926/1827] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:42:58 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:59.101903 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a5234-f3db-4889-9ae0-fd206d09398a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:59.125266 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a5234-f3db-4889-9ae0-fd206d09398a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:59.139521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57206eb0-6159-4a51-83a0-64ffb5744778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:59.141054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57206eb0-6159-4a51-83a0-64ffb5744778 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:59.141459 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57206eb0-6159-4a51-83a0-64ffb5744778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:59.141853 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57206eb0-6159-4a51-83a0-64ffb5744778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:59.145049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57206eb0-6159-4a51-83a0-64ffb5744778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:59.147062 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57206eb0-6159-4a51-83a0-64ffb5744778 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:59.174164 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 902/1828] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:59 2022] GET /identity/v3/roles => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:59.175266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604598d4-4436-4d41-996b-a2547217b2dd admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:59.198914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604598d4-4436-4d41-996b-a2547217b2dd admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:59.210448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f76367-b616-46e3-ab02-f402285d3b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:59.212532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f76367-b616-46e3-ab02-f402285d3b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:59.213569 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f76367-b616-46e3-ab02-f402285d3b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:59.214287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f76367-b616-46e3-ab02-f402285d3b97 admin admin] PATH_INFO: `/v3/projects/3ac575c9cc314ba98d2f081bc609f7d8/users/1ba21f251af34120a2c1a14e5aecc122/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:59.257868 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f76367-b616-46e3-ab02-f402285d3b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ac575c9cc314ba98d2f081bc609f7d8, user_id=1ba21f251af34120a2c1a14e5aecc122, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:59.266392 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f76367-b616-46e3-ab02-f402285d3b97 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:59.341425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 927/1829] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:59 2022] PUT /identity/v3/projects/3ac575c9cc314ba98d2f081bc609f7d8/users/1ba21f251af34120a2c1a14e5aecc122/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:59.348868 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57206eb0-6159-4a51-83a0-64ffb5744778 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:59.373707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57206eb0-6159-4a51-83a0-64ffb5744778 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:59.388568 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f76367-b616-46e3-ab02-f402285d3b97 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:59.390933 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c9f76367-b616-46e3-ab02-f402285d3b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:59.540428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:59.541095 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2800f8-aec1-4b1a-819b-cbdd19a93d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:59.544463 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2800f8-aec1-4b1a-819b-cbdd19a93d30 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:59.544833 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2800f8-aec1-4b1a-819b-cbdd19a93d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:59.545291 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2800f8-aec1-4b1a-819b-cbdd19a93d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:59.546108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2800f8-aec1-4b1a-819b-cbdd19a93d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:59.554261 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2800f8-aec1-4b1a-819b-cbdd19a93d30 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:59.559381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f76367-b616-46e3-ab02-f402285d3b97 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:59.574109 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd6e23-1bf0-4a13-a8de-dffe7e00ebe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:59.575127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd6e23-1bf0-4a13-a8de-dffe7e00ebe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:59.575613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd6e23-1bf0-4a13-a8de-dffe7e00ebe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:59.576279 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd6e23-1bf0-4a13-a8de-dffe7e00ebe0 admin admin] PATH_INFO: `/v3/projects/761dbf4447b64178bc75ead01f2dd47c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:59.579258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd6e23-1bf0-4a13-a8de-dffe7e00ebe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=761dbf4447b64178bc75ead01f2dd47c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:59.579499 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 903/1830] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:42:59 2022] GET /identity/v3/roles => generated 1427 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:59.581101 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd6e23-1bf0-4a13-a8de-dffe7e00ebe0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:59.582550 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2800f8-aec1-4b1a-819b-cbdd19a93d30 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:59.633299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2800f8-aec1-4b1a-819b-cbdd19a93d30 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:59.639769 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2d15e-3fe9-4f05-926e-7aed1d4eee8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:59.640990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2d15e-3fe9-4f05-926e-7aed1d4eee8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:59.641282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2d15e-3fe9-4f05-926e-7aed1d4eee8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:59.641605 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2d15e-3fe9-4f05-926e-7aed1d4eee8a admin admin] PATH_INFO: `/v3/projects/3ac575c9cc314ba98d2f081bc609f7d8/users/1ba21f251af34120a2c1a14e5aecc122/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:59.644615 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2d15e-3fe9-4f05-926e-7aed1d4eee8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ac575c9cc314ba98d2f081bc609f7d8, user_id=1ba21f251af34120a2c1a14e5aecc122, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:59.647572 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2d15e-3fe9-4f05-926e-7aed1d4eee8a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:59.659563 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 904/1831] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:42:59 2022] PUT /identity/v3/projects/3ac575c9cc314ba98d2f081bc609f7d8/users/1ba21f251af34120a2c1a14e5aecc122/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:59.670498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cabe0-dcf5-45f6-85ae-4cedb29bd8d5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:59.670957 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cabe0-dcf5-45f6-85ae-4cedb29bd8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:59.671574 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cabe0-dcf5-45f6-85ae-4cedb29bd8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:59.679024 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-07bd6e23-1bf0-4a13-a8de-dffe7e00ebe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '761dbf4447b64178bc75ead01f2dd47c', 'request_id': 'req-07bd6e23-1bf0-4a13-a8de-dffe7e00ebe0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:59.704941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-07bd6e23-1bf0-4a13-a8de-dffe7e00ebe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '761dbf4447b64178bc75ead01f2dd47c', 'request_id': 'req-07bd6e23-1bf0-4a13-a8de-dffe7e00ebe0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:59.721913 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-07bd6e23-1bf0-4a13-a8de-dffe7e00ebe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '761dbf4447b64178bc75ead01f2dd47c', 'request_id': 'req-07bd6e23-1bf0-4a13-a8de-dffe7e00ebe0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:59.735908 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-541cabe0-dcf5-45f6-85ae-4cedb29bd8d5 None None] MFA Rules not processed for user `1ba21f251af34120a2c1a14e5aecc122`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:59.737753 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-541cabe0-dcf5-45f6-85ae-4cedb29bd8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:59.743979 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-07bd6e23-1bf0-4a13-a8de-dffe7e00ebe0 admin admin] The token cache is being invalidate because project 761dbf4447b64178bc75ead01f2dd47c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:59.744282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-07bd6e23-1bf0-4a13-a8de-dffe7e00ebe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:59.745041 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-07bd6e23-1bf0-4a13-a8de-dffe7e00ebe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:59.747332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 928/1832] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:42:59 2022] DELETE /identity/v3/projects/761dbf4447b64178bc75ead01f2dd47c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:59.751528 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd6e23-1bf0-4a13-a8de-dffe7e00ebe0 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:59.753140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-07bd6e23-1bf0-4a13-a8de-dffe7e00ebe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:59.851057 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd6e23-1bf0-4a13-a8de-dffe7e00ebe0 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:59.859047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 905/1833] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:42:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:59.872959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cabe0-dcf5-45f6-85ae-4cedb29bd8d5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:59.874700 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-541cabe0-dcf5-45f6-85ae-4cedb29bd8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:59.932339 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:59.983851 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc189f-d52c-4ba1-86fb-99151aead99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:59.984827 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc189f-d52c-4ba1-86fb-99151aead99e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:59.985885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc189f-d52c-4ba1-86fb-99151aead99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:59.986216 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc189f-d52c-4ba1-86fb-99151aead99e admin admin] PATH_INFO: `/v3/users/4061b42638b6406fae73f8e4b22ee469` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:59.990462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc189f-d52c-4ba1-86fb-99151aead99e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4061b42638b6406fae73f8e4b22ee469)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:59.992822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc189f-d52c-4ba1-86fb-99151aead99e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:00.021730 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cabe0-dcf5-45f6-85ae-4cedb29bd8d5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:00.030477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fc9bc-7cca-42fe-929a-319a5ab16833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:00.031216 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fc9bc-7cca-42fe-929a-319a5ab16833 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:00.031506 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fc9bc-7cca-42fe-929a-319a5ab16833 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:00.031777 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fc9bc-7cca-42fe-929a-319a5ab16833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:00.058093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fc9bc-7cca-42fe-929a-319a5ab16833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:00.058834 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fc9bc-7cca-42fe-929a-319a5ab16833 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:00.065407 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:00.089925 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c6cc189f-d52c-4ba1-86fb-99151aead99e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4061b42638b6406fae73f8e4b22ee469'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:00.092685 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 906/1834] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:42:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:00.121065 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c6cc189f-d52c-4ba1-86fb-99151aead99e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4061b42638b6406fae73f8e4b22ee469'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:00.124803 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c6cc189f-d52c-4ba1-86fb-99151aead99e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4061b42638b6406fae73f8e4b22ee469'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:00.144762 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c6cc189f-d52c-4ba1-86fb-99151aead99e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4061b42638b6406fae73f8e4b22ee469'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:00.145731 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c6cc189f-d52c-4ba1-86fb-99151aead99e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4061b42638b6406fae73f8e4b22ee469'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:00.176345 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 929/1835] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:42:59 2022] DELETE /identity/v3/users/4061b42638b6406fae73f8e4b22ee469 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:00.179911 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fc9bc-7cca-42fe-929a-319a5ab16833 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:00.181611 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ea1fc9bc-7cca-42fe-929a-319a5ab16833 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:00.200579 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fc9bc-7cca-42fe-929a-319a5ab16833 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:00.303839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0b168-26ee-436f-ba9b-c3b0bddef920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:00.305737 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0b168-26ee-436f-ba9b-c3b0bddef920 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:00.306057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0b168-26ee-436f-ba9b-c3b0bddef920 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:00.307323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0b168-26ee-436f-ba9b-c3b0bddef920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:00.315777 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-08c0b168-26ee-436f-ba9b-c3b0bddef920 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:00.522039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0b168-26ee-436f-ba9b-c3b0bddef920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:00.526926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0b168-26ee-436f-ba9b-c3b0bddef920 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:00.562624 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 907/1836] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:00.907192 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3bb26-bd42-46fb-ad8f-c6a1cffe2f7a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:00.907742 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3bb26-bd42-46fb-ad8f-c6a1cffe2f7a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:00.907986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3bb26-bd42-46fb-ad8f-c6a1cffe2f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:00.966054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-02f3bb26-bd42-46fb-ad8f-c6a1cffe2f7a None None] MFA Rules not processed for user `5826cbef64ba441c8d26bb3c697cf349`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:00.976378 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-02f3bb26-bd42-46fb-ad8f-c6a1cffe2f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:01.123214 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 930/1837] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:01.134277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7d447-e16a-4949-9296-478791c134ca None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:01.134671 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7d447-e16a-4949-9296-478791c134ca None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:01.135084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7d447-e16a-4949-9296-478791c134ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:01.160592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-08e7d447-e16a-4949-9296-478791c134ca None None] MFA Rules not processed for user `f2d78730896c4d3e8deb9082c83688f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:01.161842 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-08e7d447-e16a-4949-9296-478791c134ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:01.245265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 908/1838] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:01.443224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3bb26-bd42-46fb-ad8f-c6a1cffe2f7a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:01.444874 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-02f3bb26-bd42-46fb-ad8f-c6a1cffe2f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:01.627221 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3bb26-bd42-46fb-ad8f-c6a1cffe2f7a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:01.633641 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd6ec9-aeed-4eeb-be94-c7d5247a3994 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:01.634415 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd6ec9-aeed-4eeb-be94-c7d5247a3994 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:01.634802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd6ec9-aeed-4eeb-be94-c7d5247a3994 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:01.635682 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd6ec9-aeed-4eeb-be94-c7d5247a3994 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:01.643301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-edfd6ec9-aeed-4eeb-be94-c7d5247a3994 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:01.663405 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd6ec9-aeed-4eeb-be94-c7d5247a3994 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:01.665153 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd6ec9-aeed-4eeb-be94-c7d5247a3994 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:01.692795 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 931/1839] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:01.705601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7d447-e16a-4949-9296-478791c134ca None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:01.708393 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-08e7d447-e16a-4949-9296-478791c134ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:01.789127 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:01.852460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7d447-e16a-4949-9296-478791c134ca None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:01.857326 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53cc64-5208-4518-9984-8d4fb1f4c357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:01.858792 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53cc64-5208-4518-9984-8d4fb1f4c357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:01.858792 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53cc64-5208-4518-9984-8d4fb1f4c357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:01.859059 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53cc64-5208-4518-9984-8d4fb1f4c357 admin admin] PATH_INFO: `/v3/projects/c4ad9d0430b34d5caf1351e8f1e0bf1d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:01.861029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53cc64-5208-4518-9984-8d4fb1f4c357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ad9d0430b34d5caf1351e8f1e0bf1d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:01.864201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53cc64-5208-4518-9984-8d4fb1f4c357 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:01.938410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fb53cc64-5208-4518-9984-8d4fb1f4c357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ad9d0430b34d5caf1351e8f1e0bf1d', 'request_id': 'req-fb53cc64-5208-4518-9984-8d4fb1f4c357'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:01.951080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fb53cc64-5208-4518-9984-8d4fb1f4c357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ad9d0430b34d5caf1351e8f1e0bf1d', 'request_id': 'req-fb53cc64-5208-4518-9984-8d4fb1f4c357'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:01.963289 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fb53cc64-5208-4518-9984-8d4fb1f4c357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ad9d0430b34d5caf1351e8f1e0bf1d', 'request_id': 'req-fb53cc64-5208-4518-9984-8d4fb1f4c357'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:01.982240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fb53cc64-5208-4518-9984-8d4fb1f4c357 admin admin] The token cache is being invalidate because project c4ad9d0430b34d5caf1351e8f1e0bf1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:01.982524 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fb53cc64-5208-4518-9984-8d4fb1f4c357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:01.983777 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fb53cc64-5208-4518-9984-8d4fb1f4c357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:01.990286 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 909/1840] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:01 2022] DELETE /identity/v3/projects/c4ad9d0430b34d5caf1351e8f1e0bf1d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:01.992444 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31f44f-7b89-42c3-9dab-b01ec1d5e336 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:01.992891 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31f44f-7b89-42c3-9dab-b01ec1d5e336 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:01.993115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31f44f-7b89-42c3-9dab-b01ec1d5e336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:02.040986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3a31f44f-7b89-42c3-9dab-b01ec1d5e336 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:02.060287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3a31f44f-7b89-42c3-9dab-b01ec1d5e336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:02.104367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:02.248427 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 932/1841] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:02.258914 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673e9e4-7738-44bc-91bb-3e6a844d8090 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:02.259410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673e9e4-7738-44bc-91bb-3e6a844d8090 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:02.259410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673e9e4-7738-44bc-91bb-3e6a844d8090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:02.289962 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0673e9e4-7738-44bc-91bb-3e6a844d8090 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:02.291901 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0673e9e4-7738-44bc-91bb-3e6a844d8090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:02.304305 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 910/1842] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:02.309670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31f44f-7b89-42c3-9dab-b01ec1d5e336 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:02.326523 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31f44f-7b89-42c3-9dab-b01ec1d5e336 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:02.333022 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cd6ad-3e7d-49b9-a1c3-6ff83b6ba4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:02.334143 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cd6ad-3e7d-49b9-a1c3-6ff83b6ba4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:02.334866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cd6ad-3e7d-49b9-a1c3-6ff83b6ba4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:02.335601 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cd6ad-3e7d-49b9-a1c3-6ff83b6ba4f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:02.337243 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cd6ad-3e7d-49b9-a1c3-6ff83b6ba4f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:02.337981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cd6ad-3e7d-49b9-a1c3-6ff83b6ba4f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:02.340886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cd6ad-3e7d-49b9-a1c3-6ff83b6ba4f1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:02.372034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 933/1843] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:43:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:43:02.376290 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673e9e4-7738-44bc-91bb-3e6a844d8090 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:02.390786 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673e9e4-7738-44bc-91bb-3e6a844d8090 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:02.416844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66136367-4262-4f8f-874e-b2e688eb108a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:02.417823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66136367-4262-4f8f-874e-b2e688eb108a admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:02.418261 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66136367-4262-4f8f-874e-b2e688eb108a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:02.418704 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66136367-4262-4f8f-874e-b2e688eb108a admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:02.419600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66136367-4262-4f8f-874e-b2e688eb108a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:02.421784 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66136367-4262-4f8f-874e-b2e688eb108a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:02.492948 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 911/1844] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:02 2022] POST /identity/v3/projects => generated 370 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:43:02.499018 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cd6ad-3e7d-49b9-a1c3-6ff83b6ba4f1 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:02.540670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cd6ad-3e7d-49b9-a1c3-6ff83b6ba4f1 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:02.548614 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc1e73-2d32-4b41-9f8a-17fab2aac3af None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:02.548938 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc1e73-2d32-4b41-9f8a-17fab2aac3af None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:02.549228 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc1e73-2d32-4b41-9f8a-17fab2aac3af None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:02.550661 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 912/1845] 10.222.0.110 () {54 vars in 926 bytes} [Thu May 26 16:43:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:43:02.639820 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1825e-b1c0-4713-837f-9b7e1eff1494 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:02.640300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1825e-b1c0-4713-837f-9b7e1eff1494 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:02.640735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1825e-b1c0-4713-837f-9b7e1eff1494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:02.700762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cdb1825e-b1c0-4713-837f-9b7e1eff1494 None None] MFA Rules not processed for user `0043a7d5877f41de905afe6bef355867`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:02.702657 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cdb1825e-b1c0-4713-837f-9b7e1eff1494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:02.807786 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74be87-331c-4543-abc8-2e6f504a7b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:02.808733 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74be87-331c-4543-abc8-2e6f504a7b1f admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:02.809295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74be87-331c-4543-abc8-2e6f504a7b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:02.809711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74be87-331c-4543-abc8-2e6f504a7b1f admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:02.810635 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74be87-331c-4543-abc8-2e6f504a7b1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:02.815367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74be87-331c-4543-abc8-2e6f504a7b1f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:02.858714 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 934/1846] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:02 2022] POST /identity/v3/users => generated 286 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:02.863491 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74be87-331c-4543-abc8-2e6f504a7b1f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:02.892399 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74be87-331c-4543-abc8-2e6f504a7b1f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:02.897941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2ffb9-7ab5-498a-aaaa-256cfb7ec9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:02.899978 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2ffb9-7ab5-498a-aaaa-256cfb7ec9fc admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:02.900777 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2ffb9-7ab5-498a-aaaa-256cfb7ec9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:02.901343 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2ffb9-7ab5-498a-aaaa-256cfb7ec9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:02.902214 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2ffb9-7ab5-498a-aaaa-256cfb7ec9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:02.904906 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2ffb9-7ab5-498a-aaaa-256cfb7ec9fc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:02.935673 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 935/1847] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:02 2022] GET /identity/v3/roles => generated 1427 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:02.936856 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2ffb9-7ab5-498a-aaaa-256cfb7ec9fc admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:02.940308 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 913/1848] 10.222.0.110 () {58 vars in 1023 bytes} [Thu May 26 16:43:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:02.951575 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2ffb9-7ab5-498a-aaaa-256cfb7ec9fc admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:02.958137 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdb19c-2aa1-4320-a0d9-95edb74cce4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:02.959321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdb19c-2aa1-4320-a0d9-95edb74cce4a admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:02.959751 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdb19c-2aa1-4320-a0d9-95edb74cce4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:02.960170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdb19c-2aa1-4320-a0d9-95edb74cce4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:02.961347 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdb19c-2aa1-4320-a0d9-95edb74cce4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:02.963197 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdb19c-2aa1-4320-a0d9-95edb74cce4a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:02.981171 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 936/1849] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:02 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:02.988182 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1825e-b1c0-4713-837f-9b7e1eff1494 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:03.003934 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1825e-b1c0-4713-837f-9b7e1eff1494 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:03.019496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0ee09-52ba-490f-a87e-6e48a6d46741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:03.020474 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0ee09-52ba-490f-a87e-6e48a6d46741 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:03.020765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0ee09-52ba-490f-a87e-6e48a6d46741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:03.021047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0ee09-52ba-490f-a87e-6e48a6d46741 admin admin] PATH_INFO: `/v3/projects/efabf8ada4774c238284d5f03e2f0710/users/9f1edce114d848c7bbad2dc5bd4c522f/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:03.068566 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0ee09-52ba-490f-a87e-6e48a6d46741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efabf8ada4774c238284d5f03e2f0710, user_id=9f1edce114d848c7bbad2dc5bd4c522f, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:03.071344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0ee09-52ba-490f-a87e-6e48a6d46741 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:03.076221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:03.108255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 914/1850] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:02 2022] PUT /identity/v3/projects/efabf8ada4774c238284d5f03e2f0710/users/9f1edce114d848c7bbad2dc5bd4c522f/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:03.120147 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eb4d2-c1e9-403a-98f7-fa19d61102c4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:03.120679 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eb4d2-c1e9-403a-98f7-fa19d61102c4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:03.120856 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eb4d2-c1e9-403a-98f7-fa19d61102c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:03.181820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-217eb4d2-c1e9-403a-98f7-fa19d61102c4 None None] MFA Rules not processed for user `9f1edce114d848c7bbad2dc5bd4c522f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:03.184868 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-217eb4d2-c1e9-403a-98f7-fa19d61102c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:03.391909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 937/1851] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:03.396495 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0ee09-52ba-490f-a87e-6e48a6d46741 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:03.545568 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217eb4d2-c1e9-403a-98f7-fa19d61102c4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:03.548479 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-217eb4d2-c1e9-403a-98f7-fa19d61102c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:03.554280 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0ee09-52ba-490f-a87e-6e48a6d46741 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:03.561163 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:03.567472 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc25c84-ea9c-421f-b6a4-fdc521a18af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:03.568250 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc25c84-ea9c-421f-b6a4-fdc521a18af9 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:03.568724 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc25c84-ea9c-421f-b6a4-fdc521a18af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:03.569152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc25c84-ea9c-421f-b6a4-fdc521a18af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:03.570016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc25c84-ea9c-421f-b6a4-fdc521a18af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:03.572019 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc25c84-ea9c-421f-b6a4-fdc521a18af9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:03.630526 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 915/1852] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:03 2022] POST /identity/v3/projects => generated 370 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:03.634901 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc25c84-ea9c-421f-b6a4-fdc521a18af9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:03.720236 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217eb4d2-c1e9-403a-98f7-fa19d61102c4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:03.857331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc25c84-ea9c-421f-b6a4-fdc521a18af9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:03.881999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc37c5-248e-4db4-a015-ca5cd8c700f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:03.884601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc37c5-248e-4db4-a015-ca5cd8c700f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:03.884601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc37c5-248e-4db4-a015-ca5cd8c700f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:03.884601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc37c5-248e-4db4-a015-ca5cd8c700f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:03.885212 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc37c5-248e-4db4-a015-ca5cd8c700f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:03.887251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc37c5-248e-4db4-a015-ca5cd8c700f6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:03.950250 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 916/1853] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:03 2022] POST /identity/v3/users => generated 292 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:43:03.952817 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc37c5-248e-4db4-a015-ca5cd8c700f6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:03.956550 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f7c6a-a91a-4e3e-95a3-170e21b8d61f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:03.957503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f7c6a-a91a-4e3e-95a3-170e21b8d61f service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:03.958094 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f7c6a-a91a-4e3e-95a3-170e21b8d61f service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:03.961041 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f7c6a-a91a-4e3e-95a3-170e21b8d61f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:03.978426 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f7c6a-a91a-4e3e-95a3-170e21b8d61f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:03.980995 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f7c6a-a91a-4e3e-95a3-170e21b8d61f service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:03.987931 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc37c5-248e-4db4-a015-ca5cd8c700f6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:03.998367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 938/1854] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:43:04.018386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66955389-5247-4142-b666-824064833d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:04.020209 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66955389-5247-4142-b666-824064833d79 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.020736 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66955389-5247-4142-b666-824064833d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.021103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66955389-5247-4142-b666-824064833d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.021884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66955389-5247-4142-b666-824064833d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:04.024152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66955389-5247-4142-b666-824064833d79 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:04.062936 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 917/1855] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:03 2022] GET /identity/v3/roles => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:04.068173 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f7c6a-a91a-4e3e-95a3-170e21b8d61f service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:04.099338 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f7c6a-a91a-4e3e-95a3-170e21b8d61f service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:04.128450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c505120-efd4-4903-8574-a7a015c67026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:04.129864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c505120-efd4-4903-8574-a7a015c67026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.132765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c505120-efd4-4903-8574-a7a015c67026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.133177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c505120-efd4-4903-8574-a7a015c67026 admin admin] PATH_INFO: `/v3/projects/0f63529fb0bb48129de48994f6d0dca1/users/95404fc6a3894f42b1d4ee369f2956a8/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.192506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c505120-efd4-4903-8574-a7a015c67026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f63529fb0bb48129de48994f6d0dca1, user_id=95404fc6a3894f42b1d4ee369f2956a8, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:04.203414 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c505120-efd4-4903-8574-a7a015c67026 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:04.249318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 939/1856] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:04 2022] PUT /identity/v3/projects/0f63529fb0bb48129de48994f6d0dca1/users/95404fc6a3894f42b1d4ee369f2956a8/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:04.253204 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66955389-5247-4142-b666-824064833d79 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:04.267521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66955389-5247-4142-b666-824064833d79 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:04.355983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:04.363926 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15496cab-be1e-4583-b95c-db4344f0f231 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.364219 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15496cab-be1e-4583-b95c-db4344f0f231 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.364530 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15496cab-be1e-4583-b95c-db4344f0f231 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.366646 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 940/1857] 10.222.0.110 () {54 vars in 926 bytes} [Thu May 26 16:43:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:43:04.386643 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a193727-c748-4166-8176-9d6576af4628 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.386862 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a193727-c748-4166-8176-9d6576af4628 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.387266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a193727-c748-4166-8176-9d6576af4628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.407902 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d078a1-8db3-4a33-a531-55cefc76aac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:04.414548 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d078a1-8db3-4a33-a531-55cefc76aac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.414788 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d078a1-8db3-4a33-a531-55cefc76aac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.415732 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d078a1-8db3-4a33-a531-55cefc76aac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.418862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d078a1-8db3-4a33-a531-55cefc76aac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:04.427948 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d078a1-8db3-4a33-a531-55cefc76aac3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:04.457026 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0a193727-c748-4166-8176-9d6576af4628 None None] MFA Rules not processed for user `0043a7d5877f41de905afe6bef355867`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:04.463392 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0a193727-c748-4166-8176-9d6576af4628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:04.480261 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 918/1858] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:04 2022] GET /identity/v3/roles => generated 1427 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:43:04.481581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d078a1-8db3-4a33-a531-55cefc76aac3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:04.513224 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d078a1-8db3-4a33-a531-55cefc76aac3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:04.540349 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9856c1b-5458-4dc0-aba7-802da1a5c518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:04.541714 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9856c1b-5458-4dc0-aba7-802da1a5c518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.542188 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9856c1b-5458-4dc0-aba7-802da1a5c518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.542712 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9856c1b-5458-4dc0-aba7-802da1a5c518 admin admin] PATH_INFO: `/v3/projects/0f63529fb0bb48129de48994f6d0dca1/users/95404fc6a3894f42b1d4ee369f2956a8/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.545686 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9856c1b-5458-4dc0-aba7-802da1a5c518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f63529fb0bb48129de48994f6d0dca1, user_id=95404fc6a3894f42b1d4ee369f2956a8, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:04.548807 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9856c1b-5458-4dc0-aba7-802da1a5c518 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:04.569154 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 919/1859] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:04 2022] PUT /identity/v3/projects/0f63529fb0bb48129de48994f6d0dca1/users/95404fc6a3894f42b1d4ee369f2956a8/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:04.586454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6be179-0511-41c4-a884-fe20b7c7c479 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.587031 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6be179-0511-41c4-a884-fe20b7c7c479 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.587486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6be179-0511-41c4-a884-fe20b7c7c479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.599472 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:04.640367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 941/1860] 10.222.0.110 () {58 vars in 1023 bytes} [Thu May 26 16:43:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:04.650138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4d6be179-0511-41c4-a884-fe20b7c7c479 None None] MFA Rules not processed for user `95404fc6a3894f42b1d4ee369f2956a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:04.652809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4d6be179-0511-41c4-a884-fe20b7c7c479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:04.658129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a193727-c748-4166-8176-9d6576af4628 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:04.672981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a193727-c748-4166-8176-9d6576af4628 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:04.792424 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c508007-98c1-4366-b38f-195c9610e34a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:04.793106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c508007-98c1-4366-b38f-195c9610e34a service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.793395 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c508007-98c1-4366-b38f-195c9610e34a service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.793676 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c508007-98c1-4366-b38f-195c9610e34a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.803549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 920/1861] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:04.804693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c508007-98c1-4366-b38f-195c9610e34a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:04.804816 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6be179-0511-41c4-a884-fe20b7c7c479 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:04.806276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4d6be179-0511-41c4-a884-fe20b7c7c479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:04.807612 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c508007-98c1-4366-b38f-195c9610e34a service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:04.824563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 942/1862] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:04.825587 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c508007-98c1-4366-b38f-195c9610e34a service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:04.828283 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4c508007-98c1-4366-b38f-195c9610e34a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:04.913910 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c508007-98c1-4366-b38f-195c9610e34a service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:04.918989 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae632455-c8ac-4b85-9ea0-8163c0095f68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:04.919658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae632455-c8ac-4b85-9ea0-8163c0095f68 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.919946 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae632455-c8ac-4b85-9ea0-8163c0095f68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.920225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae632455-c8ac-4b85-9ea0-8163c0095f68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.926938 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6be179-0511-41c4-a884-fe20b7c7c479 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:04.931025 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae632455-c8ac-4b85-9ea0-8163c0095f68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:04.933243 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae632455-c8ac-4b85-9ea0-8163c0095f68 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:04.935138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b3f86-5688-4ea8-888f-1e06b95f9802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:04.936629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b3f86-5688-4ea8-888f-1e06b95f9802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.937020 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b3f86-5688-4ea8-888f-1e06b95f9802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.937472 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b3f86-5688-4ea8-888f-1e06b95f9802 admin admin] PATH_INFO: `/v3/users/25855c3371424db9af38ac1cd60994dd` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.939640 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b3f86-5688-4ea8-888f-1e06b95f9802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25855c3371424db9af38ac1cd60994dd)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:04.943445 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b3f86-5688-4ea8-888f-1e06b95f9802 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:04.944636 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 943/1863] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:05.006656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-034b3f86-5688-4ea8-888f-1e06b95f9802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25855c3371424db9af38ac1cd60994dd'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:05.007918 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-034b3f86-5688-4ea8-888f-1e06b95f9802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25855c3371424db9af38ac1cd60994dd'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:05.017032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-034b3f86-5688-4ea8-888f-1e06b95f9802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25855c3371424db9af38ac1cd60994dd'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:05.017926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-034b3f86-5688-4ea8-888f-1e06b95f9802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25855c3371424db9af38ac1cd60994dd'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:05.029439 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-034b3f86-5688-4ea8-888f-1e06b95f9802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25855c3371424db9af38ac1cd60994dd'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:05.041839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:05.059190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 921/1864] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:04 2022] DELETE /identity/v3/users/25855c3371424db9af38ac1cd60994dd => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:05.064185 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2831c6-ce8d-4d88-97fb-455ab9fe93ce None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:05.064634 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2831c6-ce8d-4d88-97fb-455ab9fe93ce None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:05.064945 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2831c6-ce8d-4d88-97fb-455ab9fe93ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:05.086385 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ea2831c6-ce8d-4d88-97fb-455ab9fe93ce None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:05.088532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ea2831c6-ce8d-4d88-97fb-455ab9fe93ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:05.191305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 944/1865] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:05.241120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b3f86-5688-4ea8-888f-1e06b95f9802 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:05.243459 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-034b3f86-5688-4ea8-888f-1e06b95f9802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:05.391736 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b3f86-5688-4ea8-888f-1e06b95f9802 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:05.401831 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f20ec-90aa-45a5-9a5d-3d14dc85dba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:05.403101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f20ec-90aa-45a5-9a5d-3d14dc85dba5 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:05.403598 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f20ec-90aa-45a5-9a5d-3d14dc85dba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:05.404048 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f20ec-90aa-45a5-9a5d-3d14dc85dba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:05.492789 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f20ec-90aa-45a5-9a5d-3d14dc85dba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:05.500058 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f20ec-90aa-45a5-9a5d-3d14dc85dba5 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:05.535166 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 922/1866] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:07.254444 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2831c6-ce8d-4d88-97fb-455ab9fe93ce None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:07.256040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ea2831c6-ce8d-4d88-97fb-455ab9fe93ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:07.283876 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2831c6-ce8d-4d88-97fb-455ab9fe93ce None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:07.295258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212c251-a216-44f6-abde-4874f2345558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:07.296157 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212c251-a216-44f6-abde-4874f2345558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:07.296441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212c251-a216-44f6-abde-4874f2345558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:07.298823 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212c251-a216-44f6-abde-4874f2345558 admin admin] PATH_INFO: `/v3/projects/af68872a3cae4662a6218f7c0720cf78` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:07.301643 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212c251-a216-44f6-abde-4874f2345558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af68872a3cae4662a6218f7c0720cf78)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:07.307001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212c251-a216-44f6-abde-4874f2345558 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:07.348934 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:07.360178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f20ec-90aa-45a5-9a5d-3d14dc85dba5 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:07.362177 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a68f20ec-90aa-45a5-9a5d-3d14dc85dba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:07.386789 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f20ec-90aa-45a5-9a5d-3d14dc85dba5 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:07.398671 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0212c251-a216-44f6-abde-4874f2345558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af68872a3cae4662a6218f7c0720cf78', 'request_id': 'req-0212c251-a216-44f6-abde-4874f2345558'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.407804 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0212c251-a216-44f6-abde-4874f2345558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af68872a3cae4662a6218f7c0720cf78', 'request_id': 'req-0212c251-a216-44f6-abde-4874f2345558'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.417141 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0212c251-a216-44f6-abde-4874f2345558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af68872a3cae4662a6218f7c0720cf78', 'request_id': 'req-0212c251-a216-44f6-abde-4874f2345558'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.444915 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0212c251-a216-44f6-abde-4874f2345558 admin admin] The token cache is being invalidate because project af68872a3cae4662a6218f7c0720cf78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:07.445396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0212c251-a216-44f6-abde-4874f2345558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.446255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0212c251-a216-44f6-abde-4874f2345558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.448787 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 945/1867] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:07 2022] DELETE /identity/v3/projects/af68872a3cae4662a6218f7c0720cf78 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:07.453243 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212c251-a216-44f6-abde-4874f2345558 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:07.455289 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0212c251-a216-44f6-abde-4874f2345558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:07.488807 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddd9d2-1670-478a-93bc-dba049b7aac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:07.489582 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddd9d2-1670-478a-93bc-dba049b7aac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:07.490062 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddd9d2-1670-478a-93bc-dba049b7aac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:07.490508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddd9d2-1670-478a-93bc-dba049b7aac2 admin admin] PATH_INFO: `/v3/users/9f1edce114d848c7bbad2dc5bd4c522f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:07.491790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddd9d2-1670-478a-93bc-dba049b7aac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f1edce114d848c7bbad2dc5bd4c522f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:07.494069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddd9d2-1670-478a-93bc-dba049b7aac2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:07.591703 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b5ddd9d2-1670-478a-93bc-dba049b7aac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f1edce114d848c7bbad2dc5bd4c522f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.592414 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b5ddd9d2-1670-478a-93bc-dba049b7aac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f1edce114d848c7bbad2dc5bd4c522f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.595756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212c251-a216-44f6-abde-4874f2345558 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:07.606875 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d613608-29f5-4cbc-b7fc-edfb7668cb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:07.608577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d613608-29f5-4cbc-b7fc-edfb7668cb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:07.609306 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d613608-29f5-4cbc-b7fc-edfb7668cb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:07.609908 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d613608-29f5-4cbc-b7fc-edfb7668cb29 admin admin] PATH_INFO: `/v3/users/277c129482674733a86f829875f12b67` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:07.612169 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d613608-29f5-4cbc-b7fc-edfb7668cb29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=277c129482674733a86f829875f12b67)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:07.612346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b5ddd9d2-1670-478a-93bc-dba049b7aac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f1edce114d848c7bbad2dc5bd4c522f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.613575 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b5ddd9d2-1670-478a-93bc-dba049b7aac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f1edce114d848c7bbad2dc5bd4c522f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.615392 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d613608-29f5-4cbc-b7fc-edfb7668cb29 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:07.640010 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b5ddd9d2-1670-478a-93bc-dba049b7aac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f1edce114d848c7bbad2dc5bd4c522f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.671632 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 923/1868] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:07 2022] DELETE /identity/v3/users/9f1edce114d848c7bbad2dc5bd4c522f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:07.679246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6610c-527f-4401-a7a8-95db63771daa None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:07.680384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6610c-527f-4401-a7a8-95db63771daa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:07.681334 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6610c-527f-4401-a7a8-95db63771daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:07.700868 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:07.708519 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-61e6610c-527f-4401-a7a8-95db63771daa None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:07.710974 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-61e6610c-527f-4401-a7a8-95db63771daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:07.842825 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2d613608-29f5-4cbc-b7fc-edfb7668cb29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '277c129482674733a86f829875f12b67'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.876513 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2d613608-29f5-4cbc-b7fc-edfb7668cb29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '277c129482674733a86f829875f12b67'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.877301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2d613608-29f5-4cbc-b7fc-edfb7668cb29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '277c129482674733a86f829875f12b67'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.904859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2d613608-29f5-4cbc-b7fc-edfb7668cb29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '277c129482674733a86f829875f12b67'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.906022 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2d613608-29f5-4cbc-b7fc-edfb7668cb29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '277c129482674733a86f829875f12b67'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.948801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 924/1869] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:07.964132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 946/1870] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:07 2022] DELETE /identity/v3/users/277c129482674733a86f829875f12b67 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:07.965293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6610c-527f-4401-a7a8-95db63771daa None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:07.967392 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-61e6610c-527f-4401-a7a8-95db63771daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:08.097963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6610c-527f-4401-a7a8-95db63771daa None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:08.262195 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c296a-bfd5-4466-a2af-6cfa859612cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:08.262950 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c296a-bfd5-4466-a2af-6cfa859612cf service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:08.263246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c296a-bfd5-4466-a2af-6cfa859612cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:08.263534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c296a-bfd5-4466-a2af-6cfa859612cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:08.446351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c296a-bfd5-4466-a2af-6cfa859612cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:08.449175 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c296a-bfd5-4466-a2af-6cfa859612cf service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:08.462473 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 925/1871] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:08.771026 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d613608-29f5-4cbc-b7fc-edfb7668cb29 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:08.773338 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2d613608-29f5-4cbc-b7fc-edfb7668cb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:08.797897 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d613608-29f5-4cbc-b7fc-edfb7668cb29 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:08.808988 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f46217-8167-4edc-b360-d7024dffb6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:08.810557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f46217-8167-4edc-b360-d7024dffb6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:08.811101 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f46217-8167-4edc-b360-d7024dffb6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:08.811605 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f46217-8167-4edc-b360-d7024dffb6c6 admin admin] PATH_INFO: `/v3/projects/cb000246d17e415f88ce5a7305d34859` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:08.813333 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f46217-8167-4edc-b360-d7024dffb6c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb000246d17e415f88ce5a7305d34859)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:08.816520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f46217-8167-4edc-b360-d7024dffb6c6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:08.876023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:08.921767 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a0f46217-8167-4edc-b360-d7024dffb6c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb000246d17e415f88ce5a7305d34859', 'request_id': 'req-a0f46217-8167-4edc-b360-d7024dffb6c6'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.929537 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a0f46217-8167-4edc-b360-d7024dffb6c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb000246d17e415f88ce5a7305d34859', 'request_id': 'req-a0f46217-8167-4edc-b360-d7024dffb6c6'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.942123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a0f46217-8167-4edc-b360-d7024dffb6c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb000246d17e415f88ce5a7305d34859', 'request_id': 'req-a0f46217-8167-4edc-b360-d7024dffb6c6'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.976398 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a0f46217-8167-4edc-b360-d7024dffb6c6 admin admin] The token cache is being invalidate because project cb000246d17e415f88ce5a7305d34859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:08.977221 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a0f46217-8167-4edc-b360-d7024dffb6c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.979495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a0f46217-8167-4edc-b360-d7024dffb6c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.985443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 947/1872] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:08 2022] DELETE /identity/v3/projects/cb000246d17e415f88ce5a7305d34859 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:08.990479 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c296a-bfd5-4466-a2af-6cfa859612cf service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:09.008908 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c296a-bfd5-4466-a2af-6cfa859612cf service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:09.022310 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f46217-8167-4edc-b360-d7024dffb6c6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:09.023910 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a0f46217-8167-4edc-b360-d7024dffb6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:09.037042 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:09.189948 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f46217-8167-4edc-b360-d7024dffb6c6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:09.197956 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c209e79-7f41-4b0a-97e2-e074442a48aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:09.200173 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c209e79-7f41-4b0a-97e2-e074442a48aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.200644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c209e79-7f41-4b0a-97e2-e074442a48aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.201118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c209e79-7f41-4b0a-97e2-e074442a48aa admin admin] PATH_INFO: `/v3/projects/efabf8ada4774c238284d5f03e2f0710` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.206475 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c209e79-7f41-4b0a-97e2-e074442a48aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=efabf8ada4774c238284d5f03e2f0710)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:09.209602 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c209e79-7f41-4b0a-97e2-e074442a48aa admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.239123 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22705af8-7070-4cb5-8ebb-c4c87b3dbde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:09.240230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22705af8-7070-4cb5-8ebb-c4c87b3dbde1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.240613 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22705af8-7070-4cb5-8ebb-c4c87b3dbde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.241118 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22705af8-7070-4cb5-8ebb-c4c87b3dbde1 admin admin] PATH_INFO: `/v3/users/1ba21f251af34120a2c1a14e5aecc122` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.250293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22705af8-7070-4cb5-8ebb-c4c87b3dbde1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ba21f251af34120a2c1a14e5aecc122)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:09.259700 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22705af8-7070-4cb5-8ebb-c4c87b3dbde1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.313637 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2c209e79-7f41-4b0a-97e2-e074442a48aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efabf8ada4774c238284d5f03e2f0710', 'request_id': 'req-2c209e79-7f41-4b0a-97e2-e074442a48aa'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:09.326535 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2c209e79-7f41-4b0a-97e2-e074442a48aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efabf8ada4774c238284d5f03e2f0710', 'request_id': 'req-2c209e79-7f41-4b0a-97e2-e074442a48aa'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:09.333875 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2c209e79-7f41-4b0a-97e2-e074442a48aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efabf8ada4774c238284d5f03e2f0710', 'request_id': 'req-2c209e79-7f41-4b0a-97e2-e074442a48aa'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:09.345450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-22705af8-7070-4cb5-8ebb-c4c87b3dbde1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ba21f251af34120a2c1a14e5aecc122'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:09.346532 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-22705af8-7070-4cb5-8ebb-c4c87b3dbde1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ba21f251af34120a2c1a14e5aecc122'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:09.358786 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2c209e79-7f41-4b0a-97e2-e074442a48aa admin admin] The token cache is being invalidate because project efabf8ada4774c238284d5f03e2f0710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:09.358786 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2c209e79-7f41-4b0a-97e2-e074442a48aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:09.361247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2c209e79-7f41-4b0a-97e2-e074442a48aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:09.363690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-22705af8-7070-4cb5-8ebb-c4c87b3dbde1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ba21f251af34120a2c1a14e5aecc122'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:09.365390 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 948/1873] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:09 2022] DELETE /identity/v3/projects/efabf8ada4774c238284d5f03e2f0710 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:09.366555 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-22705af8-7070-4cb5-8ebb-c4c87b3dbde1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ba21f251af34120a2c1a14e5aecc122'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:09.372379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c209e79-7f41-4b0a-97e2-e074442a48aa admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:09.374312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2c209e79-7f41-4b0a-97e2-e074442a48aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:09.382316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-22705af8-7070-4cb5-8ebb-c4c87b3dbde1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ba21f251af34120a2c1a14e5aecc122'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:09.438425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 926/1874] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:08 2022] DELETE /identity/v3/users/1ba21f251af34120a2c1a14e5aecc122 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:09.506288 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:09.592150 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c209e79-7f41-4b0a-97e2-e074442a48aa admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:09.866786 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080cfd4-90bc-4654-bd3e-be6c88bdba1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:09.867782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080cfd4-90bc-4654-bd3e-be6c88bdba1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.867975 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080cfd4-90bc-4654-bd3e-be6c88bdba1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.868256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080cfd4-90bc-4654-bd3e-be6c88bdba1b admin admin] PATH_INFO: `/v3/users/95404fc6a3894f42b1d4ee369f2956a8` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.873083 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080cfd4-90bc-4654-bd3e-be6c88bdba1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=95404fc6a3894f42b1d4ee369f2956a8)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:09.878514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080cfd4-90bc-4654-bd3e-be6c88bdba1b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.950552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0080cfd4-90bc-4654-bd3e-be6c88bdba1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95404fc6a3894f42b1d4ee369f2956a8'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:10.024278 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0080cfd4-90bc-4654-bd3e-be6c88bdba1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95404fc6a3894f42b1d4ee369f2956a8'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:10.026389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0080cfd4-90bc-4654-bd3e-be6c88bdba1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95404fc6a3894f42b1d4ee369f2956a8'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:10.058162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0080cfd4-90bc-4654-bd3e-be6c88bdba1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95404fc6a3894f42b1d4ee369f2956a8'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:10.060385 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0080cfd4-90bc-4654-bd3e-be6c88bdba1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95404fc6a3894f42b1d4ee369f2956a8'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:10.108038 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 949/1875] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:09 2022] DELETE /identity/v3/users/95404fc6a3894f42b1d4ee369f2956a8 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:10.230763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22705af8-7070-4cb5-8ebb-c4c87b3dbde1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:10.235626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-22705af8-7070-4cb5-8ebb-c4c87b3dbde1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:10.273906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22705af8-7070-4cb5-8ebb-c4c87b3dbde1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:10.431921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15e66d-1f82-4902-a7a3-d469ff365df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:10.433174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15e66d-1f82-4902-a7a3-d469ff365df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.433699 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15e66d-1f82-4902-a7a3-d469ff365df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.434178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15e66d-1f82-4902-a7a3-d469ff365df6 admin admin] PATH_INFO: `/v3/users/9a5a533758ef495ba12ffd954fd47dc3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.436213 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15e66d-1f82-4902-a7a3-d469ff365df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a5a533758ef495ba12ffd954fd47dc3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:10.438665 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15e66d-1f82-4902-a7a3-d469ff365df6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:10.505050 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:10.525790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ff15e66d-1f82-4902-a7a3-d469ff365df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a5a533758ef495ba12ffd954fd47dc3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:10.529999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ff15e66d-1f82-4902-a7a3-d469ff365df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a5a533758ef495ba12ffd954fd47dc3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:10.547172 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ff15e66d-1f82-4902-a7a3-d469ff365df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a5a533758ef495ba12ffd954fd47dc3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:10.548089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ff15e66d-1f82-4902-a7a3-d469ff365df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a5a533758ef495ba12ffd954fd47dc3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:10.565971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080cfd4-90bc-4654-bd3e-be6c88bdba1b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:10.567946 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ff15e66d-1f82-4902-a7a3-d469ff365df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a5a533758ef495ba12ffd954fd47dc3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:10.568462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0080cfd4-90bc-4654-bd3e-be6c88bdba1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:10.597154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080cfd4-90bc-4654-bd3e-be6c88bdba1b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:10.610993 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e5a8d-4576-4402-846d-e792bb442d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:10.610993 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e5a8d-4576-4402-846d-e792bb442d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.610993 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e5a8d-4576-4402-846d-e792bb442d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.610993 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e5a8d-4576-4402-846d-e792bb442d36 admin admin] PATH_INFO: `/v3/projects/3ac575c9cc314ba98d2f081bc609f7d8` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.611899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e5a8d-4576-4402-846d-e792bb442d36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ac575c9cc314ba98d2f081bc609f7d8)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:10.614201 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e5a8d-4576-4402-846d-e792bb442d36 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:10.649043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 927/1876] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:10 2022] DELETE /identity/v3/users/9a5a533758ef495ba12ffd954fd47dc3 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:10.652118 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39f77f-b682-41f4-9d76-00bde900cd78 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.652694 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39f77f-b682-41f4-9d76-00bde900cd78 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.653247 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39f77f-b682-41f4-9d76-00bde900cd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.698952 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dc39f77f-b682-41f4-9d76-00bde900cd78 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:10.703572 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dc39f77f-b682-41f4-9d76-00bde900cd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:10.707694 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-382e5a8d-4576-4402-846d-e792bb442d36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ac575c9cc314ba98d2f081bc609f7d8', 'request_id': 'req-382e5a8d-4576-4402-846d-e792bb442d36'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:10.725440 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-382e5a8d-4576-4402-846d-e792bb442d36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ac575c9cc314ba98d2f081bc609f7d8', 'request_id': 'req-382e5a8d-4576-4402-846d-e792bb442d36'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:10.743524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:10.746725 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-382e5a8d-4576-4402-846d-e792bb442d36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ac575c9cc314ba98d2f081bc609f7d8', 'request_id': 'req-382e5a8d-4576-4402-846d-e792bb442d36'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:10.833456 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-382e5a8d-4576-4402-846d-e792bb442d36 admin admin] The token cache is being invalidate because project 3ac575c9cc314ba98d2f081bc609f7d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:10.833763 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-382e5a8d-4576-4402-846d-e792bb442d36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:10.836804 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-382e5a8d-4576-4402-846d-e792bb442d36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:10.840869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 950/1877] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:10 2022] DELETE /identity/v3/projects/3ac575c9cc314ba98d2f081bc609f7d8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:10.847088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 928/1878] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:10.849921 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b5138-6fb9-43ca-a6a9-aa13d92e764f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.850431 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b5138-6fb9-43ca-a6a9-aa13d92e764f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.851601 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b5138-6fb9-43ca-a6a9-aa13d92e764f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.858886 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39f77f-b682-41f4-9d76-00bde900cd78 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:10.860790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dc39f77f-b682-41f4-9d76-00bde900cd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:10.961785 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a90b5138-6fb9-43ca-a6a9-aa13d92e764f None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:10.967590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a90b5138-6fb9-43ca-a6a9-aa13d92e764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:11.002375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 951/1879] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:11.004291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c2d57-c5f7-4004-b0ae-68e173d6fa47 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.004805 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c2d57-c5f7-4004-b0ae-68e173d6fa47 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.005156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c2d57-c5f7-4004-b0ae-68e173d6fa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.032241 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39f77f-b682-41f4-9d76-00bde900cd78 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:11.037551 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32c728-b7a7-4138-ba13-bcd52d8b7571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:11.038339 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32c728-b7a7-4138-ba13-bcd52d8b7571 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.038675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32c728-b7a7-4138-ba13-bcd52d8b7571 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.038949 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32c728-b7a7-4138-ba13-bcd52d8b7571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.049693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32c728-b7a7-4138-ba13-bcd52d8b7571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:11.050291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2e9c2d57-c5f7-4004-b0ae-68e173d6fa47 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:11.051299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32c728-b7a7-4138-ba13-bcd52d8b7571 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:11.052974 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2e9c2d57-c5f7-4004-b0ae-68e173d6fa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:11.063221 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 952/1880] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:11.070370 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c2d57-c5f7-4004-b0ae-68e173d6fa47 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.075075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 929/1881] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:43:11.084829 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c2d57-c5f7-4004-b0ae-68e173d6fa47 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:11.113853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021a9b2-ff2b-4073-bebb-53bca7121218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:11.114701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021a9b2-ff2b-4073-bebb-53bca7121218 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.115065 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021a9b2-ff2b-4073-bebb-53bca7121218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.115423 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021a9b2-ff2b-4073-bebb-53bca7121218 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.117129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021a9b2-ff2b-4073-bebb-53bca7121218 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:11.117525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021a9b2-ff2b-4073-bebb-53bca7121218 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:11.121212 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021a9b2-ff2b-4073-bebb-53bca7121218 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:11.152776 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 953/1882] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:43:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:11.153252 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32c728-b7a7-4138-ba13-bcd52d8b7571 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.168110 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32c728-b7a7-4138-ba13-bcd52d8b7571 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:11.174026 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b857cad-a6c4-4769-88b3-442afbec3f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:11.174906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b857cad-a6c4-4769-88b3-442afbec3f6e admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.175222 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b857cad-a6c4-4769-88b3-442afbec3f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.175522 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b857cad-a6c4-4769-88b3-442afbec3f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.176183 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b857cad-a6c4-4769-88b3-442afbec3f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:11.178138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b857cad-a6c4-4769-88b3-442afbec3f6e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:11.217015 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021a9b2-ff2b-4073-bebb-53bca7121218 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.224127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e021a9b2-ff2b-4073-bebb-53bca7121218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:11.247433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021a9b2-ff2b-4073-bebb-53bca7121218 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:11.257388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d272d-d61d-4ac9-a384-c05452d7ed9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:11.258688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d272d-d61d-4ac9-a384-c05452d7ed9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.260818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d272d-d61d-4ac9-a384-c05452d7ed9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.262110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d272d-d61d-4ac9-a384-c05452d7ed9a admin admin] PATH_INFO: `/v3/projects/0f63529fb0bb48129de48994f6d0dca1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.270878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d272d-d61d-4ac9-a384-c05452d7ed9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f63529fb0bb48129de48994f6d0dca1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:11.272049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 930/1883] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:11 2022] POST /identity/v3/projects => generated 378 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:11.277727 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b857cad-a6c4-4769-88b3-442afbec3f6e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.287960 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d272d-d61d-4ac9-a384-c05452d7ed9a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:11.349747 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:11.419851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b857cad-a6c4-4769-88b3-442afbec3f6e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:11.479013 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-935d272d-d61d-4ac9-a384-c05452d7ed9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f63529fb0bb48129de48994f6d0dca1', 'request_id': 'req-935d272d-d61d-4ac9-a384-c05452d7ed9a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:11.498690 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-935d272d-d61d-4ac9-a384-c05452d7ed9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f63529fb0bb48129de48994f6d0dca1', 'request_id': 'req-935d272d-d61d-4ac9-a384-c05452d7ed9a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:11.518462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-935d272d-d61d-4ac9-a384-c05452d7ed9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f63529fb0bb48129de48994f6d0dca1', 'request_id': 'req-935d272d-d61d-4ac9-a384-c05452d7ed9a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:11.542357 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-935d272d-d61d-4ac9-a384-c05452d7ed9a admin admin] The token cache is being invalidate because project 0f63529fb0bb48129de48994f6d0dca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:11.544844 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-935d272d-d61d-4ac9-a384-c05452d7ed9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:11.545779 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-935d272d-d61d-4ac9-a384-c05452d7ed9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:11.550004 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 954/1884] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:11 2022] DELETE /identity/v3/projects/0f63529fb0bb48129de48994f6d0dca1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:11.554054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464525b4-97f0-405a-81ce-8e99416054d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:11.555473 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464525b4-97f0-405a-81ce-8e99416054d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.555957 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b560fa-0b08-4b67-ad78-2fbe3b77d09f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.556377 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464525b4-97f0-405a-81ce-8e99416054d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.556785 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b560fa-0b08-4b67-ad78-2fbe3b77d09f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.556891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464525b4-97f0-405a-81ce-8e99416054d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.557354 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b560fa-0b08-4b67-ad78-2fbe3b77d09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.563789 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464525b4-97f0-405a-81ce-8e99416054d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:11.569123 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464525b4-97f0-405a-81ce-8e99416054d6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:11.581714 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d1b560fa-0b08-4b67-ad78-2fbe3b77d09f None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:11.583440 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d1b560fa-0b08-4b67-ad78-2fbe3b77d09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:11.594591 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 955/1885] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:11.602345 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff5451-4fe8-48ce-b790-35071ccf92b4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.603015 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff5451-4fe8-48ce-b790-35071ccf92b4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.603607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff5451-4fe8-48ce-b790-35071ccf92b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.627133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f0ff5451-4fe8-48ce-b790-35071ccf92b4 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:11.628790 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f0ff5451-4fe8-48ce-b790-35071ccf92b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:11.633736 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 931/1886] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:11 2022] POST /identity/v3/users => generated 290 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:11.636131 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464525b4-97f0-405a-81ce-8e99416054d6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.647079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-464525b4-97f0-405a-81ce-8e99416054d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:11.657963 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 956/1887] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:11.664163 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff5451-4fe8-48ce-b790-35071ccf92b4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.676998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff5451-4fe8-48ce-b790-35071ccf92b4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:11.684421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efce817-22a1-4003-8a3c-d61867ed5d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:11.684929 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464525b4-97f0-405a-81ce-8e99416054d6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:11.685366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efce817-22a1-4003-8a3c-d61867ed5d23 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.685748 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efce817-22a1-4003-8a3c-d61867ed5d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.686124 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efce817-22a1-4003-8a3c-d61867ed5d23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.687458 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efce817-22a1-4003-8a3c-d61867ed5d23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:11.687628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efce817-22a1-4003-8a3c-d61867ed5d23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:11.690499 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efce817-22a1-4003-8a3c-d61867ed5d23 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:11.700391 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d22f8-65a5-47f1-a072-545118960241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:11.701093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d22f8-65a5-47f1-a072-545118960241 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.701384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d22f8-65a5-47f1-a072-545118960241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.701664 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d22f8-65a5-47f1-a072-545118960241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.702410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d22f8-65a5-47f1-a072-545118960241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:11.704082 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d22f8-65a5-47f1-a072-545118960241 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:11.721931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 957/1888] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:43:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:11.727152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efce817-22a1-4003-8a3c-d61867ed5d23 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.730647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 932/1889] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:11 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:11.734495 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d22f8-65a5-47f1-a072-545118960241 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.747281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d22f8-65a5-47f1-a072-545118960241 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:11.755086 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767c475-135b-496e-b34f-085009995c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:11.755855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767c475-135b-496e-b34f-085009995c8b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.756143 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767c475-135b-496e-b34f-085009995c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.756433 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767c475-135b-496e-b34f-085009995c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.757193 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767c475-135b-496e-b34f-085009995c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:11.757379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efce817-22a1-4003-8a3c-d61867ed5d23 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:11.758939 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767c475-135b-496e-b34f-085009995c8b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:11.770374 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af426d-8e52-4667-9c70-17a94d939439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:11.773186 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af426d-8e52-4667-9c70-17a94d939439 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.773788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af426d-8e52-4667-9c70-17a94d939439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.774348 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af426d-8e52-4667-9c70-17a94d939439 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.776271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af426d-8e52-4667-9c70-17a94d939439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:11.778508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 933/1890] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:11 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:11.784778 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af426d-8e52-4667-9c70-17a94d939439 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:11.787177 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767c475-135b-496e-b34f-085009995c8b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.812080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767c475-135b-496e-b34f-085009995c8b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:11.827672 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13199569-a501-4a8d-957f-5258b3115071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:11.829960 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13199569-a501-4a8d-957f-5258b3115071 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.831037 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13199569-a501-4a8d-957f-5258b3115071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.832971 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13199569-a501-4a8d-957f-5258b3115071 admin admin] PATH_INFO: `/v3/projects/dd67c8128e8f4b08b818a1163073a179/users/f56d05aa8a2340b1b47f42222eac6924/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.839490 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 958/1891] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:11 2022] POST /identity/v3/projects => generated 378 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:43:11.844843 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af426d-8e52-4667-9c70-17a94d939439 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.871397 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13199569-a501-4a8d-957f-5258b3115071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd67c8128e8f4b08b818a1163073a179, user_id=f56d05aa8a2340b1b47f42222eac6924, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:11.878436 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13199569-a501-4a8d-957f-5258b3115071 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:11.927495 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 934/1892] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:11 2022] PUT /identity/v3/projects/dd67c8128e8f4b08b818a1163073a179/users/f56d05aa8a2340b1b47f42222eac6924/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:11.930369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae509cc3-8282-4463-be71-7b2be4db7fca None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.931835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae509cc3-8282-4463-be71-7b2be4db7fca None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.932160 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae509cc3-8282-4463-be71-7b2be4db7fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:12.012478 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ae509cc3-8282-4463-be71-7b2be4db7fca None None] MFA Rules not processed for user `f56d05aa8a2340b1b47f42222eac6924`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:12.014924 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:12.020833 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ae509cc3-8282-4463-be71-7b2be4db7fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:12.032144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af426d-8e52-4667-9c70-17a94d939439 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:12.220676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 935/1893] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:12.224740 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ff4fa-d6bc-4512-b2a1-dfd3c39ba658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:12.226430 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff4fa-d6bc-4512-b2a1-dfd3c39ba658 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:12.226940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff4fa-d6bc-4512-b2a1-dfd3c39ba658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:12.228497 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff4fa-d6bc-4512-b2a1-dfd3c39ba658 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:12.229450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ff4fa-d6bc-4512-b2a1-dfd3c39ba658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:12.231659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ff4fa-d6bc-4512-b2a1-dfd3c39ba658 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:12.260682 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 959/1894] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:11 2022] POST /identity/v3/users => generated 290 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:43:12.262594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae509cc3-8282-4463-be71-7b2be4db7fca None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:12.279734 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae509cc3-8282-4463-be71-7b2be4db7fca None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:12.293903 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840376d3-6224-4bc5-aefe-9898356e5aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:12.295366 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840376d3-6224-4bc5-aefe-9898356e5aaa admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:12.295887 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840376d3-6224-4bc5-aefe-9898356e5aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:12.296408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840376d3-6224-4bc5-aefe-9898356e5aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:12.298882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840376d3-6224-4bc5-aefe-9898356e5aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:12.302836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840376d3-6224-4bc5-aefe-9898356e5aaa admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:12.327502 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 936/1895] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:12 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:12.331094 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ff4fa-d6bc-4512-b2a1-dfd3c39ba658 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:12.348155 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ff4fa-d6bc-4512-b2a1-dfd3c39ba658 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:12.355110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bb7fe-616b-4b70-8e8c-3f47f2714eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:12.360224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bb7fe-616b-4b70-8e8c-3f47f2714eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:12.361430 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bb7fe-616b-4b70-8e8c-3f47f2714eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:12.364553 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bb7fe-616b-4b70-8e8c-3f47f2714eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:12.369221 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bb7fe-616b-4b70-8e8c-3f47f2714eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:12.381536 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bb7fe-616b-4b70-8e8c-3f47f2714eb7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:12.405940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 960/1896] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:12 2022] GET /identity/v3/roles => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:43:12.410380 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840376d3-6224-4bc5-aefe-9898356e5aaa admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:12.418463 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:12.442931 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840376d3-6224-4bc5-aefe-9898356e5aaa admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:12.442931 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7aed9c-8e4f-4d8f-925b-45d150065561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:12.442931 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7aed9c-8e4f-4d8f-925b-45d150065561 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:12.442931 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7aed9c-8e4f-4d8f-925b-45d150065561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:12.443589 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7aed9c-8e4f-4d8f-925b-45d150065561 admin admin] PATH_INFO: `/v3/projects/eacdd7efdd664315adfb8b1f5938a00a/users/11704ac24eae41beb892d49ccbd36d8f/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:12.450251 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bb7fe-616b-4b70-8e8c-3f47f2714eb7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:12.451023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-934bb7fe-616b-4b70-8e8c-3f47f2714eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:12.472788 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7aed9c-8e4f-4d8f-925b-45d150065561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eacdd7efdd664315adfb8b1f5938a00a, user_id=11704ac24eae41beb892d49ccbd36d8f, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:12.475527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7aed9c-8e4f-4d8f-925b-45d150065561 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:12.505251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 937/1897] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:12 2022] PUT /identity/v3/projects/eacdd7efdd664315adfb8b1f5938a00a/users/11704ac24eae41beb892d49ccbd36d8f/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:12.517899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76eaf5-78c6-4f64-8776-89748c60019e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:12.518277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76eaf5-78c6-4f64-8776-89748c60019e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:12.518710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76eaf5-78c6-4f64-8776-89748c60019e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:12.574033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6b76eaf5-78c6-4f64-8776-89748c60019e None None] MFA Rules not processed for user `11704ac24eae41beb892d49ccbd36d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:12.578725 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6b76eaf5-78c6-4f64-8776-89748c60019e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:12.609105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bb7fe-616b-4b70-8e8c-3f47f2714eb7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:12.763085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94aebae-01ca-44da-8192-d91b8a5862f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:12.763085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94aebae-01ca-44da-8192-d91b8a5862f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:12.763506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94aebae-01ca-44da-8192-d91b8a5862f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:12.763842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94aebae-01ca-44da-8192-d91b8a5862f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:12.832462 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 938/1898] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:12.833784 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76eaf5-78c6-4f64-8776-89748c60019e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:12.839947 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6b76eaf5-78c6-4f64-8776-89748c60019e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:12.946186 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:12.955556 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94aebae-01ca-44da-8192-d91b8a5862f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:12.959614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94aebae-01ca-44da-8192-d91b8a5862f2 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:13.000506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 961/1899] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:43:13.000506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94aebae-01ca-44da-8192-d91b8a5862f2 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:13.001574 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76eaf5-78c6-4f64-8776-89748c60019e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:13.011906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85723ae5-8fd8-4bc1-84a5-8719af85c7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:13.013728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85723ae5-8fd8-4bc1-84a5-8719af85c7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:13.014015 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85723ae5-8fd8-4bc1-84a5-8719af85c7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:13.017391 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85723ae5-8fd8-4bc1-84a5-8719af85c7ce admin admin] PATH_INFO: `/v3/projects/d0c3f3de81ad4423bfd1ba3ef3b2ae48` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:13.021285 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85723ae5-8fd8-4bc1-84a5-8719af85c7ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c3f3de81ad4423bfd1ba3ef3b2ae48)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:13.023887 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94aebae-01ca-44da-8192-d91b8a5862f2 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:13.027633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85723ae5-8fd8-4bc1-84a5-8719af85c7ce admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:13.045543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10b692-d43f-4bb9-9963-3a2aec001bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:13.047232 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10b692-d43f-4bb9-9963-3a2aec001bdd admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:13.047998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10b692-d43f-4bb9-9963-3a2aec001bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:13.048741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10b692-d43f-4bb9-9963-3a2aec001bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:13.050228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10b692-d43f-4bb9-9963-3a2aec001bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:13.058995 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10b692-d43f-4bb9-9963-3a2aec001bdd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:13.141186 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-85723ae5-8fd8-4bc1-84a5-8719af85c7ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c3f3de81ad4423bfd1ba3ef3b2ae48', 'request_id': 'req-85723ae5-8fd8-4bc1-84a5-8719af85c7ce'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:13.154041 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 962/1900] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:12 2022] POST /identity/v3/projects => generated 376 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:13.156402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10b692-d43f-4bb9-9963-3a2aec001bdd admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:13.161663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-85723ae5-8fd8-4bc1-84a5-8719af85c7ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c3f3de81ad4423bfd1ba3ef3b2ae48', 'request_id': 'req-85723ae5-8fd8-4bc1-84a5-8719af85c7ce'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:13.180301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-85723ae5-8fd8-4bc1-84a5-8719af85c7ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c3f3de81ad4423bfd1ba3ef3b2ae48', 'request_id': 'req-85723ae5-8fd8-4bc1-84a5-8719af85c7ce'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:13.210247 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:13.220518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-85723ae5-8fd8-4bc1-84a5-8719af85c7ce admin admin] The token cache is being invalidate because project d0c3f3de81ad4423bfd1ba3ef3b2ae48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:13.221413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-85723ae5-8fd8-4bc1-84a5-8719af85c7ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:13.223226 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-85723ae5-8fd8-4bc1-84a5-8719af85c7ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:13.228382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 939/1901] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:12 2022] DELETE /identity/v3/projects/d0c3f3de81ad4423bfd1ba3ef3b2ae48 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:13.234827 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85723ae5-8fd8-4bc1-84a5-8719af85c7ce admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:13.238205 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-85723ae5-8fd8-4bc1-84a5-8719af85c7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:13.363998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10b692-d43f-4bb9-9963-3a2aec001bdd admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:13.391843 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a4d6e-504b-4403-adea-d17a34009a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:13.393693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a4d6e-504b-4403-adea-d17a34009a90 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:13.393693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a4d6e-504b-4403-adea-d17a34009a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:13.394068 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a4d6e-504b-4403-adea-d17a34009a90 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:13.395295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a4d6e-504b-4403-adea-d17a34009a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:13.399264 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a4d6e-504b-4403-adea-d17a34009a90 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:13.422520 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85723ae5-8fd8-4bc1-84a5-8719af85c7ce admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:13.431719 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 963/1902] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:13 2022] POST /identity/v3/users => generated 295 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:13.435305 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c9d4b-6acb-4143-8859-24260f13fa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:13.437161 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c9d4b-6acb-4143-8859-24260f13fa5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:13.437480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c9d4b-6acb-4143-8859-24260f13fa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:13.437761 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c9d4b-6acb-4143-8859-24260f13fa5f admin admin] PATH_INFO: `/v3/users/6fbaef99dce0496facc90a723a85f032` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:13.439256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a4d6e-504b-4403-adea-d17a34009a90 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:13.440811 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c9d4b-6acb-4143-8859-24260f13fa5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fbaef99dce0496facc90a723a85f032)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:13.443457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cc2a4d6e-504b-4403-adea-d17a34009a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:13.445578 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c9d4b-6acb-4143-8859-24260f13fa5f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:13.463017 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a4d6e-504b-4403-adea-d17a34009a90 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:13.469911 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47178d82-3ec4-4909-a660-b416b62dc297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:13.471619 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47178d82-3ec4-4909-a660-b416b62dc297 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:13.472096 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47178d82-3ec4-4909-a660-b416b62dc297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:13.472702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47178d82-3ec4-4909-a660-b416b62dc297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:13.474350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47178d82-3ec4-4909-a660-b416b62dc297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:13.478970 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47178d82-3ec4-4909-a660-b416b62dc297 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:13.502642 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 964/1903] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:13 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:43:13.509073 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47178d82-3ec4-4909-a660-b416b62dc297 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:13.521986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47178d82-3ec4-4909-a660-b416b62dc297 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:13.528745 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1164655-60f7-45e7-aafc-e3bdf8007f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:13.529667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1164655-60f7-45e7-aafc-e3bdf8007f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:13.529951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1164655-60f7-45e7-aafc-e3bdf8007f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:13.530231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1164655-60f7-45e7-aafc-e3bdf8007f26 admin admin] PATH_INFO: `/v3/projects/37d5336c7dfb4d82928568d1a2e88c0d/users/f6d791c01621446592fe23b24dd68e21/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:13.567548 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6e7c9d4b-6acb-4143-8859-24260f13fa5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fbaef99dce0496facc90a723a85f032'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:13.569255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6e7c9d4b-6acb-4143-8859-24260f13fa5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fbaef99dce0496facc90a723a85f032'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:13.596415 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1164655-60f7-45e7-aafc-e3bdf8007f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d5336c7dfb4d82928568d1a2e88c0d, user_id=f6d791c01621446592fe23b24dd68e21, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:13.596764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6e7c9d4b-6acb-4143-8859-24260f13fa5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fbaef99dce0496facc90a723a85f032'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:13.599424 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6e7c9d4b-6acb-4143-8859-24260f13fa5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fbaef99dce0496facc90a723a85f032'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:13.603591 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1164655-60f7-45e7-aafc-e3bdf8007f26 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:13.618976 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6e7c9d4b-6acb-4143-8859-24260f13fa5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fbaef99dce0496facc90a723a85f032'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:13.628898 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 965/1904] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:13 2022] PUT /identity/v3/projects/37d5336c7dfb4d82928568d1a2e88c0d/users/f6d791c01621446592fe23b24dd68e21/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:13.631859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1164655-60f7-45e7-aafc-e3bdf8007f26 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:13.635169 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c1164655-60f7-45e7-aafc-e3bdf8007f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:13.683661 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 940/1905] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:13 2022] DELETE /identity/v3/users/6fbaef99dce0496facc90a723a85f032 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:13.820946 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1164655-60f7-45e7-aafc-e3bdf8007f26 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:13.888106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:13.968493 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01287ab-878c-40d0-93c7-a3c54aefb59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:13.970175 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01287ab-878c-40d0-93c7-a3c54aefb59d admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:13.970862 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01287ab-878c-40d0-93c7-a3c54aefb59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:13.971287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01287ab-878c-40d0-93c7-a3c54aefb59d admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:13.972336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01287ab-878c-40d0-93c7-a3c54aefb59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:13.974344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01287ab-878c-40d0-93c7-a3c54aefb59d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:13.994902 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 966/1906] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:13 2022] GET /identity/v3/roles => generated 1427 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:13.998324 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c9d4b-6acb-4143-8859-24260f13fa5f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:14.027325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c9d4b-6acb-4143-8859-24260f13fa5f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:14.035787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abfb86-9dce-4166-9676-952a57ba92d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:14.036733 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abfb86-9dce-4166-9676-952a57ba92d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:14.037018 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abfb86-9dce-4166-9676-952a57ba92d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:14.037301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abfb86-9dce-4166-9676-952a57ba92d0 admin admin] PATH_INFO: `/v3/projects/37d5336c7dfb4d82928568d1a2e88c0d/users/f6d791c01621446592fe23b24dd68e21/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:14.039453 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abfb86-9dce-4166-9676-952a57ba92d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d5336c7dfb4d82928568d1a2e88c0d, user_id=f6d791c01621446592fe23b24dd68e21, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:14.042405 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abfb86-9dce-4166-9676-952a57ba92d0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:14.066203 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 941/1907] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:13 2022] PUT /identity/v3/projects/37d5336c7dfb4d82928568d1a2e88c0d/users/f6d791c01621446592fe23b24dd68e21/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:14.088891 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20cb06-1956-45a6-ad62-ff997f5f3cea None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:14.089430 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20cb06-1956-45a6-ad62-ff997f5f3cea None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:14.089540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20cb06-1956-45a6-ad62-ff997f5f3cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:14.166890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-dc20cb06-1956-45a6-ad62-ff997f5f3cea None None] MFA Rules not processed for user `f6d791c01621446592fe23b24dd68e21`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:14.168651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dc20cb06-1956-45a6-ad62-ff997f5f3cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:14.465829 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 967/1908] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:14.484848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20cb06-1956-45a6-ad62-ff997f5f3cea None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:14.486680 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abfb86-9dce-4166-9676-952a57ba92d0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:14.487191 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dc20cb06-1956-45a6-ad62-ff997f5f3cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:14.491502 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d3abfb86-9dce-4166-9676-952a57ba92d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:14.636807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20cb06-1956-45a6-ad62-ff997f5f3cea None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:14.646866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c6645-fd54-4514-ad8c-40dadf9096d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:14.648832 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c6645-fd54-4514-ad8c-40dadf9096d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:14.651304 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c6645-fd54-4514-ad8c-40dadf9096d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:14.651948 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c6645-fd54-4514-ad8c-40dadf9096d8 admin admin] PATH_INFO: `/v3/projects/bbdcaaf34f974c1eb74326b57ed62aaa` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:14.654842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c6645-fd54-4514-ad8c-40dadf9096d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbdcaaf34f974c1eb74326b57ed62aaa)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:14.660312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c6645-fd54-4514-ad8c-40dadf9096d8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:14.761429 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abfb86-9dce-4166-9676-952a57ba92d0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:14.799456 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-701c6645-fd54-4514-ad8c-40dadf9096d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbdcaaf34f974c1eb74326b57ed62aaa', 'request_id': 'req-701c6645-fd54-4514-ad8c-40dadf9096d8'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:14.809024 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:14.820659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-701c6645-fd54-4514-ad8c-40dadf9096d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbdcaaf34f974c1eb74326b57ed62aaa', 'request_id': 'req-701c6645-fd54-4514-ad8c-40dadf9096d8'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:14.826907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:14.843058 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-701c6645-fd54-4514-ad8c-40dadf9096d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbdcaaf34f974c1eb74326b57ed62aaa', 'request_id': 'req-701c6645-fd54-4514-ad8c-40dadf9096d8'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:14.885418 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-701c6645-fd54-4514-ad8c-40dadf9096d8 admin admin] The token cache is being invalidate because project bbdcaaf34f974c1eb74326b57ed62aaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:14.885891 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-701c6645-fd54-4514-ad8c-40dadf9096d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:14.887776 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-701c6645-fd54-4514-ad8c-40dadf9096d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:14.890825 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 968/1909] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:14 2022] DELETE /identity/v3/projects/bbdcaaf34f974c1eb74326b57ed62aaa => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:14.893176 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36268cf-65ad-49c9-a8d9-76b8c93a5eee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:14.894418 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36268cf-65ad-49c9-a8d9-76b8c93a5eee service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:14.895065 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36268cf-65ad-49c9-a8d9-76b8c93a5eee service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:14.895635 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36268cf-65ad-49c9-a8d9-76b8c93a5eee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:14.898048 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c36268cf-65ad-49c9-a8d9-76b8c93a5eee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:14.898844 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398751a5-7008-4527-a8e6-c34ea43917d0 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:14.899718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398751a5-7008-4527-a8e6-c34ea43917d0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:14.900331 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398751a5-7008-4527-a8e6-c34ea43917d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:14.939938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-398751a5-7008-4527-a8e6-c34ea43917d0 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:14.941989 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-398751a5-7008-4527-a8e6-c34ea43917d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:15.057107 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 969/1910] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:15.060770 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8cfe8-8773-47b4-a45b-ba7edd1c4211 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.061319 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8cfe8-8773-47b4-a45b-ba7edd1c4211 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.061818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8cfe8-8773-47b4-a45b-ba7edd1c4211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.122697 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36268cf-65ad-49c9-a8d9-76b8c93a5eee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:15.125593 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36268cf-65ad-49c9-a8d9-76b8c93a5eee service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:15.129136 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6ed8cfe8-8773-47b4-a45b-ba7edd1c4211 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:15.129932 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6ed8cfe8-8773-47b4-a45b-ba7edd1c4211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:15.147086 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 942/1911] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:15.166712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 970/1912] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:15.174315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36268cf-65ad-49c9-a8d9-76b8c93a5eee service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:15.200274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36268cf-65ad-49c9-a8d9-76b8c93a5eee service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.212252 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2907f-0f00-4988-bce5-d0599bcb27c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:15.214047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2907f-0f00-4988-bce5-d0599bcb27c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.214599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2907f-0f00-4988-bce5-d0599bcb27c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.215452 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2907f-0f00-4988-bce5-d0599bcb27c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.217129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2907f-0f00-4988-bce5-d0599bcb27c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:15.217943 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2907f-0f00-4988-bce5-d0599bcb27c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:15.221788 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2907f-0f00-4988-bce5-d0599bcb27c6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:15.263026 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8cfe8-8773-47b4-a45b-ba7edd1c4211 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:15.264728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 943/1913] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:43:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:15.283248 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8cfe8-8773-47b4-a45b-ba7edd1c4211 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.291747 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4f706-2061-4897-a116-c34549f6071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:15.292953 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4f706-2061-4897-a116-c34549f6071e admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.294132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4f706-2061-4897-a116-c34549f6071e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.294615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4f706-2061-4897-a116-c34549f6071e admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.295488 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4f706-2061-4897-a116-c34549f6071e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:15.298241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4f706-2061-4897-a116-c34549f6071e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:15.347997 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 971/1914] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:15 2022] POST /identity/v3/projects => generated 368 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:15.355529 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2907f-0f00-4988-bce5-d0599bcb27c6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:15.392029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2907f-0f00-4988-bce5-d0599bcb27c6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.584470 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bf8a4-b581-424a-b935-255bfa829c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:15.586017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bf8a4-b581-424a-b935-255bfa829c88 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.587171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bf8a4-b581-424a-b935-255bfa829c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.587779 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bf8a4-b581-424a-b935-255bfa829c88 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.589430 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bf8a4-b581-424a-b935-255bfa829c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:15.594243 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bf8a4-b581-424a-b935-255bfa829c88 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:15.649033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 944/1915] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:15 2022] POST /identity/v3/users => generated 285 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:15.656284 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4f706-2061-4897-a116-c34549f6071e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:15.684198 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4f706-2061-4897-a116-c34549f6071e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.697360 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c258b2-17f7-492d-92be-959592965251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:15.698961 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c258b2-17f7-492d-92be-959592965251 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.699738 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c258b2-17f7-492d-92be-959592965251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.700605 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c258b2-17f7-492d-92be-959592965251 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.702620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c258b2-17f7-492d-92be-959592965251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:15.706905 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c258b2-17f7-492d-92be-959592965251 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:15.736806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 972/1916] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:15 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:43:15.744945 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bf8a4-b581-424a-b935-255bfa829c88 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:15.790735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bf8a4-b581-424a-b935-255bfa829c88 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.808787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3630b-f79f-4b3e-8149-b492e0a668dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:15.809814 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3630b-f79f-4b3e-8149-b492e0a668dd admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.810313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3630b-f79f-4b3e-8149-b492e0a668dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.810636 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3630b-f79f-4b3e-8149-b492e0a668dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.811523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3630b-f79f-4b3e-8149-b492e0a668dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:15.814027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3630b-f79f-4b3e-8149-b492e0a668dd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:15.835180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 945/1917] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:15 2022] GET /identity/v3/roles => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:15.837650 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c258b2-17f7-492d-92be-959592965251 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:15.861314 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c258b2-17f7-492d-92be-959592965251 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.872098 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991a833-f9b8-471f-aa6c-c3839ef75b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:15.873435 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991a833-f9b8-471f-aa6c-c3839ef75b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.874276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991a833-f9b8-471f-aa6c-c3839ef75b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.874276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991a833-f9b8-471f-aa6c-c3839ef75b17 admin admin] PATH_INFO: `/v3/projects/6190446fca0d481a9c8cbf40acd13db9/users/2a38cf3d1dae46deba126f31013abcca/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.898818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991a833-f9b8-471f-aa6c-c3839ef75b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6190446fca0d481a9c8cbf40acd13db9, user_id=2a38cf3d1dae46deba126f31013abcca, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:15.903359 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991a833-f9b8-471f-aa6c-c3839ef75b17 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:15.942402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 973/1918] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:15 2022] PUT /identity/v3/projects/6190446fca0d481a9c8cbf40acd13db9/users/2a38cf3d1dae46deba126f31013abcca/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:15.963729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ee1e7-41ab-4b77-a130-657e90a0655f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.964023 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ee1e7-41ab-4b77-a130-657e90a0655f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.964292 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ee1e7-41ab-4b77-a130-657e90a0655f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.006820 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f04ee1e7-41ab-4b77-a130-657e90a0655f None None] MFA Rules not processed for user `2a38cf3d1dae46deba126f31013abcca`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:16.009080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f04ee1e7-41ab-4b77-a130-657e90a0655f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:16.046335 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991a833-f9b8-471f-aa6c-c3839ef75b17 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.049238 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8991a833-f9b8-471f-aa6c-c3839ef75b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:16.078950 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:16.158733 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 946/1919] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:16.163885 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ee1e7-41ab-4b77-a130-657e90a0655f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.174924 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991a833-f9b8-471f-aa6c-c3839ef75b17 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.182341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede4d51-d7e5-4aef-90bc-fb6d543b02da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.183691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede4d51-d7e5-4aef-90bc-fb6d543b02da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.184162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede4d51-d7e5-4aef-90bc-fb6d543b02da admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.184592 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede4d51-d7e5-4aef-90bc-fb6d543b02da admin admin] PATH_INFO: `/v3/users/31bcaab7686548af9b231f9f32834b33` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.187742 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede4d51-d7e5-4aef-90bc-fb6d543b02da admin admin] RBAC: Authorizing `identity:delete_user(user_id=31bcaab7686548af9b231f9f32834b33)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.191835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede4d51-d7e5-4aef-90bc-fb6d543b02da admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.196007 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ee1e7-41ab-4b77-a130-657e90a0655f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.208686 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b012ef7-54d4-4bf9-8ab6-0f8adbfe0f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.209861 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b012ef7-54d4-4bf9-8ab6-0f8adbfe0f00 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.210407 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b012ef7-54d4-4bf9-8ab6-0f8adbfe0f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.210809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b012ef7-54d4-4bf9-8ab6-0f8adbfe0f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.211630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b012ef7-54d4-4bf9-8ab6-0f8adbfe0f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.213997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b012ef7-54d4-4bf9-8ab6-0f8adbfe0f00 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.238101 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:16.261175 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 947/1920] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:16 2022] POST /identity/v3/projects => generated 366 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:16.266440 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b012ef7-54d4-4bf9-8ab6-0f8adbfe0f00 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.281442 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1ede4d51-d7e5-4aef-90bc-fb6d543b02da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31bcaab7686548af9b231f9f32834b33'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:16.299358 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1ede4d51-d7e5-4aef-90bc-fb6d543b02da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31bcaab7686548af9b231f9f32834b33'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:16.300515 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1ede4d51-d7e5-4aef-90bc-fb6d543b02da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31bcaab7686548af9b231f9f32834b33'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:16.312504 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1ede4d51-d7e5-4aef-90bc-fb6d543b02da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31bcaab7686548af9b231f9f32834b33'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:16.313498 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1ede4d51-d7e5-4aef-90bc-fb6d543b02da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31bcaab7686548af9b231f9f32834b33'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:16.339494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 974/1921] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:16 2022] DELETE /identity/v3/users/31bcaab7686548af9b231f9f32834b33 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:16.342008 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accd143-ec87-4e05-b3a1-2a3b8c1a1fd7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.342511 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accd143-ec87-4e05-b3a1-2a3b8c1a1fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.343288 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accd143-ec87-4e05-b3a1-2a3b8c1a1fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.383047 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7accd143-ec87-4e05-b3a1-2a3b8c1a1fd7 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:16.385898 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7accd143-ec87-4e05-b3a1-2a3b8c1a1fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:16.409688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b012ef7-54d4-4bf9-8ab6-0f8adbfe0f00 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.537192 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd949e9a-1029-4ce1-9e27-94cb890545c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.538560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949e9a-1029-4ce1-9e27-94cb890545c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.539148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949e9a-1029-4ce1-9e27-94cb890545c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.541180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949e9a-1029-4ce1-9e27-94cb890545c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.548549 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 975/1922] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:16.548980 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd949e9a-1029-4ce1-9e27-94cb890545c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.550769 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd949e9a-1029-4ce1-9e27-94cb890545c0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.563855 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accd143-ec87-4e05-b3a1-2a3b8c1a1fd7 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.567589 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7accd143-ec87-4e05-b3a1-2a3b8c1a1fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:16.581096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 948/1923] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:16 2022] POST /identity/v3/users => generated 290 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:43:16.583217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd949e9a-1029-4ce1-9e27-94cb890545c0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.586000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fd949e9a-1029-4ce1-9e27-94cb890545c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:16.602617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd949e9a-1029-4ce1-9e27-94cb890545c0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.610398 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa6d35-0604-40aa-96d8-8eb0ef34aa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.611169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa6d35-0604-40aa-96d8-8eb0ef34aa6d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.611725 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa6d35-0604-40aa-96d8-8eb0ef34aa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.611725 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa6d35-0604-40aa-96d8-8eb0ef34aa6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.612464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa6d35-0604-40aa-96d8-8eb0ef34aa6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.614086 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa6d35-0604-40aa-96d8-8eb0ef34aa6d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.626240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 949/1924] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:16 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:43:16.631544 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa6d35-0604-40aa-96d8-8eb0ef34aa6d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.663633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa6d35-0604-40aa-96d8-8eb0ef34aa6d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.681369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30072d65-f4e7-41c7-a9cc-16c42ffb672a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.682397 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30072d65-f4e7-41c7-a9cc-16c42ffb672a admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.684859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30072d65-f4e7-41c7-a9cc-16c42ffb672a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.684859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30072d65-f4e7-41c7-a9cc-16c42ffb672a admin admin] PATH_INFO: `/v3/projects/d02b80185b4a4eb4bf0d735b4f3c441a/users/db69c602d4054ad8842ffac3a4be4768/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.714607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accd143-ec87-4e05-b3a1-2a3b8c1a1fd7 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.716217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30072d65-f4e7-41c7-a9cc-16c42ffb672a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d02b80185b4a4eb4bf0d735b4f3c441a, user_id=db69c602d4054ad8842ffac3a4be4768, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.719132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a8ff5-2989-4fef-8fbf-e9a4467566c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.719873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a8ff5-2989-4fef-8fbf-e9a4467566c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.720436 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30072d65-f4e7-41c7-a9cc-16c42ffb672a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.720609 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a8ff5-2989-4fef-8fbf-e9a4467566c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.720609 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a8ff5-2989-4fef-8fbf-e9a4467566c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.732333 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a8ff5-2989-4fef-8fbf-e9a4467566c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.733949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a8ff5-2989-4fef-8fbf-e9a4467566c8 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.755625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 950/1926] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:16 2022] PUT /identity/v3/projects/d02b80185b4a4eb4bf0d735b4f3c441a/users/db69c602d4054ad8842ffac3a4be4768/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:16.761168 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30072d65-f4e7-41c7-a9cc-16c42ffb672a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.762650 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 976/1926] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:16.780148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:16.935814 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30072d65-f4e7-41c7-a9cc-16c42ffb672a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.947821 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aeef93-aa18-4be3-9dd5-f90849356c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.948633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aeef93-aa18-4be3-9dd5-f90849356c3b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.948842 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aeef93-aa18-4be3-9dd5-f90849356c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.949204 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aeef93-aa18-4be3-9dd5-f90849356c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.950087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aeef93-aa18-4be3-9dd5-f90849356c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.952324 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aeef93-aa18-4be3-9dd5-f90849356c3b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:17.005193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a8ff5-2989-4fef-8fbf-e9a4467566c8 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:17.012927 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 951/1927] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:16 2022] GET /identity/v3/roles => generated 1427 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:43:17.035217 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a8ff5-2989-4fef-8fbf-e9a4467566c8 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:17.066039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715294e-095b-4525-9296-9b96a168b7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:17.069648 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715294e-095b-4525-9296-9b96a168b7fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:17.070149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715294e-095b-4525-9296-9b96a168b7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:17.071704 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715294e-095b-4525-9296-9b96a168b7fc admin admin] PATH_INFO: `/v3/projects/d02b80185b4a4eb4bf0d735b4f3c441a/users/db69c602d4054ad8842ffac3a4be4768/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:17.082689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715294e-095b-4525-9296-9b96a168b7fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d02b80185b4a4eb4bf0d735b4f3c441a, user_id=db69c602d4054ad8842ffac3a4be4768, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:17.090337 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715294e-095b-4525-9296-9b96a168b7fc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:17.134947 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 977/1928] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:17 2022] PUT /identity/v3/projects/d02b80185b4a4eb4bf0d735b4f3c441a/users/db69c602d4054ad8842ffac3a4be4768/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:17.140487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f0c97-3bef-4bef-83b6-06f9925e48d4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:17.140797 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f0c97-3bef-4bef-83b6-06f9925e48d4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:17.141083 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f0c97-3bef-4bef-83b6-06f9925e48d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:17.235339 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fa0f0c97-3bef-4bef-83b6-06f9925e48d4 None None] MFA Rules not processed for user `db69c602d4054ad8842ffac3a4be4768`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:17.241059 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fa0f0c97-3bef-4bef-83b6-06f9925e48d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:17.413656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715294e-095b-4525-9296-9b96a168b7fc admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:17.417898 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4715294e-095b-4525-9296-9b96a168b7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:17.543677 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:17.579480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 952/1929] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:17.598510 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f0c97-3bef-4bef-83b6-06f9925e48d4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:17.605554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fa0f0c97-3bef-4bef-83b6-06f9925e48d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:17.632408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715294e-095b-4525-9296-9b96a168b7fc admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:17.655140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdfca5-93c7-44fc-a541-0ee25a38076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:17.656806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdfca5-93c7-44fc-a541-0ee25a38076a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:17.657425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdfca5-93c7-44fc-a541-0ee25a38076a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:17.658024 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdfca5-93c7-44fc-a541-0ee25a38076a admin admin] PATH_INFO: `/v3/projects/1208f5ab7a7944b291050e3f11d9ca79` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:17.659729 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdfca5-93c7-44fc-a541-0ee25a38076a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1208f5ab7a7944b291050e3f11d9ca79)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:17.662374 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdfca5-93c7-44fc-a541-0ee25a38076a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:17.746337 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f0c97-3bef-4bef-83b6-06f9925e48d4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:17.769930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ebbdfca5-93c7-44fc-a541-0ee25a38076a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1208f5ab7a7944b291050e3f11d9ca79', 'request_id': 'req-ebbdfca5-93c7-44fc-a541-0ee25a38076a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:17.785262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ebbdfca5-93c7-44fc-a541-0ee25a38076a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1208f5ab7a7944b291050e3f11d9ca79', 'request_id': 'req-ebbdfca5-93c7-44fc-a541-0ee25a38076a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:17.797444 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ebbdfca5-93c7-44fc-a541-0ee25a38076a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1208f5ab7a7944b291050e3f11d9ca79', 'request_id': 'req-ebbdfca5-93c7-44fc-a541-0ee25a38076a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:17.819293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ebbdfca5-93c7-44fc-a541-0ee25a38076a admin admin] The token cache is being invalidate because project 1208f5ab7a7944b291050e3f11d9ca79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:17.820016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ebbdfca5-93c7-44fc-a541-0ee25a38076a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:17.821994 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ebbdfca5-93c7-44fc-a541-0ee25a38076a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:17.825858 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 978/1930] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:17 2022] DELETE /identity/v3/projects/1208f5ab7a7944b291050e3f11d9ca79 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:17.842753 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdfca5-93c7-44fc-a541-0ee25a38076a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:17.846095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ebbdfca5-93c7-44fc-a541-0ee25a38076a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:17.864876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:17.889731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e3589-25d6-468a-86b1-46fd9db68bb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:17.890781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e3589-25d6-468a-86b1-46fd9db68bb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:17.891395 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e3589-25d6-468a-86b1-46fd9db68bb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:17.891689 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e3589-25d6-468a-86b1-46fd9db68bb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:17.899512 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d25e3589-25d6-468a-86b1-46fd9db68bb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:18.034213 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdfca5-93c7-44fc-a541-0ee25a38076a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:18.041252 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e3589-25d6-468a-86b1-46fd9db68bb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:18.044029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e3589-25d6-468a-86b1-46fd9db68bb4 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:18.061476 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b7ff2-c566-4e34-88b3-8e90246cf0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:18.061874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 953/1931] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:17 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:43:18.072430 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b7ff2-c566-4e34-88b3-8e90246cf0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:18.072979 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b7ff2-c566-4e34-88b3-8e90246cf0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:18.073489 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b7ff2-c566-4e34-88b3-8e90246cf0e6 admin admin] PATH_INFO: `/v3/users/944c90063228489d8b1d946effa2ba18` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:18.084805 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b7ff2-c566-4e34-88b3-8e90246cf0e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=944c90063228489d8b1d946effa2ba18)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:18.090883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b7ff2-c566-4e34-88b3-8e90246cf0e6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:18.240133 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e3589-25d6-468a-86b1-46fd9db68bb4 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:18.248163 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d25e3589-25d6-468a-86b1-46fd9db68bb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:18.285599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e3589-25d6-468a-86b1-46fd9db68bb4 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:18.299688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-da8b7ff2-c566-4e34-88b3-8e90246cf0e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '944c90063228489d8b1d946effa2ba18'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:18.307478 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584d0bb-895b-47c9-87d4-9a1ea2d0c107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:18.312393 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584d0bb-895b-47c9-87d4-9a1ea2d0c107 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:18.312896 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584d0bb-895b-47c9-87d4-9a1ea2d0c107 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:18.313398 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584d0bb-895b-47c9-87d4-9a1ea2d0c107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:18.318481 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4584d0bb-895b-47c9-87d4-9a1ea2d0c107 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:18.334129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:18.337643 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-da8b7ff2-c566-4e34-88b3-8e90246cf0e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '944c90063228489d8b1d946effa2ba18'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:18.345768 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-da8b7ff2-c566-4e34-88b3-8e90246cf0e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '944c90063228489d8b1d946effa2ba18'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:18.378376 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-da8b7ff2-c566-4e34-88b3-8e90246cf0e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '944c90063228489d8b1d946effa2ba18'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:18.381481 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-da8b7ff2-c566-4e34-88b3-8e90246cf0e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '944c90063228489d8b1d946effa2ba18'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:18.415204 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 979/1932] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:17 2022] DELETE /identity/v3/users/944c90063228489d8b1d946effa2ba18 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:18.524757 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584d0bb-895b-47c9-87d4-9a1ea2d0c107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:18.527668 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584d0bb-895b-47c9-87d4-9a1ea2d0c107 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:18.559285 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 954/1933] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:43:18.620290 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b7ff2-c566-4e34-88b3-8e90246cf0e6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:18.623425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-da8b7ff2-c566-4e34-88b3-8e90246cf0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:18.809518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b7ff2-c566-4e34-88b3-8e90246cf0e6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:18.813889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b74d68-1561-4348-af2d-d02bf2a54475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:18.814540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b74d68-1561-4348-af2d-d02bf2a54475 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:18.815105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b74d68-1561-4348-af2d-d02bf2a54475 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:18.815389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b74d68-1561-4348-af2d-d02bf2a54475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:18.818113 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-50b74d68-1561-4348-af2d-d02bf2a54475 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:18.983629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b74d68-1561-4348-af2d-d02bf2a54475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:18.990004 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b74d68-1561-4348-af2d-d02bf2a54475 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:19.032152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 980/1934] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:43:19.143110 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584d0bb-895b-47c9-87d4-9a1ea2d0c107 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:19.222221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584d0bb-895b-47c9-87d4-9a1ea2d0c107 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:19.425843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f600418-daf7-40d9-a139-7d57aec3e65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:19.427449 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f600418-daf7-40d9-a139-7d57aec3e65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:19.427973 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f600418-daf7-40d9-a139-7d57aec3e65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:19.428464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f600418-daf7-40d9-a139-7d57aec3e65c admin admin] PATH_INFO: `/v3/projects/132f0e00402144b8802d942dafede41e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:19.436068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f600418-daf7-40d9-a139-7d57aec3e65c admin admin] RBAC: Authorizing `identity:delete_project(project_id=132f0e00402144b8802d942dafede41e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:19.448315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f600418-daf7-40d9-a139-7d57aec3e65c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:19.603925 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:19.652148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0f600418-daf7-40d9-a139-7d57aec3e65c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132f0e00402144b8802d942dafede41e', 'request_id': 'req-0f600418-daf7-40d9-a139-7d57aec3e65c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:19.684863 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0f600418-daf7-40d9-a139-7d57aec3e65c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132f0e00402144b8802d942dafede41e', 'request_id': 'req-0f600418-daf7-40d9-a139-7d57aec3e65c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:19.734098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0f600418-daf7-40d9-a139-7d57aec3e65c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132f0e00402144b8802d942dafede41e', 'request_id': 'req-0f600418-daf7-40d9-a139-7d57aec3e65c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:19.764656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0f600418-daf7-40d9-a139-7d57aec3e65c admin admin] The token cache is being invalidate because project 132f0e00402144b8802d942dafede41e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:19.765761 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0f600418-daf7-40d9-a139-7d57aec3e65c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:19.767974 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0f600418-daf7-40d9-a139-7d57aec3e65c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:19.770443 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 955/1935] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:19 2022] DELETE /identity/v3/projects/132f0e00402144b8802d942dafede41e => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:19.777623 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f9d33-a6a4-4eae-8222-c34070af8897 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:19.778619 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f9d33-a6a4-4eae-8222-c34070af8897 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:19.779039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f9d33-a6a4-4eae-8222-c34070af8897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:19.809024 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-389f9d33-a6a4-4eae-8222-c34070af8897 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:19.812449 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-389f9d33-a6a4-4eae-8222-c34070af8897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:20.072990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 981/1936] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:20.076112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef626d-53c7-47df-b5ba-a5a0ffbeeba1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:20.076618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef626d-53c7-47df-b5ba-a5a0ffbeeba1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:20.077134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef626d-53c7-47df-b5ba-a5a0ffbeeba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:20.127542 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-63ef626d-53c7-47df-b5ba-a5a0ffbeeba1 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:20.130311 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-63ef626d-53c7-47df-b5ba-a5a0ffbeeba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:20.149447 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 956/1937] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:20.154311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f9d33-a6a4-4eae-8222-c34070af8897 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:20.190260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f9d33-a6a4-4eae-8222-c34070af8897 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:20.207665 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c55713-bf20-42fa-8672-972c25513bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:20.208694 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c55713-bf20-42fa-8672-972c25513bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:20.209013 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c55713-bf20-42fa-8672-972c25513bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:20.209570 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c55713-bf20-42fa-8672-972c25513bb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:20.210473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c55713-bf20-42fa-8672-972c25513bb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:20.211810 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c55713-bf20-42fa-8672-972c25513bb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:20.213608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c55713-bf20-42fa-8672-972c25513bb6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:20.238236 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 982/1938] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:43:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:20.240665 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef626d-53c7-47df-b5ba-a5a0ffbeeba1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:20.263031 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef626d-53c7-47df-b5ba-a5a0ffbeeba1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:20.286148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90189e-4396-4d22-8bd2-079e4b6d1aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:20.288833 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90189e-4396-4d22-8bd2-079e4b6d1aff admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:20.289345 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90189e-4396-4d22-8bd2-079e4b6d1aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:20.290330 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90189e-4396-4d22-8bd2-079e4b6d1aff admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:20.291841 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90189e-4396-4d22-8bd2-079e4b6d1aff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:20.297694 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90189e-4396-4d22-8bd2-079e4b6d1aff admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:20.366391 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 957/1939] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:20 2022] POST /identity/v3/projects => generated 388 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:43:20.372592 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c55713-bf20-42fa-8672-972c25513bb6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:20.400923 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c55713-bf20-42fa-8672-972c25513bb6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:20.478599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:20.583282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c32c86-9a10-413e-b27f-43711dc087c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:20.584519 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c32c86-9a10-413e-b27f-43711dc087c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:20.585121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c32c86-9a10-413e-b27f-43711dc087c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:20.587918 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c32c86-9a10-413e-b27f-43711dc087c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:20.589625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c32c86-9a10-413e-b27f-43711dc087c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:20.595061 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c32c86-9a10-413e-b27f-43711dc087c8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:20.638949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 983/1940] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:20 2022] POST /identity/v3/users => generated 295 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:20.660985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90189e-4396-4d22-8bd2-079e4b6d1aff admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:20.693929 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90189e-4396-4d22-8bd2-079e4b6d1aff admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:20.708936 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c595da-5b60-446a-8dc0-a6a1960370ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:20.710327 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c595da-5b60-446a-8dc0-a6a1960370ee admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:20.711546 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c595da-5b60-446a-8dc0-a6a1960370ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:20.712215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c595da-5b60-446a-8dc0-a6a1960370ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:20.713726 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c595da-5b60-446a-8dc0-a6a1960370ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:20.717266 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c595da-5b60-446a-8dc0-a6a1960370ee admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:20.755093 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c32c86-9a10-413e-b27f-43711dc087c8 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:20.755787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 958/1941] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:20 2022] GET /identity/v3/roles => generated 1427 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:20.771737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c32c86-9a10-413e-b27f-43711dc087c8 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:20.777975 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba03888-c370-4dcb-a9c5-0ebe073fdf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:20.778961 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba03888-c370-4dcb-a9c5-0ebe073fdf95 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:20.778961 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba03888-c370-4dcb-a9c5-0ebe073fdf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:20.779246 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba03888-c370-4dcb-a9c5-0ebe073fdf95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:20.779968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba03888-c370-4dcb-a9c5-0ebe073fdf95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:20.781591 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba03888-c370-4dcb-a9c5-0ebe073fdf95 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:20.800135 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 984/1942] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:20 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:20.803931 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c595da-5b60-446a-8dc0-a6a1960370ee admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:20.823516 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c595da-5b60-446a-8dc0-a6a1960370ee admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:20.837027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1b50a-6056-4352-9313-9b54a78e2945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:20.837951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1b50a-6056-4352-9313-9b54a78e2945 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:20.838236 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1b50a-6056-4352-9313-9b54a78e2945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:20.838515 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1b50a-6056-4352-9313-9b54a78e2945 admin admin] PATH_INFO: `/v3/projects/f6b18c48701747bda2745db7e3d51db7/users/6b1459ef233b497ebb8503f32d7a3086/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:20.883156 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1b50a-6056-4352-9313-9b54a78e2945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b18c48701747bda2745db7e3d51db7, user_id=6b1459ef233b497ebb8503f32d7a3086, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:20.891748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1b50a-6056-4352-9313-9b54a78e2945 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:20.933847 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 959/1943] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:20 2022] PUT /identity/v3/projects/f6b18c48701747bda2745db7e3d51db7/users/6b1459ef233b497ebb8503f32d7a3086/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:20.935715 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19302b3a-4668-4f68-aad9-89094a715d43 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:20.936268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19302b3a-4668-4f68-aad9-89094a715d43 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:20.936946 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19302b3a-4668-4f68-aad9-89094a715d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:21.030850 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-19302b3a-4668-4f68-aad9-89094a715d43 None None] MFA Rules not processed for user `6b1459ef233b497ebb8503f32d7a3086`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:21.034919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-19302b3a-4668-4f68-aad9-89094a715d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:21.216994 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1b50a-6056-4352-9313-9b54a78e2945 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:21.236077 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 985/1944] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:21.385135 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1b50a-6056-4352-9313-9b54a78e2945 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:21.400940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddb769-c5f5-46bf-af19-2521c373defc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:21.401642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddb769-c5f5-46bf-af19-2521c373defc admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:21.401982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddb769-c5f5-46bf-af19-2521c373defc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:21.404514 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddb769-c5f5-46bf-af19-2521c373defc admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:21.405768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ddb769-c5f5-46bf-af19-2521c373defc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:21.421384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ddb769-c5f5-46bf-af19-2521c373defc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:21.490319 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19302b3a-4668-4f68-aad9-89094a715d43 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:21.499772 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 960/1945] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:21 2022] POST /identity/v3/projects => generated 388 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:21.512063 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19302b3a-4668-4f68-aad9-89094a715d43 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:21.661997 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38061a8-a2d7-4aa2-97ec-06727471dd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:21.663836 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38061a8-a2d7-4aa2-97ec-06727471dd6e admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:21.664756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38061a8-a2d7-4aa2-97ec-06727471dd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:21.665703 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38061a8-a2d7-4aa2-97ec-06727471dd6e admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:21.667992 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38061a8-a2d7-4aa2-97ec-06727471dd6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:21.672529 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38061a8-a2d7-4aa2-97ec-06727471dd6e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:21.723324 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 986/1946] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:21 2022] POST /identity/v3/users => generated 295 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:21.728233 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddb769-c5f5-46bf-af19-2521c373defc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:21.743523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddb769-c5f5-46bf-af19-2521c373defc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:21.753066 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6a7fc-d1cd-45a8-a0f9-cbd42cd0c564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:21.754121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6a7fc-d1cd-45a8-a0f9-cbd42cd0c564 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:21.754974 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6a7fc-d1cd-45a8-a0f9-cbd42cd0c564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:21.756272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6a7fc-d1cd-45a8-a0f9-cbd42cd0c564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:21.758029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6a7fc-d1cd-45a8-a0f9-cbd42cd0c564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:21.762271 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6a7fc-d1cd-45a8-a0f9-cbd42cd0c564 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:21.805528 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38061a8-a2d7-4aa2-97ec-06727471dd6e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:21.824701 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 961/1947] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:21 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:21.825100 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38061a8-a2d7-4aa2-97ec-06727471dd6e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:21.830396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282a8c8-fdc3-4367-8ea2-5cc99558424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:21.832660 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282a8c8-fdc3-4367-8ea2-5cc99558424a admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:21.833382 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282a8c8-fdc3-4367-8ea2-5cc99558424a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:21.833382 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282a8c8-fdc3-4367-8ea2-5cc99558424a admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:21.834656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282a8c8-fdc3-4367-8ea2-5cc99558424a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:21.836478 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282a8c8-fdc3-4367-8ea2-5cc99558424a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:21.848253 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 987/1948] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:21 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:21.854022 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6a7fc-d1cd-45a8-a0f9-cbd42cd0c564 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:21.880367 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6a7fc-d1cd-45a8-a0f9-cbd42cd0c564 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:21.888024 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fbba9-ac13-4d96-90df-71d8220eb1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:21.888970 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fbba9-ac13-4d96-90df-71d8220eb1bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:21.889268 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fbba9-ac13-4d96-90df-71d8220eb1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:21.889549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fbba9-ac13-4d96-90df-71d8220eb1bc admin admin] PATH_INFO: `/v3/projects/a4ad9a14054e44568ae06d00c40be20e/users/b9be814461c745e79b79ac33d1afc9f7/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:21.919720 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fbba9-ac13-4d96-90df-71d8220eb1bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ad9a14054e44568ae06d00c40be20e, user_id=b9be814461c745e79b79ac33d1afc9f7, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:21.924994 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fbba9-ac13-4d96-90df-71d8220eb1bc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:21.949825 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 962/1949] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:21 2022] PUT /identity/v3/projects/a4ad9a14054e44568ae06d00c40be20e/users/b9be814461c745e79b79ac33d1afc9f7/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:21.967769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c81b15-fc8a-479f-9c7c-3aa81ba554a3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:21.968045 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c81b15-fc8a-479f-9c7c-3aa81ba554a3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:21.968339 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c81b15-fc8a-479f-9c7c-3aa81ba554a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:21.980050 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:22.014158 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-91c81b15-fc8a-479f-9c7c-3aa81ba554a3 None None] MFA Rules not processed for user `b9be814461c745e79b79ac33d1afc9f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:22.015896 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-91c81b15-fc8a-479f-9c7c-3aa81ba554a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:22.149351 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 988/1950] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:22.155389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fbba9-ac13-4d96-90df-71d8220eb1bc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:22.175567 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:22.272279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fbba9-ac13-4d96-90df-71d8220eb1bc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:22.282626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5dcfc-98cb-4ed1-bbfc-aa752cddc5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:22.284216 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5dcfc-98cb-4ed1-bbfc-aa752cddc5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:22.284744 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5dcfc-98cb-4ed1-bbfc-aa752cddc5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:22.285167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5dcfc-98cb-4ed1-bbfc-aa752cddc5b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:22.286405 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5dcfc-98cb-4ed1-bbfc-aa752cddc5b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:22.290247 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5dcfc-98cb-4ed1-bbfc-aa752cddc5b5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:22.346181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 963/1951] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:22 2022] POST /identity/v3/projects => generated 386 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:22.347182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c81b15-fc8a-479f-9c7c-3aa81ba554a3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:22.367728 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c81b15-fc8a-479f-9c7c-3aa81ba554a3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:22.518156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb122e2d-bf34-440d-836a-8b87df09125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:22.519554 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb122e2d-bf34-440d-836a-8b87df09125c admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:22.520181 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb122e2d-bf34-440d-836a-8b87df09125c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:22.520506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb122e2d-bf34-440d-836a-8b87df09125c admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:22.521825 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb122e2d-bf34-440d-836a-8b87df09125c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:22.524956 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb122e2d-bf34-440d-836a-8b87df09125c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:22.564871 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 989/1952] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:22 2022] POST /identity/v3/users => generated 300 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:43:22.566057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5dcfc-98cb-4ed1-bbfc-aa752cddc5b5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:22.589967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5dcfc-98cb-4ed1-bbfc-aa752cddc5b5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:22.600867 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d101d56-11f4-4e24-be84-005b3b76dfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:22.602237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d101d56-11f4-4e24-be84-005b3b76dfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:22.602979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d101d56-11f4-4e24-be84-005b3b76dfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:22.603501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d101d56-11f4-4e24-be84-005b3b76dfa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:22.604898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d101d56-11f4-4e24-be84-005b3b76dfa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:22.607500 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d101d56-11f4-4e24-be84-005b3b76dfa1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:22.634704 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 964/1953] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:22 2022] GET /identity/v3/roles => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:22.638861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb122e2d-bf34-440d-836a-8b87df09125c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:22.660508 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb122e2d-bf34-440d-836a-8b87df09125c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:22.668396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986faaa-aa0e-4230-a46a-19068545cc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:22.669969 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986faaa-aa0e-4230-a46a-19068545cc60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:22.670498 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986faaa-aa0e-4230-a46a-19068545cc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:22.671162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986faaa-aa0e-4230-a46a-19068545cc60 admin admin] PATH_INFO: `/v3/projects/d72bc3c3a23c41a3a7190479fdd90b55/users/bd634d8d78a44f18b0c276dc939383b9/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:22.694399 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986faaa-aa0e-4230-a46a-19068545cc60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d72bc3c3a23c41a3a7190479fdd90b55, user_id=bd634d8d78a44f18b0c276dc939383b9, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:22.699331 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986faaa-aa0e-4230-a46a-19068545cc60 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:22.721195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 990/1954] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:22 2022] PUT /identity/v3/projects/d72bc3c3a23c41a3a7190479fdd90b55/users/bd634d8d78a44f18b0c276dc939383b9/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:22.727110 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d101d56-11f4-4e24-be84-005b3b76dfa1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:22.753627 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d101d56-11f4-4e24-be84-005b3b76dfa1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:22.893317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804e159-7601-4267-a095-0c9dcf9357c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:22.894774 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804e159-7601-4267-a095-0c9dcf9357c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:22.895451 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804e159-7601-4267-a095-0c9dcf9357c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:22.896367 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804e159-7601-4267-a095-0c9dcf9357c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:22.899162 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804e159-7601-4267-a095-0c9dcf9357c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:22.903099 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804e159-7601-4267-a095-0c9dcf9357c4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:22.937255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986faaa-aa0e-4230-a46a-19068545cc60 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:22.939674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 965/1955] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:22 2022] GET /identity/v3/roles => generated 1427 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:22.965281 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986faaa-aa0e-4230-a46a-19068545cc60 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:22.973076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f2bf8-5222-4e02-9de0-8f9b47294ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:22.974922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f2bf8-5222-4e02-9de0-8f9b47294ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:22.975589 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f2bf8-5222-4e02-9de0-8f9b47294ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:22.976205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f2bf8-5222-4e02-9de0-8f9b47294ee6 admin admin] PATH_INFO: `/v3/projects/d72bc3c3a23c41a3a7190479fdd90b55/users/bd634d8d78a44f18b0c276dc939383b9/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:22.980106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f2bf8-5222-4e02-9de0-8f9b47294ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d72bc3c3a23c41a3a7190479fdd90b55, user_id=bd634d8d78a44f18b0c276dc939383b9, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:22.985626 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f2bf8-5222-4e02-9de0-8f9b47294ee6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:23.018616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 991/1956] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:22 2022] PUT /identity/v3/projects/d72bc3c3a23c41a3a7190479fdd90b55/users/bd634d8d78a44f18b0c276dc939383b9/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:23.022897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ae98c-ce15-4318-9c7a-eb3e84372916 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:23.023461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ae98c-ce15-4318-9c7a-eb3e84372916 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:23.023874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ae98c-ce15-4318-9c7a-eb3e84372916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:23.075370 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-541ae98c-ce15-4318-9c7a-eb3e84372916 None None] MFA Rules not processed for user `bd634d8d78a44f18b0c276dc939383b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:23.077746 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-541ae98c-ce15-4318-9c7a-eb3e84372916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:23.318104 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 966/1957] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:23.390611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f2bf8-5222-4e02-9de0-8f9b47294ee6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:23.392585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-834f2bf8-5222-4e02-9de0-8f9b47294ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:23.532267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:23.559113 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f2bf8-5222-4e02-9de0-8f9b47294ee6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:23.567523 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a183e-2d54-44c5-8f2a-c329865de1c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:23.568394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a183e-2d54-44c5-8f2a-c329865de1c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:23.568802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a183e-2d54-44c5-8f2a-c329865de1c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:23.569296 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a183e-2d54-44c5-8f2a-c329865de1c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:23.589269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a183e-2d54-44c5-8f2a-c329865de1c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:23.591784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a183e-2d54-44c5-8f2a-c329865de1c4 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:23.613936 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 992/1958] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:24.909412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ae98c-ce15-4318-9c7a-eb3e84372916 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:24.912533 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-541ae98c-ce15-4318-9c7a-eb3e84372916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:24.939651 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ae98c-ce15-4318-9c7a-eb3e84372916 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:24.946676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da1072-4c3a-4a41-82f2-4fbc48832bec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:24.947838 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da1072-4c3a-4a41-82f2-4fbc48832bec service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:24.948338 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da1072-4c3a-4a41-82f2-4fbc48832bec service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:24.948839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da1072-4c3a-4a41-82f2-4fbc48832bec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:24.963558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:25.174131 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da1072-4c3a-4a41-82f2-4fbc48832bec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:25.180231 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da1072-4c3a-4a41-82f2-4fbc48832bec service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:25.228604 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 967/1959] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:43:25.628902 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a183e-2d54-44c5-8f2a-c329865de1c4 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:25.632467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-449a183e-2d54-44c5-8f2a-c329865de1c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:25.740420 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a183e-2d54-44c5-8f2a-c329865de1c4 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:25.746647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77051b70-cac1-4eea-a1f2-a845097edbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:25.747772 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77051b70-cac1-4eea-a1f2-a845097edbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:25.748281 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77051b70-cac1-4eea-a1f2-a845097edbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:25.748595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77051b70-cac1-4eea-a1f2-a845097edbbf admin admin] PATH_INFO: `/v3/users/2a38cf3d1dae46deba126f31013abcca` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:25.750280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77051b70-cac1-4eea-a1f2-a845097edbbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a38cf3d1dae46deba126f31013abcca)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:25.753315 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77051b70-cac1-4eea-a1f2-a845097edbbf admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:25.816510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-77051b70-cac1-4eea-a1f2-a845097edbbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a38cf3d1dae46deba126f31013abcca'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:25.837301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-77051b70-cac1-4eea-a1f2-a845097edbbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a38cf3d1dae46deba126f31013abcca'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:25.838475 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-77051b70-cac1-4eea-a1f2-a845097edbbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a38cf3d1dae46deba126f31013abcca'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:25.850671 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-77051b70-cac1-4eea-a1f2-a845097edbbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a38cf3d1dae46deba126f31013abcca'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:25.852307 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-77051b70-cac1-4eea-a1f2-a845097edbbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a38cf3d1dae46deba126f31013abcca'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:25.874956 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 993/1960] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:25 2022] DELETE /identity/v3/users/2a38cf3d1dae46deba126f31013abcca => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:25.882218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4d57b-7776-459b-bb01-d5a94a90e7d9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:25.882962 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4d57b-7776-459b-bb01-d5a94a90e7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:25.883478 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4d57b-7776-459b-bb01-d5a94a90e7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:25.905870 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-aeb4d57b-7776-459b-bb01-d5a94a90e7d9 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:25.909515 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aeb4d57b-7776-459b-bb01-d5a94a90e7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:25.977230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 968/1961] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:25.991058 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77051b70-cac1-4eea-a1f2-a845097edbbf admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:25.992579 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-77051b70-cac1-4eea-a1f2-a845097edbbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:26.080320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77051b70-cac1-4eea-a1f2-a845097edbbf admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:26.084923 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75062e05-96d4-4aaf-8c9b-971411c168ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:26.086171 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75062e05-96d4-4aaf-8c9b-971411c168ba service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:26.086459 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75062e05-96d4-4aaf-8c9b-971411c168ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:26.086771 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75062e05-96d4-4aaf-8c9b-971411c168ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:26.109168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75062e05-96d4-4aaf-8c9b-971411c168ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:26.110815 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75062e05-96d4-4aaf-8c9b-971411c168ba service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:26.133396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 994/1962] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:26.695780 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4d57b-7776-459b-bb01-d5a94a90e7d9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:26.698451 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aeb4d57b-7776-459b-bb01-d5a94a90e7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:26.733927 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4d57b-7776-459b-bb01-d5a94a90e7d9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:26.775872 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4d1a4-35b6-4650-b6e3-3b32218c2e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:26.776870 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4d1a4-35b6-4650-b6e3-3b32218c2e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:26.777235 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4d1a4-35b6-4650-b6e3-3b32218c2e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:26.777614 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4d1a4-35b6-4650-b6e3-3b32218c2e1a admin admin] PATH_INFO: `/v3/projects/6190446fca0d481a9c8cbf40acd13db9` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:26.781243 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4d1a4-35b6-4650-b6e3-3b32218c2e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6190446fca0d481a9c8cbf40acd13db9)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:26.787382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4d1a4-35b6-4650-b6e3-3b32218c2e1a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:26.959066 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8ba4d1a4-35b6-4650-b6e3-3b32218c2e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6190446fca0d481a9c8cbf40acd13db9', 'request_id': 'req-8ba4d1a4-35b6-4650-b6e3-3b32218c2e1a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:26.983352 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8ba4d1a4-35b6-4650-b6e3-3b32218c2e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6190446fca0d481a9c8cbf40acd13db9', 'request_id': 'req-8ba4d1a4-35b6-4650-b6e3-3b32218c2e1a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:27.008836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8ba4d1a4-35b6-4650-b6e3-3b32218c2e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6190446fca0d481a9c8cbf40acd13db9', 'request_id': 'req-8ba4d1a4-35b6-4650-b6e3-3b32218c2e1a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:27.032106 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8ba4d1a4-35b6-4650-b6e3-3b32218c2e1a admin admin] The token cache is being invalidate because project 6190446fca0d481a9c8cbf40acd13db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:27.038379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8ba4d1a4-35b6-4650-b6e3-3b32218c2e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:27.042746 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8ba4d1a4-35b6-4650-b6e3-3b32218c2e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:27.058193 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 969/1963] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:26 2022] DELETE /identity/v3/projects/6190446fca0d481a9c8cbf40acd13db9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:27.065322 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75062e05-96d4-4aaf-8c9b-971411c168ba service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:27.103760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75062e05-96d4-4aaf-8c9b-971411c168ba service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:27.134476 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:27.237221 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2d35f-d667-4258-8d3b-745d95b604f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:27.238149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2d35f-d667-4258-8d3b-745d95b604f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:27.238436 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2d35f-d667-4258-8d3b-745d95b604f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:27.238997 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2d35f-d667-4258-8d3b-745d95b604f1 admin admin] PATH_INFO: `/v3/users/db69c602d4054ad8842ffac3a4be4768` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:27.240944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2d35f-d667-4258-8d3b-745d95b604f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db69c602d4054ad8842ffac3a4be4768)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:27.244110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2d35f-d667-4258-8d3b-745d95b604f1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:27.395594 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-34b2d35f-d667-4258-8d3b-745d95b604f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db69c602d4054ad8842ffac3a4be4768'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:27.421352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-34b2d35f-d667-4258-8d3b-745d95b604f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db69c602d4054ad8842ffac3a4be4768'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:27.422869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-34b2d35f-d667-4258-8d3b-745d95b604f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db69c602d4054ad8842ffac3a4be4768'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:27.436159 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-34b2d35f-d667-4258-8d3b-745d95b604f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db69c602d4054ad8842ffac3a4be4768'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:27.438897 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-34b2d35f-d667-4258-8d3b-745d95b604f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db69c602d4054ad8842ffac3a4be4768'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:27.464626 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 995/1964] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:27 2022] DELETE /identity/v3/users/db69c602d4054ad8842ffac3a4be4768 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:27.962886 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4d1a4-35b6-4650-b6e3-3b32218c2e1a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:27.964666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8ba4d1a4-35b6-4650-b6e3-3b32218c2e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:27.990658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4d1a4-35b6-4650-b6e3-3b32218c2e1a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:28.034142 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:28.086141 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68267f4c-c4d3-437f-be8c-11b636dc161c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:28.087959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68267f4c-c4d3-437f-be8c-11b636dc161c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:28.088502 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68267f4c-c4d3-437f-be8c-11b636dc161c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:28.089125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68267f4c-c4d3-437f-be8c-11b636dc161c admin admin] PATH_INFO: `/v3/projects/d02b80185b4a4eb4bf0d735b4f3c441a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:28.091740 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68267f4c-c4d3-437f-be8c-11b636dc161c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d02b80185b4a4eb4bf0d735b4f3c441a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:28.095389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68267f4c-c4d3-437f-be8c-11b636dc161c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:28.190446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-68267f4c-c4d3-437f-be8c-11b636dc161c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd02b80185b4a4eb4bf0d735b4f3c441a', 'request_id': 'req-68267f4c-c4d3-437f-be8c-11b636dc161c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:28.206273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-68267f4c-c4d3-437f-be8c-11b636dc161c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd02b80185b4a4eb4bf0d735b4f3c441a', 'request_id': 'req-68267f4c-c4d3-437f-be8c-11b636dc161c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:28.220776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-68267f4c-c4d3-437f-be8c-11b636dc161c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd02b80185b4a4eb4bf0d735b4f3c441a', 'request_id': 'req-68267f4c-c4d3-437f-be8c-11b636dc161c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:28.236666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-68267f4c-c4d3-437f-be8c-11b636dc161c admin admin] The token cache is being invalidate because project d02b80185b4a4eb4bf0d735b4f3c441a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:28.237581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-68267f4c-c4d3-437f-be8c-11b636dc161c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:28.239844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-68267f4c-c4d3-437f-be8c-11b636dc161c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:28.242299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 970/1965] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:27 2022] DELETE /identity/v3/projects/d02b80185b4a4eb4bf0d735b4f3c441a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:28.248886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b449e2-8614-47a8-b15a-5a765910df1a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:28.249508 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b449e2-8614-47a8-b15a-5a765910df1a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:28.250081 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b449e2-8614-47a8-b15a-5a765910df1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:28.287477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-80b449e2-8614-47a8-b15a-5a765910df1a None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:28.290544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-80b449e2-8614-47a8-b15a-5a765910df1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:28.396471 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 996/1966] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:28.409419 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5f08d-ba14-4259-bbcc-f778d6cfa7b9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:28.409711 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5f08d-ba14-4259-bbcc-f778d6cfa7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:28.409996 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5f08d-ba14-4259-bbcc-f778d6cfa7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:28.441677 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-88a5f08d-ba14-4259-bbcc-f778d6cfa7b9 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:28.444976 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-88a5f08d-ba14-4259-bbcc-f778d6cfa7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:28.458411 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 971/1967] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:28.466232 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b449e2-8614-47a8-b15a-5a765910df1a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:28.481065 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b449e2-8614-47a8-b15a-5a765910df1a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:28.487807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bbed4-ebaa-4933-8903-0d9698faf415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:28.488769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bbed4-ebaa-4933-8903-0d9698faf415 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:28.489443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bbed4-ebaa-4933-8903-0d9698faf415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:28.489963 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bbed4-ebaa-4933-8903-0d9698faf415 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:28.491444 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bbed4-ebaa-4933-8903-0d9698faf415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:28.491816 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bbed4-ebaa-4933-8903-0d9698faf415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:28.493615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bbed4-ebaa-4933-8903-0d9698faf415 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:28.509673 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 997/1968] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:43:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:28.519093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5f08d-ba14-4259-bbcc-f778d6cfa7b9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:28.538055 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5f08d-ba14-4259-bbcc-f778d6cfa7b9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:28.547015 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92751731-5778-4072-8ff9-b4f8bed1966c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:28.548073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92751731-5778-4072-8ff9-b4f8bed1966c admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:28.548554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92751731-5778-4072-8ff9-b4f8bed1966c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:28.548994 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92751731-5778-4072-8ff9-b4f8bed1966c admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:28.550153 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92751731-5778-4072-8ff9-b4f8bed1966c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:28.553555 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92751731-5778-4072-8ff9-b4f8bed1966c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:28.597345 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 972/1969] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:28 2022] POST /identity/v3/projects => generated 386 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:28.600286 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bbed4-ebaa-4933-8903-0d9698faf415 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:28.612180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bbed4-ebaa-4933-8903-0d9698faf415 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:28.634076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:28.736715 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5595e-65ad-455a-8b2d-12e421cda593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:28.738122 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5595e-65ad-455a-8b2d-12e421cda593 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:28.738907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5595e-65ad-455a-8b2d-12e421cda593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:28.739628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5595e-65ad-455a-8b2d-12e421cda593 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:28.741192 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5595e-65ad-455a-8b2d-12e421cda593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:28.758883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5595e-65ad-455a-8b2d-12e421cda593 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:28.814817 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 998/1970] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:28 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:43:28.829348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92751731-5778-4072-8ff9-b4f8bed1966c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:28.860035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92751731-5778-4072-8ff9-b4f8bed1966c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:28.874354 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77a313-177b-4f8e-a8bb-01efcf6fd452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:28.875331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77a313-177b-4f8e-a8bb-01efcf6fd452 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:28.875625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77a313-177b-4f8e-a8bb-01efcf6fd452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:28.875916 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77a313-177b-4f8e-a8bb-01efcf6fd452 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:28.876709 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77a313-177b-4f8e-a8bb-01efcf6fd452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:28.878761 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77a313-177b-4f8e-a8bb-01efcf6fd452 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:28.893060 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 973/1971] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:28 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:28.901071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5595e-65ad-455a-8b2d-12e421cda593 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:28.923309 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5595e-65ad-455a-8b2d-12e421cda593 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:28.934276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0faee-76e7-44e5-919a-c5fa2047a4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:28.935243 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0faee-76e7-44e5-919a-c5fa2047a4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:28.935673 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0faee-76e7-44e5-919a-c5fa2047a4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:28.936143 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0faee-76e7-44e5-919a-c5fa2047a4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:28.937664 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0faee-76e7-44e5-919a-c5fa2047a4a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:28.953789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0faee-76e7-44e5-919a-c5fa2047a4a9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:28.979269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 999/1972] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:28 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:28.985397 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77a313-177b-4f8e-a8bb-01efcf6fd452 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:29.009230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77a313-177b-4f8e-a8bb-01efcf6fd452 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:29.050294 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da98c8-2993-46d3-bc79-a890ac856fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:29.052096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da98c8-2993-46d3-bc79-a890ac856fef admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:29.052606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da98c8-2993-46d3-bc79-a890ac856fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:29.053217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da98c8-2993-46d3-bc79-a890ac856fef admin admin] PATH_INFO: `/v3/projects/73d4238730d84388bb10ea686a904cb4/users/11094e04c35b4f8cb65b46d13175f996/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:29.093778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da98c8-2993-46d3-bc79-a890ac856fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d4238730d84388bb10ea686a904cb4, user_id=11094e04c35b4f8cb65b46d13175f996, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:29.096856 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da98c8-2993-46d3-bc79-a890ac856fef admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:29.118550 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0faee-76e7-44e5-919a-c5fa2047a4a9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:29.125532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-87e0faee-76e7-44e5-919a-c5fa2047a4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:29.139998 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 974/1973] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:28 2022] PUT /identity/v3/projects/73d4238730d84388bb10ea686a904cb4/users/11094e04c35b4f8cb65b46d13175f996/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:29.172141 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c73be-02db-4523-9f35-e3878e1d4eaf None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:29.173016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c73be-02db-4523-9f35-e3878e1d4eaf None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:29.173655 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c73be-02db-4523-9f35-e3878e1d4eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:29.208690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f03c73be-02db-4523-9f35-e3878e1d4eaf None None] MFA Rules not processed for user `11094e04c35b4f8cb65b46d13175f996`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:29.211382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f03c73be-02db-4523-9f35-e3878e1d4eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:29.283105 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:29.336197 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 975/1974] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:29.344578 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c73be-02db-4523-9f35-e3878e1d4eaf None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:29.376513 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0faee-76e7-44e5-919a-c5fa2047a4a9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:29.513519 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c73be-02db-4523-9f35-e3878e1d4eaf None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:29.525288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a827665-e97f-4e41-b1f5-da34f7aa55ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:29.527064 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a827665-e97f-4e41-b1f5-da34f7aa55ed admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:29.527679 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a827665-e97f-4e41-b1f5-da34f7aa55ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:29.528302 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a827665-e97f-4e41-b1f5-da34f7aa55ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:29.529611 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a827665-e97f-4e41-b1f5-da34f7aa55ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:29.533108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a827665-e97f-4e41-b1f5-da34f7aa55ed admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:29.575519 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5070bc0-d023-4cf1-8235-68ccffd7881b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:29.577312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5070bc0-d023-4cf1-8235-68ccffd7881b service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:29.578037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5070bc0-d023-4cf1-8235-68ccffd7881b service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:29.578797 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5070bc0-d023-4cf1-8235-68ccffd7881b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:29.583968 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 976/1975] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:29 2022] POST /identity/v3/projects => generated 388 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:29.585230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a827665-e97f-4e41-b1f5-da34f7aa55ed admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:29.598475 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d5070bc0-d023-4cf1-8235-68ccffd7881b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:29.731544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5070bc0-d023-4cf1-8235-68ccffd7881b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:29.733871 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5070bc0-d023-4cf1-8235-68ccffd7881b service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:29.748536 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1000/1976] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:43:29.753037 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a827665-e97f-4e41-b1f5-da34f7aa55ed admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:29.763064 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1c17d-6351-4c62-8417-bed9d58df8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:29.764455 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1c17d-6351-4c62-8417-bed9d58df8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:29.765099 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1c17d-6351-4c62-8417-bed9d58df8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:29.765723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1c17d-6351-4c62-8417-bed9d58df8f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:29.767237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1c17d-6351-4c62-8417-bed9d58df8f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:29.771419 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1c17d-6351-4c62-8417-bed9d58df8f0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:29.806828 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 977/1977] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:29 2022] POST /identity/v3/users => generated 301 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:29.811208 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5070bc0-d023-4cf1-8235-68ccffd7881b service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:29.822437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:29.835707 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5070bc0-d023-4cf1-8235-68ccffd7881b service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:29.845259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db568bb-1aa2-46b8-8346-f2c906c5a565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:29.846415 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db568bb-1aa2-46b8-8346-f2c906c5a565 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:29.846961 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db568bb-1aa2-46b8-8346-f2c906c5a565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:29.850165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db568bb-1aa2-46b8-8346-f2c906c5a565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:29.850165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db568bb-1aa2-46b8-8346-f2c906c5a565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:29.852914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db568bb-1aa2-46b8-8346-f2c906c5a565 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:29.872695 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1001/1978] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:29 2022] GET /identity/v3/roles => generated 1427 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:43:29.876541 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1c17d-6351-4c62-8417-bed9d58df8f0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:29.891860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1c17d-6351-4c62-8417-bed9d58df8f0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:29.898434 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67863fd8-600e-4dfc-ad56-905fa2e2251a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:29.900072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67863fd8-600e-4dfc-ad56-905fa2e2251a admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:29.900622 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67863fd8-600e-4dfc-ad56-905fa2e2251a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:29.903351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67863fd8-600e-4dfc-ad56-905fa2e2251a admin admin] PATH_INFO: `/v3/projects/a031926cc58c4a38b8aa2beb869d5b31/users/2719964aa0cd4b70bc8cc936ed2c385b/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:29.933779 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67863fd8-600e-4dfc-ad56-905fa2e2251a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a031926cc58c4a38b8aa2beb869d5b31, user_id=2719964aa0cd4b70bc8cc936ed2c385b, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:29.938807 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67863fd8-600e-4dfc-ad56-905fa2e2251a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:29.974494 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 978/1979] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:29 2022] PUT /identity/v3/projects/a031926cc58c4a38b8aa2beb869d5b31/users/2719964aa0cd4b70bc8cc936ed2c385b/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:29.979964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db568bb-1aa2-46b8-8346-f2c906c5a565 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:30.003633 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db568bb-1aa2-46b8-8346-f2c906c5a565 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:30.127393 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9ee7a-f4ec-425a-8ad6-4fd6fcd4fb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:30.128794 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9ee7a-f4ec-425a-8ad6-4fd6fcd4fb38 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:30.129156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9ee7a-f4ec-425a-8ad6-4fd6fcd4fb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:30.129561 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9ee7a-f4ec-425a-8ad6-4fd6fcd4fb38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:30.130902 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9ee7a-f4ec-425a-8ad6-4fd6fcd4fb38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:30.133471 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9ee7a-f4ec-425a-8ad6-4fd6fcd4fb38 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:30.157225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1002/1980] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:29 2022] GET /identity/v3/roles => generated 1427 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:43:30.162097 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67863fd8-600e-4dfc-ad56-905fa2e2251a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:30.181954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67863fd8-600e-4dfc-ad56-905fa2e2251a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:30.190232 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609b24c-41cf-40c1-a7fd-b76476991d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:30.191988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609b24c-41cf-40c1-a7fd-b76476991d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:30.192493 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609b24c-41cf-40c1-a7fd-b76476991d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:30.192981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609b24c-41cf-40c1-a7fd-b76476991d88 admin admin] PATH_INFO: `/v3/projects/a031926cc58c4a38b8aa2beb869d5b31/users/2719964aa0cd4b70bc8cc936ed2c385b/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:30.196837 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609b24c-41cf-40c1-a7fd-b76476991d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a031926cc58c4a38b8aa2beb869d5b31, user_id=2719964aa0cd4b70bc8cc936ed2c385b, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:30.201929 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609b24c-41cf-40c1-a7fd-b76476991d88 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:30.234704 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 979/1981] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:30 2022] PUT /identity/v3/projects/a031926cc58c4a38b8aa2beb869d5b31/users/2719964aa0cd4b70bc8cc936ed2c385b/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:30.240241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f02a09-40a8-40bb-aa9e-8c2580ee6a5a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:30.240702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f02a09-40a8-40bb-aa9e-8c2580ee6a5a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:30.241093 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f02a09-40a8-40bb-aa9e-8c2580ee6a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:30.276519 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-06f02a09-40a8-40bb-aa9e-8c2580ee6a5a None None] MFA Rules not processed for user `2719964aa0cd4b70bc8cc936ed2c385b`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:30.278483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-06f02a09-40a8-40bb-aa9e-8c2580ee6a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:30.426968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1003/1982] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:30.493471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609b24c-41cf-40c1-a7fd-b76476991d88 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:30.542748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:30.595534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609b24c-41cf-40c1-a7fd-b76476991d88 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:30.606775 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522cd83-3b49-4d9d-a84d-bd9889091c5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:30.607453 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f02a09-40a8-40bb-aa9e-8c2580ee6a5a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:30.608122 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522cd83-3b49-4d9d-a84d-bd9889091c5d service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:30.608537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522cd83-3b49-4d9d-a84d-bd9889091c5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:30.609130 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-06f02a09-40a8-40bb-aa9e-8c2580ee6a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:30.609234 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522cd83-3b49-4d9d-a84d-bd9889091c5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:30.630166 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522cd83-3b49-4d9d-a84d-bd9889091c5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:30.631409 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f02a09-40a8-40bb-aa9e-8c2580ee6a5a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:30.631741 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522cd83-3b49-4d9d-a84d-bd9889091c5d service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:30.637733 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428042e-3d1f-4529-919c-b079d1cc4d8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:30.638928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428042e-3d1f-4529-919c-b079d1cc4d8d service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:30.639376 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428042e-3d1f-4529-919c-b079d1cc4d8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:30.639873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428042e-3d1f-4529-919c-b079d1cc4d8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:30.643630 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b428042e-3d1f-4529-919c-b079d1cc4d8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:30.648908 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 980/1983] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:30.739092 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428042e-3d1f-4529-919c-b079d1cc4d8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:30.740781 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428042e-3d1f-4529-919c-b079d1cc4d8d service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:30.764815 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1004/1984] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:32.110234 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522cd83-3b49-4d9d-a84d-bd9889091c5d service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:32.113837 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d522cd83-3b49-4d9d-a84d-bd9889091c5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:32.268027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522cd83-3b49-4d9d-a84d-bd9889091c5d service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:32.276269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428042e-3d1f-4529-919c-b079d1cc4d8d service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:32.276821 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815d1eb-cae7-418c-bcb4-48898e2eda59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:32.279207 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815d1eb-cae7-418c-bcb4-48898e2eda59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.279735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815d1eb-cae7-418c-bcb4-48898e2eda59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.280295 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815d1eb-cae7-418c-bcb4-48898e2eda59 admin admin] PATH_INFO: `/v3/users/f56d05aa8a2340b1b47f42222eac6924` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.282893 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815d1eb-cae7-418c-bcb4-48898e2eda59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f56d05aa8a2340b1b47f42222eac6924)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:32.286810 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815d1eb-cae7-418c-bcb4-48898e2eda59 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:32.289668 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428042e-3d1f-4529-919c-b079d1cc4d8d service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:32.297118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c80f09-4111-4a04-975c-0822cf8e60f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:32.299211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c80f09-4111-4a04-975c-0822cf8e60f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.299980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c80f09-4111-4a04-975c-0822cf8e60f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.300491 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c80f09-4111-4a04-975c-0822cf8e60f2 admin admin] PATH_INFO: `/v3/users/11094e04c35b4f8cb65b46d13175f996` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.302797 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c80f09-4111-4a04-975c-0822cf8e60f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11094e04c35b4f8cb65b46d13175f996)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:32.307610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c80f09-4111-4a04-975c-0822cf8e60f2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:32.316903 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:32.387203 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d815d1eb-cae7-418c-bcb4-48898e2eda59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f56d05aa8a2340b1b47f42222eac6924'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:32.388423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d815d1eb-cae7-418c-bcb4-48898e2eda59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f56d05aa8a2340b1b47f42222eac6924'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:32.399742 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-09c80f09-4111-4a04-975c-0822cf8e60f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11094e04c35b4f8cb65b46d13175f996'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:32.402332 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d815d1eb-cae7-418c-bcb4-48898e2eda59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f56d05aa8a2340b1b47f42222eac6924'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:32.403853 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d815d1eb-cae7-418c-bcb4-48898e2eda59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f56d05aa8a2340b1b47f42222eac6924'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:32.421165 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d815d1eb-cae7-418c-bcb4-48898e2eda59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f56d05aa8a2340b1b47f42222eac6924'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:32.438030 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-09c80f09-4111-4a04-975c-0822cf8e60f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11094e04c35b4f8cb65b46d13175f996'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:32.441749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-09c80f09-4111-4a04-975c-0822cf8e60f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11094e04c35b4f8cb65b46d13175f996'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:32.457223 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-09c80f09-4111-4a04-975c-0822cf8e60f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11094e04c35b4f8cb65b46d13175f996'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:32.458246 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-09c80f09-4111-4a04-975c-0822cf8e60f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11094e04c35b4f8cb65b46d13175f996'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:32.470059 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 981/1985] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:32 2022] DELETE /identity/v3/users/f56d05aa8a2340b1b47f42222eac6924 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:32.474372 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1005/1986] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:32 2022] DELETE /identity/v3/users/11094e04c35b4f8cb65b46d13175f996 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:32.479077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a3b1f-89f8-45e2-adda-cf09193da2af None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.479439 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a3b1f-89f8-45e2-adda-cf09193da2af None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.479744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbad1d-5ab8-4f17-94a3-639d19e9890c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.479896 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a3b1f-89f8-45e2-adda-cf09193da2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.480046 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbad1d-5ab8-4f17-94a3-639d19e9890c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.480422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbad1d-5ab8-4f17-94a3-639d19e9890c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.516520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-54dbad1d-5ab8-4f17-94a3-639d19e9890c None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:32.519204 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-54dbad1d-5ab8-4f17-94a3-639d19e9890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:32.520080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b13a3b1f-89f8-45e2-adda-cf09193da2af None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:32.521323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b13a3b1f-89f8-45e2-adda-cf09193da2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:32.598989 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:32.649543 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 982/1987] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:32.664643 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a3b1f-89f8-45e2-adda-cf09193da2af None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:32.666476 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b13a3b1f-89f8-45e2-adda-cf09193da2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:32.681696 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1006/1988] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:32.703622 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbad1d-5ab8-4f17-94a3-639d19e9890c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:32.706534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-54dbad1d-5ab8-4f17-94a3-639d19e9890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:32.799252 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a3b1f-89f8-45e2-adda-cf09193da2af None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:32.807783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e4988-7fa2-46b3-a4b1-441b83a36a5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:32.809890 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e4988-7fa2-46b3-a4b1-441b83a36a5d service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.811186 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e4988-7fa2-46b3-a4b1-441b83a36a5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.811801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e4988-7fa2-46b3-a4b1-441b83a36a5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.832254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e4988-7fa2-46b3-a4b1-441b83a36a5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:32.833887 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e4988-7fa2-46b3-a4b1-441b83a36a5d service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:32.847368 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 983/1989] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:43:32.848981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e67a9-0578-47c2-8379-76d5089e4ee2 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.849334 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e67a9-0578-47c2-8379-76d5089e4ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.849679 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e67a9-0578-47c2-8379-76d5089e4ee2 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.852431 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 984/1990] 10.222.0.110 () {54 vars in 926 bytes} [Thu May 26 16:43:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:43:32.889212 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbad1d-5ab8-4f17-94a3-639d19e9890c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:32.895985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a64a7-a052-44b6-b72c-0ea9bbd00272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:32.898170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a64a7-a052-44b6-b72c-0ea9bbd00272 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.898814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a64a7-a052-44b6-b72c-0ea9bbd00272 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.899391 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a64a7-a052-44b6-b72c-0ea9bbd00272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.908192 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc65c5-c81c-41c0-b5d4-ed7524dba357 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.909192 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc65c5-c81c-41c0-b5d4-ed7524dba357 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.909696 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc65c5-c81c-41c0-b5d4-ed7524dba357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.942353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a64a7-a052-44b6-b72c-0ea9bbd00272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:32.944217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b9dc65c5-c81c-41c0-b5d4-ed7524dba357 None None] MFA Rules not processed for user `9ffef7640dd1487ab2ea91fc0f4be9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:32.945040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a64a7-a052-44b6-b72c-0ea9bbd00272 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:32.947237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b9dc65c5-c81c-41c0-b5d4-ed7524dba357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:32.974067 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1007/1991] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:32.975121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a64a7-a052-44b6-b72c-0ea9bbd00272 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:32.977613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d53a64a7-a052-44b6-b72c-0ea9bbd00272 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:32.997948 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a64a7-a052-44b6-b72c-0ea9bbd00272 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:33.004133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779da84-c5ca-49b5-a4d8-dea8d612f420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:33.005080 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779da84-c5ca-49b5-a4d8-dea8d612f420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:33.005393 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779da84-c5ca-49b5-a4d8-dea8d612f420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:33.005641 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779da84-c5ca-49b5-a4d8-dea8d612f420 admin admin] PATH_INFO: `/v3/users/d1c1bf4c8bac47129cbd0fb58eb29035` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:33.007429 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779da84-c5ca-49b5-a4d8-dea8d612f420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c1bf4c8bac47129cbd0fb58eb29035)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:33.011387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779da84-c5ca-49b5-a4d8-dea8d612f420 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:33.061771 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:33.118457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 985/1992] 10.222.0.110 () {58 vars in 1023 bytes} [Thu May 26 16:43:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:33.146494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5779da84-c5ca-49b5-a4d8-dea8d612f420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c1bf4c8bac47129cbd0fb58eb29035'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:33.149738 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc65c5-c81c-41c0-b5d4-ed7524dba357 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:33.154086 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b9dc65c5-c81c-41c0-b5d4-ed7524dba357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:33.180023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5779da84-c5ca-49b5-a4d8-dea8d612f420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c1bf4c8bac47129cbd0fb58eb29035'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:33.183047 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5779da84-c5ca-49b5-a4d8-dea8d612f420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c1bf4c8bac47129cbd0fb58eb29035'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:33.202402 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc65c5-c81c-41c0-b5d4-ed7524dba357 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:33.211609 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5779da84-c5ca-49b5-a4d8-dea8d612f420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c1bf4c8bac47129cbd0fb58eb29035'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:33.213888 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5779da84-c5ca-49b5-a4d8-dea8d612f420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c1bf4c8bac47129cbd0fb58eb29035'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:33.228134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5363ad-9358-44d9-b312-0fd5e99d2ac6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ffef7640dd1487ab2ea91fc0f4be9e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:33.229426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5363ad-9358-44d9-b312-0fd5e99d2ac6 service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:33.229927 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5363ad-9358-44d9-b312-0fd5e99d2ac6 service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:33.230454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5363ad-9358-44d9-b312-0fd5e99d2ac6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:33.233773 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1008/1993] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:32 2022] DELETE /identity/v3/users/d1c1bf4c8bac47129cbd0fb58eb29035 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:33.237121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0c5363ad-9358-44d9-b312-0fd5e99d2ac6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:33.262103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5363ad-9358-44d9-b312-0fd5e99d2ac6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:33.264113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5363ad-9358-44d9-b312-0fd5e99d2ac6 service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:33.289179 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 986/1994] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:43:33.696386 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779da84-c5ca-49b5-a4d8-dea8d612f420 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:33.698753 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5779da84-c5ca-49b5-a4d8-dea8d612f420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:33.781965 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5363ad-9358-44d9-b312-0fd5e99d2ac6 service placement] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:33.788875 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0c5363ad-9358-44d9-b312-0fd5e99d2ac6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:33.835789 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5363ad-9358-44d9-b312-0fd5e99d2ac6 service placement] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:33.858639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82475cb1-1391-4d3c-a4d7-a3669fe6a498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:33.860230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82475cb1-1391-4d3c-a4d7-a3669fe6a498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:33.860798 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82475cb1-1391-4d3c-a4d7-a3669fe6a498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:33.861257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82475cb1-1391-4d3c-a4d7-a3669fe6a498 admin admin] PATH_INFO: `/v3/projects/dd67c8128e8f4b08b818a1163073a179` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:33.868273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82475cb1-1391-4d3c-a4d7-a3669fe6a498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd67c8128e8f4b08b818a1163073a179)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:33.871404 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82475cb1-1391-4d3c-a4d7-a3669fe6a498 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:33.875166 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779da84-c5ca-49b5-a4d8-dea8d612f420 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:33.884398 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead1ee5-bd6c-4343-95c1-640baa804226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:33.886684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead1ee5-bd6c-4343-95c1-640baa804226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:33.887292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead1ee5-bd6c-4343-95c1-640baa804226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:33.888042 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead1ee5-bd6c-4343-95c1-640baa804226 admin admin] PATH_INFO: `/v3/projects/c8740cea7f324d248c18313c906aae22` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:33.890614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead1ee5-bd6c-4343-95c1-640baa804226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8740cea7f324d248c18313c906aae22)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:33.895302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead1ee5-bd6c-4343-95c1-640baa804226 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:33.973772 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-82475cb1-1391-4d3c-a4d7-a3669fe6a498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd67c8128e8f4b08b818a1163073a179', 'request_id': 'req-82475cb1-1391-4d3c-a4d7-a3669fe6a498'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:33.991467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-82475cb1-1391-4d3c-a4d7-a3669fe6a498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd67c8128e8f4b08b818a1163073a179', 'request_id': 'req-82475cb1-1391-4d3c-a4d7-a3669fe6a498'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:34.002319 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3ead1ee5-bd6c-4343-95c1-640baa804226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8740cea7f324d248c18313c906aae22', 'request_id': 'req-3ead1ee5-bd6c-4343-95c1-640baa804226'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:34.007294 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-82475cb1-1391-4d3c-a4d7-a3669fe6a498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd67c8128e8f4b08b818a1163073a179', 'request_id': 'req-82475cb1-1391-4d3c-a4d7-a3669fe6a498'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:34.016159 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:34.029169 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3ead1ee5-bd6c-4343-95c1-640baa804226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8740cea7f324d248c18313c906aae22', 'request_id': 'req-3ead1ee5-bd6c-4343-95c1-640baa804226'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:34.035035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-82475cb1-1391-4d3c-a4d7-a3669fe6a498 admin admin] The token cache is being invalidate because project dd67c8128e8f4b08b818a1163073a179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:34.035672 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-82475cb1-1391-4d3c-a4d7-a3669fe6a498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:34.036987 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-82475cb1-1391-4d3c-a4d7-a3669fe6a498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:34.040364 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 987/1995] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:33 2022] DELETE /identity/v3/projects/dd67c8128e8f4b08b818a1163073a179 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:34.047519 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3ead1ee5-bd6c-4343-95c1-640baa804226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8740cea7f324d248c18313c906aae22', 'request_id': 'req-3ead1ee5-bd6c-4343-95c1-640baa804226'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:34.049922 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb0cec-29d3-44aa-9eb3-877f064b6f1e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:34.050670 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb0cec-29d3-44aa-9eb3-877f064b6f1e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:34.051539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb0cec-29d3-44aa-9eb3-877f064b6f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:34.077228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3ead1ee5-bd6c-4343-95c1-640baa804226 admin admin] The token cache is being invalidate because project c8740cea7f324d248c18313c906aae22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:34.077949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3ead1ee5-bd6c-4343-95c1-640baa804226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:34.079053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3ead1ee5-bd6c-4343-95c1-640baa804226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:34.081595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1009/1996] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:33 2022] DELETE /identity/v3/projects/c8740cea7f324d248c18313c906aae22 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:34.089624 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8663687-5ca6-4a92-9a35-9ba9f16a5415 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:34.090194 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8663687-5ca6-4a92-9a35-9ba9f16a5415 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:34.090662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8663687-5ca6-4a92-9a35-9ba9f16a5415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:34.099020 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ccbb0cec-29d3-44aa-9eb3-877f064b6f1e None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:34.101471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ccbb0cec-29d3-44aa-9eb3-877f064b6f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:34.128196 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c8663687-5ca6-4a92-9a35-9ba9f16a5415 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:34.132305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c8663687-5ca6-4a92-9a35-9ba9f16a5415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:34.184982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:34.249075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 988/1997] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:34.250070 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb0cec-29d3-44aa-9eb3-877f064b6f1e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:34.251555 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ccbb0cec-29d3-44aa-9eb3-877f064b6f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:34.266539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb0cec-29d3-44aa-9eb3-877f064b6f1e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:34.271736 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15174304-2eb7-4957-a0f0-e1c0114e1b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:34.273196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15174304-2eb7-4957-a0f0-e1c0114e1b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:34.273451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1010/1998] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:34.276175 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d02bd8-4387-4bf3-b66c-fb380853cbb6 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:34.276813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d02bd8-4387-4bf3-b66c-fb380853cbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:34.279270 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d02bd8-4387-4bf3-b66c-fb380853cbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:34.279831 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15174304-2eb7-4957-a0f0-e1c0114e1b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:34.280061 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15174304-2eb7-4957-a0f0-e1c0114e1b49 admin admin] PATH_INFO: `/v3/users/6b1459ef233b497ebb8503f32d7a3086` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:34.281602 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15174304-2eb7-4957-a0f0-e1c0114e1b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b1459ef233b497ebb8503f32d7a3086)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:34.283604 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15174304-2eb7-4957-a0f0-e1c0114e1b49 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:34.320232 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-49d02bd8-4387-4bf3-b66c-fb380853cbb6 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:34.321911 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-49d02bd8-4387-4bf3-b66c-fb380853cbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:34.339190 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1011/1999] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:34.341602 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c460b-09e8-4788-b395-92082db1cad3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:34.342051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c460b-09e8-4788-b395-92082db1cad3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:34.342612 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c460b-09e8-4788-b395-92082db1cad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:34.365150 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-15174304-2eb7-4957-a0f0-e1c0114e1b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b1459ef233b497ebb8503f32d7a3086'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:34.369039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-15174304-2eb7-4957-a0f0-e1c0114e1b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b1459ef233b497ebb8503f32d7a3086'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:34.381350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-574c460b-09e8-4788-b395-92082db1cad3 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:34.383445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-574c460b-09e8-4788-b395-92082db1cad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:34.390225 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-15174304-2eb7-4957-a0f0-e1c0114e1b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b1459ef233b497ebb8503f32d7a3086'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:34.391426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-15174304-2eb7-4957-a0f0-e1c0114e1b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b1459ef233b497ebb8503f32d7a3086'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:34.396421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1012/2000] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:34.399288 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c460b-09e8-4788-b395-92082db1cad3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:34.403245 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-574c460b-09e8-4788-b395-92082db1cad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:34.408009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-15174304-2eb7-4957-a0f0-e1c0114e1b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b1459ef233b497ebb8503f32d7a3086'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:34.425148 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c460b-09e8-4788-b395-92082db1cad3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:34.433564 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265b81e-8b5d-4898-9eab-cfc256c06d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:34.435113 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265b81e-8b5d-4898-9eab-cfc256c06d78 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:34.435532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265b81e-8b5d-4898-9eab-cfc256c06d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:34.435892 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265b81e-8b5d-4898-9eab-cfc256c06d78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:34.437016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265b81e-8b5d-4898-9eab-cfc256c06d78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:34.438536 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265b81e-8b5d-4898-9eab-cfc256c06d78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:34.441326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265b81e-8b5d-4898-9eab-cfc256c06d78 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:34.453378 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 989/2001] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:34 2022] DELETE /identity/v3/users/6b1459ef233b497ebb8503f32d7a3086 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:34.455130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15174304-2eb7-4957-a0f0-e1c0114e1b49 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:34.458551 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1013/2002] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:43:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:34.460759 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e813f0-7f62-4a30-833a-df45fb6e9972 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:34.461151 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e813f0-7f62-4a30-833a-df45fb6e9972 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:34.461513 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e813f0-7f62-4a30-833a-df45fb6e9972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:34.500266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-13e813f0-7f62-4a30-833a-df45fb6e9972 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:34.501949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-13e813f0-7f62-4a30-833a-df45fb6e9972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:34.610116 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1014/2003] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:34.611350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e813f0-7f62-4a30-833a-df45fb6e9972 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:34.619828 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15174304-2eb7-4957-a0f0-e1c0114e1b49 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:34.632421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e813f0-7f62-4a30-833a-df45fb6e9972 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:34.635255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c4dc7-260d-4dbb-b35d-24f9af518306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:34.635951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c4dc7-260d-4dbb-b35d-24f9af518306 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:34.636240 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c4dc7-260d-4dbb-b35d-24f9af518306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:34.636527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c4dc7-260d-4dbb-b35d-24f9af518306 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:34.637269 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c4dc7-260d-4dbb-b35d-24f9af518306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:34.637587 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c4dc7-260d-4dbb-b35d-24f9af518306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:34.639869 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c4dc7-260d-4dbb-b35d-24f9af518306 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:34.651667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49224339-d901-4374-a0db-c94f291d8fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:34.652361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49224339-d901-4374-a0db-c94f291d8fba admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:34.652521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:34.652653 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49224339-d901-4374-a0db-c94f291d8fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:34.652914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49224339-d901-4374-a0db-c94f291d8fba admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:34.654086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49224339-d901-4374-a0db-c94f291d8fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:34.660959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49224339-d901-4374-a0db-c94f291d8fba admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:34.661610 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 990/2004] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:43:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:34.663591 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c4dc7-260d-4dbb-b35d-24f9af518306 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:34.665503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1f5c4dc7-260d-4dbb-b35d-24f9af518306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:34.679700 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c4dc7-260d-4dbb-b35d-24f9af518306 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:34.685207 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3d9fd-8dd9-496d-9baf-d56366846c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:34.686173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3d9fd-8dd9-496d-9baf-d56366846c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:34.686527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3d9fd-8dd9-496d-9baf-d56366846c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:34.686927 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3d9fd-8dd9-496d-9baf-d56366846c79 admin admin] PATH_INFO: `/v3/projects/73d4238730d84388bb10ea686a904cb4` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:34.688335 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3d9fd-8dd9-496d-9baf-d56366846c79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d4238730d84388bb10ea686a904cb4)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:34.691458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3d9fd-8dd9-496d-9baf-d56366846c79 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:34.727560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1015/2005] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:34 2022] POST /identity/v3/projects => generated 364 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:34.729194 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49224339-d901-4374-a0db-c94f291d8fba admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:34.737192 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-49224339-d901-4374-a0db-c94f291d8fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:34.758235 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-33d3d9fd-8dd9-496d-9baf-d56366846c79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d4238730d84388bb10ea686a904cb4', 'request_id': 'req-33d3d9fd-8dd9-496d-9baf-d56366846c79'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:34.767754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-33d3d9fd-8dd9-496d-9baf-d56366846c79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d4238730d84388bb10ea686a904cb4', 'request_id': 'req-33d3d9fd-8dd9-496d-9baf-d56366846c79'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:34.778625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-33d3d9fd-8dd9-496d-9baf-d56366846c79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d4238730d84388bb10ea686a904cb4', 'request_id': 'req-33d3d9fd-8dd9-496d-9baf-d56366846c79'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:34.803281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-33d3d9fd-8dd9-496d-9baf-d56366846c79 admin admin] The token cache is being invalidate because project 73d4238730d84388bb10ea686a904cb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:34.803281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-33d3d9fd-8dd9-496d-9baf-d56366846c79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:34.804141 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-33d3d9fd-8dd9-496d-9baf-d56366846c79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:34.807942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 991/2006] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:34 2022] DELETE /identity/v3/projects/73d4238730d84388bb10ea686a904cb4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:34.809940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3d9fd-8dd9-496d-9baf-d56366846c79 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:34.813983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-33d3d9fd-8dd9-496d-9baf-d56366846c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:34.824771 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49224339-d901-4374-a0db-c94f291d8fba admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:34.874267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:34.905745 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cd04f-f227-4427-9376-af2cb5fc69fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:34.906935 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cd04f-f227-4427-9376-af2cb5fc69fa service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:34.907836 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cd04f-f227-4427-9376-af2cb5fc69fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:34.908741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cd04f-f227-4427-9376-af2cb5fc69fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:34.916360 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-087cd04f-f227-4427-9376-af2cb5fc69fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:34.955618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3d9fd-8dd9-496d-9baf-d56366846c79 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:34.963829 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb730915-f83d-4bec-a6ac-a6fd4b3374c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:34.964804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb730915-f83d-4bec-a6ac-a6fd4b3374c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:34.965651 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb730915-f83d-4bec-a6ac-a6fd4b3374c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:34.966222 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb730915-f83d-4bec-a6ac-a6fd4b3374c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:34.968073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb730915-f83d-4bec-a6ac-a6fd4b3374c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:34.971486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb730915-f83d-4bec-a6ac-a6fd4b3374c8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:35.016196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 992/2007] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:34 2022] POST /identity/v3/projects => generated 394 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:35.017730 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb730915-f83d-4bec-a6ac-a6fd4b3374c8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:35.025321 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fb730915-f83d-4bec-a6ac-a6fd4b3374c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:35.036321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cd04f-f227-4427-9376-af2cb5fc69fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:35.038953 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cd04f-f227-4427-9376-af2cb5fc69fa service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:35.055077 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1016/2008] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:35.055731 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cd04f-f227-4427-9376-af2cb5fc69fa service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:35.057284 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-087cd04f-f227-4427-9376-af2cb5fc69fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:35.076427 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cd04f-f227-4427-9376-af2cb5fc69fa service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:35.178914 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb730915-f83d-4bec-a6ac-a6fd4b3374c8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:35.188246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1980c47-7bca-4502-a697-992ba5058bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:35.190077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1980c47-7bca-4502-a697-992ba5058bec admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:35.190900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1980c47-7bca-4502-a697-992ba5058bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:35.192015 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1980c47-7bca-4502-a697-992ba5058bec admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:35.193917 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1980c47-7bca-4502-a697-992ba5058bec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:35.198023 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1980c47-7bca-4502-a697-992ba5058bec admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:35.220967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:35.229881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 993/2009] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:35 2022] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:35.231847 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1980c47-7bca-4502-a697-992ba5058bec admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:35.247888 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c138b1-cfb8-4fde-b21e-93051aae76fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:35.249734 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c138b1-cfb8-4fde-b21e-93051aae76fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:35.250337 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c138b1-cfb8-4fde-b21e-93051aae76fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:35.251129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c138b1-cfb8-4fde-b21e-93051aae76fd admin admin] PATH_INFO: `/v3/users/2719964aa0cd4b70bc8cc936ed2c385b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:35.254440 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c138b1-cfb8-4fde-b21e-93051aae76fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2719964aa0cd4b70bc8cc936ed2c385b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:35.258795 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c138b1-cfb8-4fde-b21e-93051aae76fd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:35.262072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1980c47-7bca-4502-a697-992ba5058bec admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:35.269907 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441bc3c-0c39-4849-9b06-ae58c948c7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:35.270690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441bc3c-0c39-4849-9b06-ae58c948c7cc admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:35.271009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441bc3c-0c39-4849-9b06-ae58c948c7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:35.271482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441bc3c-0c39-4849-9b06-ae58c948c7cc admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:35.272386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441bc3c-0c39-4849-9b06-ae58c948c7cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:35.276409 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441bc3c-0c39-4849-9b06-ae58c948c7cc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:35.306616 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 994/2010] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:35 2022] POST /identity/v3/users => generated 298 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:35.306616 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441bc3c-0c39-4849-9b06-ae58c948c7cc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:35.332754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441bc3c-0c39-4849-9b06-ae58c948c7cc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:35.349130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1954d-0f86-44fa-b4dc-370226ffeb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:35.353101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1954d-0f86-44fa-b4dc-370226ffeb09 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:35.353577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1954d-0f86-44fa-b4dc-370226ffeb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:35.354821 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1954d-0f86-44fa-b4dc-370226ffeb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:35.356194 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-67c138b1-cfb8-4fde-b21e-93051aae76fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2719964aa0cd4b70bc8cc936ed2c385b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:35.356745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1954d-0f86-44fa-b4dc-370226ffeb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:35.360042 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1954d-0f86-44fa-b4dc-370226ffeb09 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:35.380426 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-67c138b1-cfb8-4fde-b21e-93051aae76fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2719964aa0cd4b70bc8cc936ed2c385b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:35.381609 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-67c138b1-cfb8-4fde-b21e-93051aae76fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2719964aa0cd4b70bc8cc936ed2c385b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:35.384534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 995/2011] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:35 2022] GET /identity/v3/roles => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:35.386284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1954d-0f86-44fa-b4dc-370226ffeb09 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:35.389447 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e7e1954d-0f86-44fa-b4dc-370226ffeb09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:35.395115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-67c138b1-cfb8-4fde-b21e-93051aae76fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2719964aa0cd4b70bc8cc936ed2c385b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:35.398734 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-67c138b1-cfb8-4fde-b21e-93051aae76fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2719964aa0cd4b70bc8cc936ed2c385b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:35.408393 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1954d-0f86-44fa-b4dc-370226ffeb09 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:35.415949 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f49145-559c-41a2-be67-61fe1c2d4305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:35.416925 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f49145-559c-41a2-be67-61fe1c2d4305 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:35.417216 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f49145-559c-41a2-be67-61fe1c2d4305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:35.417501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f49145-559c-41a2-be67-61fe1c2d4305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:35.418313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f49145-559c-41a2-be67-61fe1c2d4305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:35.421093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f49145-559c-41a2-be67-61fe1c2d4305 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:35.430421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1017/2012] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:35 2022] DELETE /identity/v3/users/2719964aa0cd4b70bc8cc936ed2c385b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:35.430421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c138b1-cfb8-4fde-b21e-93051aae76fd admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:35.430421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-67c138b1-cfb8-4fde-b21e-93051aae76fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:35.450304 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 996/2013] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:35 2022] GET /identity/v3/roles => generated 1427 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:35.455596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f49145-559c-41a2-be67-61fe1c2d4305 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:35.456406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:35.476342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f49145-559c-41a2-be67-61fe1c2d4305 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:35.578404 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c138b1-cfb8-4fde-b21e-93051aae76fd admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:35.587053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d7881-61cf-4761-80c3-6fce50a573f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:35.588037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d7881-61cf-4761-80c3-6fce50a573f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:35.588392 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d7881-61cf-4761-80c3-6fce50a573f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:35.588822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d7881-61cf-4761-80c3-6fce50a573f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:35.589024 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e0f8e-6705-4c54-a1c9-a4dfc5c854f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:35.589807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d7881-61cf-4761-80c3-6fce50a573f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:35.590862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e0f8e-6705-4c54-a1c9-a4dfc5c854f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:35.590862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e0f8e-6705-4c54-a1c9-a4dfc5c854f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:35.591352 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e0f8e-6705-4c54-a1c9-a4dfc5c854f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:35.592302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d7881-61cf-4761-80c3-6fce50a573f0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:35.592675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e0f8e-6705-4c54-a1c9-a4dfc5c854f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:35.596643 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e0f8e-6705-4c54-a1c9-a4dfc5c854f9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:35.613970 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1018/2015] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:35 2022] GET /identity/v3/roles => generated 1427 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:35.616809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d7881-61cf-4761-80c3-6fce50a573f0 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:35.617811 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 997/2015] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:35 2022] GET /identity/v3/roles => generated 1427 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:43:35.619012 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e0f8e-6705-4c54-a1c9-a4dfc5c854f9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:35.620702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4c8d7881-61cf-4761-80c3-6fce50a573f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:35.636053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e0f8e-6705-4c54-a1c9-a4dfc5c854f9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:35.640436 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d7881-61cf-4761-80c3-6fce50a573f0 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:35.642768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869de6d2-cb9b-4841-95ec-8307e3345432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:35.643877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869de6d2-cb9b-4841-95ec-8307e3345432 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:35.644167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869de6d2-cb9b-4841-95ec-8307e3345432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:35.644443 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869de6d2-cb9b-4841-95ec-8307e3345432 admin admin] PATH_INFO: `/v3/projects/2156757ac65f40f995b01b9ad6b943f5/users/77d30a8a09c44b40a2e32065e5fcde64/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:35.648782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb9df2-e90e-4071-b32f-fdace0852673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:35.650116 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb9df2-e90e-4071-b32f-fdace0852673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:35.650662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb9df2-e90e-4071-b32f-fdace0852673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:35.651246 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb9df2-e90e-4071-b32f-fdace0852673 admin admin] PATH_INFO: `/v3/projects/f6b18c48701747bda2745db7e3d51db7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:35.653047 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb9df2-e90e-4071-b32f-fdace0852673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b18c48701747bda2745db7e3d51db7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:35.656386 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb9df2-e90e-4071-b32f-fdace0852673 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:35.669474 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869de6d2-cb9b-4841-95ec-8307e3345432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2156757ac65f40f995b01b9ad6b943f5, user_id=77d30a8a09c44b40a2e32065e5fcde64, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:35.673851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869de6d2-cb9b-4841-95ec-8307e3345432 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:35.702706 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 998/2016] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:35 2022] PUT /identity/v3/projects/2156757ac65f40f995b01b9ad6b943f5/users/77d30a8a09c44b40a2e32065e5fcde64/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:35.702706 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869de6d2-cb9b-4841-95ec-8307e3345432 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:35.757723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3beb9df2-e90e-4071-b32f-fdace0852673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b18c48701747bda2745db7e3d51db7', 'request_id': 'req-3beb9df2-e90e-4071-b32f-fdace0852673'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:35.765731 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3beb9df2-e90e-4071-b32f-fdace0852673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b18c48701747bda2745db7e3d51db7', 'request_id': 'req-3beb9df2-e90e-4071-b32f-fdace0852673'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:35.773008 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3beb9df2-e90e-4071-b32f-fdace0852673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b18c48701747bda2745db7e3d51db7', 'request_id': 'req-3beb9df2-e90e-4071-b32f-fdace0852673'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:35.790747 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3beb9df2-e90e-4071-b32f-fdace0852673 admin admin] The token cache is being invalidate because project f6b18c48701747bda2745db7e3d51db7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:35.791600 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3beb9df2-e90e-4071-b32f-fdace0852673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:35.792280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3beb9df2-e90e-4071-b32f-fdace0852673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:35.794987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1019/2017] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:35 2022] DELETE /identity/v3/projects/f6b18c48701747bda2745db7e3d51db7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:35.796373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6922-7dd9-497e-8d2e-56d723bc985b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:35.796669 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6922-7dd9-497e-8d2e-56d723bc985b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:35.796952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6922-7dd9-497e-8d2e-56d723bc985b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:35.826535 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869de6d2-cb9b-4841-95ec-8307e3345432 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:35.840710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-91ed6922-7dd9-497e-8d2e-56d723bc985b None None] MFA Rules not processed for user `77d30a8a09c44b40a2e32065e5fcde64`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:35.843096 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-91ed6922-7dd9-497e-8d2e-56d723bc985b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:35.905198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:35.956573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c66e9-5563-4778-8acd-859d0a1c1dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:35.958878 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c66e9-5563-4778-8acd-859d0a1c1dda admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:35.960316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c66e9-5563-4778-8acd-859d0a1c1dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:35.961937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c66e9-5563-4778-8acd-859d0a1c1dda admin admin] PATH_INFO: `/v3/projects/ae85b68d75094b0f8ae94a86c4b1f36e/users/713e3f20f94849c5bb6b88ba5af39868/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.020527 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1020/2018] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:36.022205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed6922-7dd9-497e-8d2e-56d723bc985b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:36.023713 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c66e9-5563-4778-8acd-859d0a1c1dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae85b68d75094b0f8ae94a86c4b1f36e, user_id=713e3f20f94849c5bb6b88ba5af39868, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:36.028435 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-91ed6922-7dd9-497e-8d2e-56d723bc985b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:36.031403 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c66e9-5563-4778-8acd-859d0a1c1dda admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:36.053065 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed6922-7dd9-497e-8d2e-56d723bc985b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:36.054405 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 999/2019] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:35 2022] PUT /identity/v3/projects/ae85b68d75094b0f8ae94a86c4b1f36e/users/713e3f20f94849c5bb6b88ba5af39868/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:36.055297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c66e9-5563-4778-8acd-859d0a1c1dda admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:36.057172 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-eb1c66e9-5563-4778-8acd-859d0a1c1dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:36.071275 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:36.136459 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51ad69-6c8e-4d3a-9cfe-c06fd2cb4b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:36.139412 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51ad69-6c8e-4d3a-9cfe-c06fd2cb4b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.139412 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51ad69-6c8e-4d3a-9cfe-c06fd2cb4b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.139412 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51ad69-6c8e-4d3a-9cfe-c06fd2cb4b8c admin admin] PATH_INFO: `/v3/users/b9be814461c745e79b79ac33d1afc9f7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.141622 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51ad69-6c8e-4d3a-9cfe-c06fd2cb4b8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9be814461c745e79b79ac33d1afc9f7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:36.144953 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51ad69-6c8e-4d3a-9cfe-c06fd2cb4b8c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:36.154941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c66e9-5563-4778-8acd-859d0a1c1dda admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:36.159948 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d09ae-0331-4127-8aa1-1e71503b9e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:36.160856 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d09ae-0331-4127-8aa1-1e71503b9e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.161269 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d09ae-0331-4127-8aa1-1e71503b9e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.161602 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d09ae-0331-4127-8aa1-1e71503b9e07 admin admin] PATH_INFO: `/v3/users/11704ac24eae41beb892d49ccbd36d8f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.163578 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d09ae-0331-4127-8aa1-1e71503b9e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11704ac24eae41beb892d49ccbd36d8f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:36.165506 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d09ae-0331-4127-8aa1-1e71503b9e07 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:36.208915 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9d51ad69-6c8e-4d3a-9cfe-c06fd2cb4b8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9be814461c745e79b79ac33d1afc9f7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:36.227868 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9d51ad69-6c8e-4d3a-9cfe-c06fd2cb4b8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9be814461c745e79b79ac33d1afc9f7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:36.228992 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9d51ad69-6c8e-4d3a-9cfe-c06fd2cb4b8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9be814461c745e79b79ac33d1afc9f7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:36.234925 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-738d09ae-0331-4127-8aa1-1e71503b9e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11704ac24eae41beb892d49ccbd36d8f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:36.235860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-738d09ae-0331-4127-8aa1-1e71503b9e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11704ac24eae41beb892d49ccbd36d8f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:36.239706 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9d51ad69-6c8e-4d3a-9cfe-c06fd2cb4b8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9be814461c745e79b79ac33d1afc9f7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:36.240578 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9d51ad69-6c8e-4d3a-9cfe-c06fd2cb4b8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9be814461c745e79b79ac33d1afc9f7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:36.247167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-738d09ae-0331-4127-8aa1-1e71503b9e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11704ac24eae41beb892d49ccbd36d8f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:36.248007 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-738d09ae-0331-4127-8aa1-1e71503b9e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11704ac24eae41beb892d49ccbd36d8f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:36.258162 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-738d09ae-0331-4127-8aa1-1e71503b9e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11704ac24eae41beb892d49ccbd36d8f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:36.261741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1021/2020] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:36 2022] DELETE /identity/v3/users/b9be814461c745e79b79ac33d1afc9f7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:36.263147 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51ad69-6c8e-4d3a-9cfe-c06fd2cb4b8c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:36.265095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9d51ad69-6c8e-4d3a-9cfe-c06fd2cb4b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:36.289529 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1000/2021] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:36 2022] DELETE /identity/v3/users/11704ac24eae41beb892d49ccbd36d8f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:36.290439 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d09ae-0331-4127-8aa1-1e71503b9e07 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:36.292407 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-738d09ae-0331-4127-8aa1-1e71503b9e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:36.367179 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51ad69-6c8e-4d3a-9cfe-c06fd2cb4b8c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:36.381706 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:36.407475 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d09ae-0331-4127-8aa1-1e71503b9e07 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:36.412285 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b593db-a53e-4814-977f-63d423491329 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:36.413348 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b593db-a53e-4814-977f-63d423491329 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.413636 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b593db-a53e-4814-977f-63d423491329 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.413906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b593db-a53e-4814-977f-63d423491329 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.416145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-67b593db-a53e-4814-977f-63d423491329 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:36.442949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:36.472694 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea578f-e672-4243-a414-e8d94a0f9a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:36.473585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea578f-e672-4243-a414-e8d94a0f9a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.473874 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea578f-e672-4243-a414-e8d94a0f9a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.474154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea578f-e672-4243-a414-e8d94a0f9a98 admin admin] PATH_INFO: `/v3/projects/a031926cc58c4a38b8aa2beb869d5b31` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.476220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea578f-e672-4243-a414-e8d94a0f9a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a031926cc58c4a38b8aa2beb869d5b31)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:36.478979 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea578f-e672-4243-a414-e8d94a0f9a98 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:36.492112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b593db-a53e-4814-977f-63d423491329 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:36.493778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b593db-a53e-4814-977f-63d423491329 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:36.504686 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1001/2022] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:36.506796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6a78d-f6b0-4344-afb1-37bc407b08ce None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.507158 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6a78d-f6b0-4344-afb1-37bc407b08ce None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.507498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6a78d-f6b0-4344-afb1-37bc407b08ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.532411 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-12b6a78d-f6b0-4344-afb1-37bc407b08ce None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:36.533578 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-12b6a78d-f6b0-4344-afb1-37bc407b08ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:36.543829 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5cea578f-e672-4243-a414-e8d94a0f9a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a031926cc58c4a38b8aa2beb869d5b31', 'request_id': 'req-5cea578f-e672-4243-a414-e8d94a0f9a98'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:36.551892 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5cea578f-e672-4243-a414-e8d94a0f9a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a031926cc58c4a38b8aa2beb869d5b31', 'request_id': 'req-5cea578f-e672-4243-a414-e8d94a0f9a98'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:36.559520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5cea578f-e672-4243-a414-e8d94a0f9a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a031926cc58c4a38b8aa2beb869d5b31', 'request_id': 'req-5cea578f-e672-4243-a414-e8d94a0f9a98'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:36.580923 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5cea578f-e672-4243-a414-e8d94a0f9a98 admin admin] The token cache is being invalidate because project a031926cc58c4a38b8aa2beb869d5b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:36.581263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5cea578f-e672-4243-a414-e8d94a0f9a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:36.582170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5cea578f-e672-4243-a414-e8d94a0f9a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:36.585173 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1022/2023] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:36 2022] DELETE /identity/v3/projects/a031926cc58c4a38b8aa2beb869d5b31 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:36.587322 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570f6a6-ce4b-4eb9-a4a5-c55b2ff7894f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.587781 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570f6a6-ce4b-4eb9-a4a5-c55b2ff7894f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.588993 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570f6a6-ce4b-4eb9-a4a5-c55b2ff7894f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.623378 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7570f6a6-ce4b-4eb9-a4a5-c55b2ff7894f None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:36.624397 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1002/2024] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:36.625394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7570f6a6-ce4b-4eb9-a4a5-c55b2ff7894f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:36.635100 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50f199-67b6-4a61-bb0a-84aa144e78db None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.635346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50f199-67b6-4a61-bb0a-84aa144e78db None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.635671 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50f199-67b6-4a61-bb0a-84aa144e78db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.639543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1023/2025] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:36.641255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570f6a6-ce4b-4eb9-a4a5-c55b2ff7894f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:36.644671 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7570f6a6-ce4b-4eb9-a4a5-c55b2ff7894f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:36.666174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fc50f199-67b6-4a61-bb0a-84aa144e78db None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:36.668171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fc50f199-67b6-4a61-bb0a-84aa144e78db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:36.678496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1003/2026] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:36.679475 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50f199-67b6-4a61-bb0a-84aa144e78db None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:36.688815 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fc50f199-67b6-4a61-bb0a-84aa144e78db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:36.750480 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570f6a6-ce4b-4eb9-a4a5-c55b2ff7894f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:36.758062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3dcee-45ac-4402-9d4a-7f6635b71860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:36.758994 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3dcee-45ac-4402-9d4a-7f6635b71860 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.759433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3dcee-45ac-4402-9d4a-7f6635b71860 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.759927 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3dcee-45ac-4402-9d4a-7f6635b71860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.770850 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3dcee-45ac-4402-9d4a-7f6635b71860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:36.772873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3dcee-45ac-4402-9d4a-7f6635b71860 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:36.798386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50f199-67b6-4a61-bb0a-84aa144e78db None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:36.799070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1024/2027] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:36.800559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be759f-f0a7-40a5-868a-0f5f40f47046 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.800844 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be759f-f0a7-40a5-868a-0f5f40f47046 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.801127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be759f-f0a7-40a5-868a-0f5f40f47046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.803636 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621bcb9-0f95-4ed5-8ebd-f673a071e320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:36.804546 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621bcb9-0f95-4ed5-8ebd-f673a071e320 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.804823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621bcb9-0f95-4ed5-8ebd-f673a071e320 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.805144 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621bcb9-0f95-4ed5-8ebd-f673a071e320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.821303 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621bcb9-0f95-4ed5-8ebd-f673a071e320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:36.823607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621bcb9-0f95-4ed5-8ebd-f673a071e320 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:36.828639 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-54be759f-f0a7-40a5-868a-0f5f40f47046 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:36.829782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-54be759f-f0a7-40a5-868a-0f5f40f47046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:36.842740 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1025/2028] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:36.843781 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be759f-f0a7-40a5-868a-0f5f40f47046 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:36.846048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-54be759f-f0a7-40a5-868a-0f5f40f47046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:36.852654 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1004/2029] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:36.854048 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621bcb9-0f95-4ed5-8ebd-f673a071e320 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:36.902229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621bcb9-0f95-4ed5-8ebd-f673a071e320 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:36.908287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be759f-f0a7-40a5-868a-0f5f40f47046 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:36.916468 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de2324-4296-4311-9fdb-7622d3165c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:36.917674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de2324-4296-4311-9fdb-7622d3165c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.918149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de2324-4296-4311-9fdb-7622d3165c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.918673 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de2324-4296-4311-9fdb-7622d3165c46 admin admin] PATH_INFO: `/v3/projects/a4ad9a14054e44568ae06d00c40be20e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.920453 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de2324-4296-4311-9fdb-7622d3165c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ad9a14054e44568ae06d00c40be20e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:36.923275 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de2324-4296-4311-9fdb-7622d3165c46 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:36.962310 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d281d15-051f-4fab-ade4-eab0544172c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:36.963009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d281d15-051f-4fab-ade4-eab0544172c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.963330 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d281d15-051f-4fab-ade4-eab0544172c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.963603 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d281d15-051f-4fab-ade4-eab0544172c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.964385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d281d15-051f-4fab-ade4-eab0544172c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:36.969657 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d281d15-051f-4fab-ade4-eab0544172c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:36.974538 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d281d15-051f-4fab-ade4-eab0544172c2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:37.003051 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1005/2030] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:43:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:37.010269 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d281d15-051f-4fab-ade4-eab0544172c2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:37.017995 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e5de2324-4296-4311-9fdb-7622d3165c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ad9a14054e44568ae06d00c40be20e', 'request_id': 'req-e5de2324-4296-4311-9fdb-7622d3165c46'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:37.028142 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d281d15-051f-4fab-ade4-eab0544172c2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:37.043494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e5de2324-4296-4311-9fdb-7622d3165c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ad9a14054e44568ae06d00c40be20e', 'request_id': 'req-e5de2324-4296-4311-9fdb-7622d3165c46'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:37.049116 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:37.073080 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e5de2324-4296-4311-9fdb-7622d3165c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ad9a14054e44568ae06d00c40be20e', 'request_id': 'req-e5de2324-4296-4311-9fdb-7622d3165c46'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:37.076803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:37.103975 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e5de2324-4296-4311-9fdb-7622d3165c46 admin admin] The token cache is being invalidate because project a4ad9a14054e44568ae06d00c40be20e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:37.104267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e5de2324-4296-4311-9fdb-7622d3165c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:37.106040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e5de2324-4296-4311-9fdb-7622d3165c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:37.110775 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1026/2031] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:36 2022] DELETE /identity/v3/projects/a4ad9a14054e44568ae06d00c40be20e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:37.117387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de2324-4296-4311-9fdb-7622d3165c46 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:37.119685 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e5de2324-4296-4311-9fdb-7622d3165c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:37.204334 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9615d4-f1ac-40c3-a52a-004da9edf8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:37.206871 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9615d4-f1ac-40c3-a52a-004da9edf8bc admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:37.208307 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9615d4-f1ac-40c3-a52a-004da9edf8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:37.210328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9615d4-f1ac-40c3-a52a-004da9edf8bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:37.211456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9615d4-f1ac-40c3-a52a-004da9edf8bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:37.221595 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9615d4-f1ac-40c3-a52a-004da9edf8bc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:37.268761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de2324-4296-4311-9fdb-7622d3165c46 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:37.275838 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a5d21-ab8e-4056-be05-88b34b6d747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:37.276987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a5d21-ab8e-4056-be05-88b34b6d747d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:37.277379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a5d21-ab8e-4056-be05-88b34b6d747d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:37.277893 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a5d21-ab8e-4056-be05-88b34b6d747d admin admin] PATH_INFO: `/v3/users/bd634d8d78a44f18b0c276dc939383b9` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:37.280165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a5d21-ab8e-4056-be05-88b34b6d747d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd634d8d78a44f18b0c276dc939383b9)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:37.283387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a5d21-ab8e-4056-be05-88b34b6d747d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:37.296685 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1006/2032] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:37 2022] POST /identity/v3/projects => generated 382 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:37.298085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9615d4-f1ac-40c3-a52a-004da9edf8bc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:37.301493 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2d9615d4-f1ac-40c3-a52a-004da9edf8bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:37.388270 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a29a5d21-ab8e-4056-be05-88b34b6d747d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd634d8d78a44f18b0c276dc939383b9'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:37.413432 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a29a5d21-ab8e-4056-be05-88b34b6d747d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd634d8d78a44f18b0c276dc939383b9'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:37.414729 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a29a5d21-ab8e-4056-be05-88b34b6d747d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd634d8d78a44f18b0c276dc939383b9'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:37.430045 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a29a5d21-ab8e-4056-be05-88b34b6d747d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd634d8d78a44f18b0c276dc939383b9'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:37.431462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a29a5d21-ab8e-4056-be05-88b34b6d747d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd634d8d78a44f18b0c276dc939383b9'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:37.458611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1027/2033] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:37 2022] DELETE /identity/v3/users/bd634d8d78a44f18b0c276dc939383b9 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:37.467192 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9615d4-f1ac-40c3-a52a-004da9edf8bc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:37.564098 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a5d21-ab8e-4056-be05-88b34b6d747d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:37.567192 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a29a5d21-ab8e-4056-be05-88b34b6d747d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:37.592256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f24b95-2120-42eb-a056-49edeb2e9e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:37.593326 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f24b95-2120-42eb-a056-49edeb2e9e81 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:37.594035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f24b95-2120-42eb-a056-49edeb2e9e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:37.594346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f24b95-2120-42eb-a056-49edeb2e9e81 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:37.595087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f24b95-2120-42eb-a056-49edeb2e9e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:37.597358 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f24b95-2120-42eb-a056-49edeb2e9e81 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:37.619253 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a5d21-ab8e-4056-be05-88b34b6d747d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:37.634518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9233e-7887-46cc-8816-36c4022b92e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:37.635445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9233e-7887-46cc-8816-36c4022b92e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:37.635884 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9233e-7887-46cc-8816-36c4022b92e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:37.636167 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9233e-7887-46cc-8816-36c4022b92e5 admin admin] PATH_INFO: `/v3/projects/eacdd7efdd664315adfb8b1f5938a00a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:37.641119 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9233e-7887-46cc-8816-36c4022b92e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eacdd7efdd664315adfb8b1f5938a00a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:37.643158 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9233e-7887-46cc-8816-36c4022b92e5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:37.663267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1007/2034] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:37 2022] POST /identity/v3/users => generated 292 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:37.665952 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f24b95-2120-42eb-a056-49edeb2e9e81 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:37.671966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-42f24b95-2120-42eb-a056-49edeb2e9e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:37.712674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f24b95-2120-42eb-a056-49edeb2e9e81 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:37.734359 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb20ae-a5b1-4217-aa6d-6f32a4a02b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:37.736898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb20ae-a5b1-4217-aa6d-6f32a4a02b23 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:37.740340 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb20ae-a5b1-4217-aa6d-6f32a4a02b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:37.742674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb20ae-a5b1-4217-aa6d-6f32a4a02b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:37.746362 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb20ae-a5b1-4217-aa6d-6f32a4a02b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:37.752584 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb20ae-a5b1-4217-aa6d-6f32a4a02b23 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:37.781449 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1008/2035] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:37 2022] GET /identity/v3/roles => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:37.788437 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb20ae-a5b1-4217-aa6d-6f32a4a02b23 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:37.805993 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e2f9233e-7887-46cc-8816-36c4022b92e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eacdd7efdd664315adfb8b1f5938a00a', 'request_id': 'req-e2f9233e-7887-46cc-8816-36c4022b92e5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:37.820361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb20ae-a5b1-4217-aa6d-6f32a4a02b23 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:37.820757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e2f9233e-7887-46cc-8816-36c4022b92e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eacdd7efdd664315adfb8b1f5938a00a', 'request_id': 'req-e2f9233e-7887-46cc-8816-36c4022b92e5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:37.827348 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:37.839138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e2f9233e-7887-46cc-8816-36c4022b92e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eacdd7efdd664315adfb8b1f5938a00a', 'request_id': 'req-e2f9233e-7887-46cc-8816-36c4022b92e5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:37.869641 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e2f9233e-7887-46cc-8816-36c4022b92e5 admin admin] The token cache is being invalidate because project eacdd7efdd664315adfb8b1f5938a00a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:37.870454 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e2f9233e-7887-46cc-8816-36c4022b92e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:37.871833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e2f9233e-7887-46cc-8816-36c4022b92e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:37.874325 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1028/2036] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:37 2022] DELETE /identity/v3/projects/eacdd7efdd664315adfb8b1f5938a00a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:37.879070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9233e-7887-46cc-8816-36c4022b92e5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:37.881538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e2f9233e-7887-46cc-8816-36c4022b92e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:37.910956 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:37.973072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc4a87-17a1-43b3-80a2-c8417fedbf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:37.974617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc4a87-17a1-43b3-80a2-c8417fedbf2a admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:37.975800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc4a87-17a1-43b3-80a2-c8417fedbf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:37.976415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc4a87-17a1-43b3-80a2-c8417fedbf2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:37.977787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc4a87-17a1-43b3-80a2-c8417fedbf2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:37.980965 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc4a87-17a1-43b3-80a2-c8417fedbf2a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:38.004564 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1009/2037] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:37 2022] GET /identity/v3/roles => generated 1427 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:38.016379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc4a87-17a1-43b3-80a2-c8417fedbf2a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:38.019826 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-06bc4a87-17a1-43b3-80a2-c8417fedbf2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:38.052764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc4a87-17a1-43b3-80a2-c8417fedbf2a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:38.065304 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66180793-f3b9-4989-8bfb-cdcb4c17fb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:38.070174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66180793-f3b9-4989-8bfb-cdcb4c17fb74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:38.070810 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66180793-f3b9-4989-8bfb-cdcb4c17fb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:38.071414 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66180793-f3b9-4989-8bfb-cdcb4c17fb74 admin admin] PATH_INFO: `/v3/projects/1c1d6785ad8343e0aab6433ea09939bd/users/96c4838e9d5e4064b1f78684725c4b05/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:38.096814 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66180793-f3b9-4989-8bfb-cdcb4c17fb74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1d6785ad8343e0aab6433ea09939bd, user_id=96c4838e9d5e4064b1f78684725c4b05, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:38.102183 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66180793-f3b9-4989-8bfb-cdcb4c17fb74 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:38.114422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9233e-7887-46cc-8816-36c4022b92e5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:38.137019 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1010/2038] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:38 2022] PUT /identity/v3/projects/1c1d6785ad8343e0aab6433ea09939bd/users/96c4838e9d5e4064b1f78684725c4b05/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:38.145518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c81812-7e18-43a9-be97-6c8548634da3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:38.146285 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c81812-7e18-43a9-be97-6c8548634da3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:38.147915 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c81812-7e18-43a9-be97-6c8548634da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:38.185158 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-85c81812-7e18-43a9-be97-6c8548634da3 None None] MFA Rules not processed for user `96c4838e9d5e4064b1f78684725c4b05`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:38.186417 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-85c81812-7e18-43a9-be97-6c8548634da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:38.256862 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ec6b4-7225-4886-9b3e-48feda16dd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:38.260037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ec6b4-7225-4886-9b3e-48feda16dd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:38.261135 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ec6b4-7225-4886-9b3e-48feda16dd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:38.261912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ec6b4-7225-4886-9b3e-48feda16dd1b admin admin] PATH_INFO: `/v3/users/f6d791c01621446592fe23b24dd68e21` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:38.264722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ec6b4-7225-4886-9b3e-48feda16dd1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d791c01621446592fe23b24dd68e21)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:38.272126 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ec6b4-7225-4886-9b3e-48feda16dd1b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:38.286547 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1011/2039] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:38.287749 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c81812-7e18-43a9-be97-6c8548634da3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:38.305361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c81812-7e18-43a9-be97-6c8548634da3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:38.319039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2cf54-fd28-4ab0-8415-2982dfc72544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:38.319039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2cf54-fd28-4ab0-8415-2982dfc72544 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:38.319039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2cf54-fd28-4ab0-8415-2982dfc72544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:38.319039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2cf54-fd28-4ab0-8415-2982dfc72544 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:38.319764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2cf54-fd28-4ab0-8415-2982dfc72544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:38.321065 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2cf54-fd28-4ab0-8415-2982dfc72544 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:38.380729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1012/2040] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:38 2022] POST /identity/v3/projects => generated 380 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:38.386289 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2cf54-fd28-4ab0-8415-2982dfc72544 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:38.411863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ae1ec6b4-7225-4886-9b3e-48feda16dd1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d791c01621446592fe23b24dd68e21'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:38.429372 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ae1ec6b4-7225-4886-9b3e-48feda16dd1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d791c01621446592fe23b24dd68e21'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:38.430412 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ae1ec6b4-7225-4886-9b3e-48feda16dd1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d791c01621446592fe23b24dd68e21'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:38.449557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ae1ec6b4-7225-4886-9b3e-48feda16dd1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d791c01621446592fe23b24dd68e21'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:38.450150 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ae1ec6b4-7225-4886-9b3e-48feda16dd1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d791c01621446592fe23b24dd68e21'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:38.469315 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1029/2041] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:37 2022] DELETE /identity/v3/users/f6d791c01621446592fe23b24dd68e21 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:38.500550 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ec6b4-7225-4886-9b3e-48feda16dd1b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:38.502317 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ae1ec6b4-7225-4886-9b3e-48feda16dd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:38.528438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:38.575453 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2cf54-fd28-4ab0-8415-2982dfc72544 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:38.621521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:38.622759 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ec6b4-7225-4886-9b3e-48feda16dd1b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:38.627990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282181a-b977-4624-bcfa-ba4ecc60f4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:38.630727 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282181a-b977-4624-bcfa-ba4ecc60f4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:38.631726 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282181a-b977-4624-bcfa-ba4ecc60f4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:38.632106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282181a-b977-4624-bcfa-ba4ecc60f4d2 admin admin] PATH_INFO: `/v3/projects/d72bc3c3a23c41a3a7190479fdd90b55` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:38.633552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282181a-b977-4624-bcfa-ba4ecc60f4d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d72bc3c3a23c41a3a7190479fdd90b55)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:38.635667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282181a-b977-4624-bcfa-ba4ecc60f4d2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:38.754482 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7282181a-b977-4624-bcfa-ba4ecc60f4d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd72bc3c3a23c41a3a7190479fdd90b55', 'request_id': 'req-7282181a-b977-4624-bcfa-ba4ecc60f4d2'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:38.780873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7282181a-b977-4624-bcfa-ba4ecc60f4d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd72bc3c3a23c41a3a7190479fdd90b55', 'request_id': 'req-7282181a-b977-4624-bcfa-ba4ecc60f4d2'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:38.793624 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd8435-0dbe-498f-854d-ba27288e3312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:38.804782 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd8435-0dbe-498f-854d-ba27288e3312 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:38.805075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd8435-0dbe-498f-854d-ba27288e3312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:38.805361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd8435-0dbe-498f-854d-ba27288e3312 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:38.806094 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd8435-0dbe-498f-854d-ba27288e3312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:38.809188 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd8435-0dbe-498f-854d-ba27288e3312 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:38.816804 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7282181a-b977-4624-bcfa-ba4ecc60f4d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd72bc3c3a23c41a3a7190479fdd90b55', 'request_id': 'req-7282181a-b977-4624-bcfa-ba4ecc60f4d2'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:38.850184 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7282181a-b977-4624-bcfa-ba4ecc60f4d2 admin admin] The token cache is being invalidate because project d72bc3c3a23c41a3a7190479fdd90b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:38.850393 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7282181a-b977-4624-bcfa-ba4ecc60f4d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:38.863192 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7282181a-b977-4624-bcfa-ba4ecc60f4d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:38.873982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1030/2042] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:38 2022] DELETE /identity/v3/projects/d72bc3c3a23c41a3a7190479fdd90b55 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:38.875694 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec97ab-5d2f-4aaa-b3eb-a28add98333f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:38.876005 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec97ab-5d2f-4aaa-b3eb-a28add98333f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:38.876278 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec97ab-5d2f-4aaa-b3eb-a28add98333f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:38.887309 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1013/2043] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:38 2022] POST /identity/v3/users => generated 297 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:38.888948 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd8435-0dbe-498f-854d-ba27288e3312 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:38.898260 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3ddd8435-0dbe-498f-854d-ba27288e3312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:38.953699 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd8435-0dbe-498f-854d-ba27288e3312 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:38.955241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3dec97ab-5d2f-4aaa-b3eb-a28add98333f None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:38.956491 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3dec97ab-5d2f-4aaa-b3eb-a28add98333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:39.145496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110be11b-6e32-4346-abeb-8ce0f8a154a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:39.146551 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110be11b-6e32-4346-abeb-8ce0f8a154a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.147056 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110be11b-6e32-4346-abeb-8ce0f8a154a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.147557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110be11b-6e32-4346-abeb-8ce0f8a154a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.148582 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110be11b-6e32-4346-abeb-8ce0f8a154a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:39.150608 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110be11b-6e32-4346-abeb-8ce0f8a154a6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:39.153043 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1031/2044] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:39.166886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd88b6-2c06-4fa0-bfcf-61f3fe03222f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.167448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd88b6-2c06-4fa0-bfcf-61f3fe03222f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.167899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd88b6-2c06-4fa0-bfcf-61f3fe03222f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.173399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1014/2045] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:38 2022] GET /identity/v3/roles => generated 1427 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:39.174606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110be11b-6e32-4346-abeb-8ce0f8a154a6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:39.219353 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110be11b-6e32-4346-abeb-8ce0f8a154a6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:39.246988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630794f-40e3-4a44-8822-db1a5151a5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:39.253353 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630794f-40e3-4a44-8822-db1a5151a5da admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.254345 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630794f-40e3-4a44-8822-db1a5151a5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.257504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630794f-40e3-4a44-8822-db1a5151a5da admin admin] PATH_INFO: `/v3/projects/0246a37322e647099d8695762b59a541/users/2eb578e0994c4553881eef4d2129d8c4/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.266508 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d3bd88b6-2c06-4fa0-bfcf-61f3fe03222f None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:39.274031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d3bd88b6-2c06-4fa0-bfcf-61f3fe03222f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:39.327402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1032/2046] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:39.331019 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd88b6-2c06-4fa0-bfcf-61f3fe03222f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:39.333874 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d3bd88b6-2c06-4fa0-bfcf-61f3fe03222f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:39.337426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630794f-40e3-4a44-8822-db1a5151a5da admin admin] RBAC: Authorizing `identity:create_grant(project_id=0246a37322e647099d8695762b59a541, user_id=2eb578e0994c4553881eef4d2129d8c4, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:39.360780 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630794f-40e3-4a44-8822-db1a5151a5da admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:39.383013 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd88b6-2c06-4fa0-bfcf-61f3fe03222f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:39.410290 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9df503-b69f-49b8-9d0b-4638284164b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:39.411215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9df503-b69f-49b8-9d0b-4638284164b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.411507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9df503-b69f-49b8-9d0b-4638284164b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.411788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9df503-b69f-49b8-9d0b-4638284164b9 admin admin] PATH_INFO: `/v3/projects/37d5336c7dfb4d82928568d1a2e88c0d` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.415836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1015/2047] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:39 2022] PUT /identity/v3/projects/0246a37322e647099d8695762b59a541/users/2eb578e0994c4553881eef4d2129d8c4/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:39.416474 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9df503-b69f-49b8-9d0b-4638284164b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37d5336c7dfb4d82928568d1a2e88c0d)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:39.417206 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630794f-40e3-4a44-8822-db1a5151a5da admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:39.425927 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9df503-b69f-49b8-9d0b-4638284164b9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:39.525389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:39.564699 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4f9df503-b69f-49b8-9d0b-4638284164b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d5336c7dfb4d82928568d1a2e88c0d', 'request_id': 'req-4f9df503-b69f-49b8-9d0b-4638284164b9'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:39.581599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4f9df503-b69f-49b8-9d0b-4638284164b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d5336c7dfb4d82928568d1a2e88c0d', 'request_id': 'req-4f9df503-b69f-49b8-9d0b-4638284164b9'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:39.611562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630794f-40e3-4a44-8822-db1a5151a5da admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:39.613433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4f9df503-b69f-49b8-9d0b-4638284164b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d5336c7dfb4d82928568d1a2e88c0d', 'request_id': 'req-4f9df503-b69f-49b8-9d0b-4638284164b9'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:39.655048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4f9df503-b69f-49b8-9d0b-4638284164b9 admin admin] The token cache is being invalidate because project 37d5336c7dfb4d82928568d1a2e88c0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:39.656025 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4f9df503-b69f-49b8-9d0b-4638284164b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:39.659351 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4f9df503-b69f-49b8-9d0b-4638284164b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:39.668375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1033/2048] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:39 2022] DELETE /identity/v3/projects/37d5336c7dfb4d82928568d1a2e88c0d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:39.670116 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9df503-b69f-49b8-9d0b-4638284164b9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:39.679909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4f9df503-b69f-49b8-9d0b-4638284164b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:39.694631 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:39.803906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531dfef7-408f-49b7-b7d9-f71c30d878e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:39.805370 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dfef7-408f-49b7-b7d9-f71c30d878e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.805886 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dfef7-408f-49b7-b7d9-f71c30d878e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.806378 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dfef7-408f-49b7-b7d9-f71c30d878e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.807802 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531dfef7-408f-49b7-b7d9-f71c30d878e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:39.808433 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531dfef7-408f-49b7-b7d9-f71c30d878e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:39.811454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531dfef7-408f-49b7-b7d9-f71c30d878e2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:39.842298 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9df503-b69f-49b8-9d0b-4638284164b9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:39.848332 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1016/2049] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:43:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:39.851472 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065ee10-1985-465d-9d7a-35d53d55472f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.851970 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065ee10-1985-465d-9d7a-35d53d55472f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.852458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065ee10-1985-465d-9d7a-35d53d55472f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.853166 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eb66d-1e7f-4a6e-b7b4-053559b3b369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:39.854253 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eb66d-1e7f-4a6e-b7b4-053559b3b369 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.854756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eb66d-1e7f-4a6e-b7b4-053559b3b369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.855220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eb66d-1e7f-4a6e-b7b4-053559b3b369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.856554 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2eb66d-1e7f-4a6e-b7b4-053559b3b369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:39.859858 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2eb66d-1e7f-4a6e-b7b4-053559b3b369 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:39.884412 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1034/2050] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:39 2022] GET /identity/v3/roles => generated 1427 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:39.884412 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eb66d-1e7f-4a6e-b7b4-053559b3b369 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:39.884412 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1a2eb66d-1e7f-4a6e-b7b4-053559b3b369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:39.894562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6065ee10-1985-465d-9d7a-35d53d55472f None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:39.896688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6065ee10-1985-465d-9d7a-35d53d55472f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:39.907912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eb66d-1e7f-4a6e-b7b4-053559b3b369 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:39.922159 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1017/2051] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:39.922159 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065ee10-1985-465d-9d7a-35d53d55472f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:39.924186 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e71a9-f9e1-4803-89bb-e427a8686ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:39.925402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e71a9-f9e1-4803-89bb-e427a8686ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.925885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e71a9-f9e1-4803-89bb-e427a8686ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.926550 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e71a9-f9e1-4803-89bb-e427a8686ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.927794 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e71a9-f9e1-4803-89bb-e427a8686ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:39.932556 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e71a9-f9e1-4803-89bb-e427a8686ae6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:39.939544 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065ee10-1985-465d-9d7a-35d53d55472f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:39.956176 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b06b2-ef52-41b9-8a2d-982d09e031ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:39.957888 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b06b2-ef52-41b9-8a2d-982d09e031ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.958426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b06b2-ef52-41b9-8a2d-982d09e031ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.959092 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b06b2-ef52-41b9-8a2d-982d09e031ff admin admin] PATH_INFO: `/v3/projects/0246a37322e647099d8695762b59a541/users/2eb578e0994c4553881eef4d2129d8c4/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.965207 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b06b2-ef52-41b9-8a2d-982d09e031ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0246a37322e647099d8695762b59a541, user_id=2eb578e0994c4553881eef4d2129d8c4, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:39.971024 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b06b2-ef52-41b9-8a2d-982d09e031ff admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:39.999240 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1035/2053] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:39 2022] POST /identity/v3/projects => generated 402 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:39.999240 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17175c22-1544-41fe-96ff-504f92b9feb7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.999624 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17175c22-1544-41fe-96ff-504f92b9feb7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.999993 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17175c22-1544-41fe-96ff-504f92b9feb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:40.002984 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1018/2053] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:39 2022] PUT /identity/v3/projects/0246a37322e647099d8695762b59a541/users/2eb578e0994c4553881eef4d2129d8c4/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:40.004722 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b06b2-ef52-41b9-8a2d-982d09e031ff admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:40.069089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-17175c22-1544-41fe-96ff-504f92b9feb7 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:40.071466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-17175c22-1544-41fe-96ff-504f92b9feb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:40.152552 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b06b2-ef52-41b9-8a2d-982d09e031ff admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:40.267778 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1036/2054] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:40.269578 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfcb22-dd19-442c-b749-3f69dcfb1132 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:40.269869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfcb22-dd19-442c-b749-3f69dcfb1132 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:40.270154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfcb22-dd19-442c-b749-3f69dcfb1132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:40.273388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d300a42-c952-42a6-84de-e090c4c699f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:40.274352 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d300a42-c952-42a6-84de-e090c4c699f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:40.275139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d300a42-c952-42a6-84de-e090c4c699f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:40.275414 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d300a42-c952-42a6-84de-e090c4c699f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:40.276220 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d300a42-c952-42a6-84de-e090c4c699f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:40.279123 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d300a42-c952-42a6-84de-e090c4c699f8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:40.308564 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1019/2055] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:40 2022] POST /identity/v3/users => generated 302 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:40.309853 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d300a42-c952-42a6-84de-e090c4c699f8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:40.315378 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2ecfcb22-dd19-442c-b749-3f69dcfb1132 None None] MFA Rules not processed for user `2eb578e0994c4553881eef4d2129d8c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:40.316861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2ecfcb22-dd19-442c-b749-3f69dcfb1132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:40.323976 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d300a42-c952-42a6-84de-e090c4c699f8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:40.329305 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2d83b-2916-4391-865c-fabc7156d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:40.329970 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2d83b-2916-4391-865c-fabc7156d0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:40.330255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2d83b-2916-4391-865c-fabc7156d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:40.330529 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2d83b-2916-4391-865c-fabc7156d0a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:40.331315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2d83b-2916-4391-865c-fabc7156d0a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:40.331618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2d83b-2916-4391-865c-fabc7156d0a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:40.333743 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2d83b-2916-4391-865c-fabc7156d0a1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:40.356182 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1020/2056] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:43:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:40.356182 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2d83b-2916-4391-865c-fabc7156d0a1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:40.374334 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:40.380401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2d83b-2916-4391-865c-fabc7156d0a1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:40.389420 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1196788-c7b3-43eb-b3a6-1b67fac90378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:40.394643 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1196788-c7b3-43eb-b3a6-1b67fac90378 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:40.395060 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1196788-c7b3-43eb-b3a6-1b67fac90378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:40.395355 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1196788-c7b3-43eb-b3a6-1b67fac90378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:40.396148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1196788-c7b3-43eb-b3a6-1b67fac90378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:40.402452 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1196788-c7b3-43eb-b3a6-1b67fac90378 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:40.415796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1021/2057] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:40 2022] GET /identity/v3/roles => generated 1427 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:40.416506 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1196788-c7b3-43eb-b3a6-1b67fac90378 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:40.430474 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1196788-c7b3-43eb-b3a6-1b67fac90378 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:40.459768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a2678-ae1d-4af7-9ebf-c33c01c83eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:40.460144 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a2678-ae1d-4af7-9ebf-c33c01c83eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:40.460541 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a2678-ae1d-4af7-9ebf-c33c01c83eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:40.461032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a2678-ae1d-4af7-9ebf-c33c01c83eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:40.462284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a2678-ae1d-4af7-9ebf-c33c01c83eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:40.466065 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a2678-ae1d-4af7-9ebf-c33c01c83eb9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:40.472643 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1037/2058] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:40.479431 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:40.480273 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfcb22-dd19-442c-b749-3f69dcfb1132 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:40.501382 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfcb22-dd19-442c-b749-3f69dcfb1132 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:40.512832 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe224b15-318e-4f11-a4fc-523efc664ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:40.514185 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224b15-318e-4f11-a4fc-523efc664ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:40.515089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224b15-318e-4f11-a4fc-523efc664ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:40.516584 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224b15-318e-4f11-a4fc-523efc664ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:40.517781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1022/2059] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:40 2022] POST /identity/v3/projects => generated 410 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:40.519436 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a2678-ae1d-4af7-9ebf-c33c01c83eb9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:40.520337 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe224b15-318e-4f11-a4fc-523efc664ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:40.524294 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe224b15-318e-4f11-a4fc-523efc664ce9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:40.524423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-525a2678-ae1d-4af7-9ebf-c33c01c83eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:40.543129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1038/2060] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:40 2022] GET /identity/v3/roles => generated 1427 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:40.544123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe224b15-318e-4f11-a4fc-523efc664ce9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:40.557112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe224b15-318e-4f11-a4fc-523efc664ce9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:40.689484 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a2678-ae1d-4af7-9ebf-c33c01c83eb9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:40.701770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1672e-b134-4d46-a6ee-d77d949ee928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:40.702890 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1672e-b134-4d46-a6ee-d77d949ee928 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:40.703387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1672e-b134-4d46-a6ee-d77d949ee928 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:40.703894 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1672e-b134-4d46-a6ee-d77d949ee928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:40.707721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b45af8-27ce-4483-a5b8-b9372fc68bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:40.708755 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b45af8-27ce-4483-a5b8-b9372fc68bce admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:40.711092 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b45af8-27ce-4483-a5b8-b9372fc68bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:40.711766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b45af8-27ce-4483-a5b8-b9372fc68bce admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:40.712702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b45af8-27ce-4483-a5b8-b9372fc68bce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:40.715836 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b45af8-27ce-4483-a5b8-b9372fc68bce admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:40.744460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1039/2061] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:40 2022] POST /identity/v3/users => generated 306 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:40.745540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b45af8-27ce-4483-a5b8-b9372fc68bce admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:40.761658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b45af8-27ce-4483-a5b8-b9372fc68bce admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:40.771091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c7cf2-70db-48e6-b9bb-90b53b07a30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:40.774209 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c7cf2-70db-48e6-b9bb-90b53b07a30b admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:40.774712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c7cf2-70db-48e6-b9bb-90b53b07a30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:40.775012 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c7cf2-70db-48e6-b9bb-90b53b07a30b admin admin] PATH_INFO: `/v3/projects/b82578ab94c5486d9deb06a51a239f96/users/8d6d8d05541f49eab3126ed60d5ee3a8/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:40.825613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c7cf2-70db-48e6-b9bb-90b53b07a30b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b82578ab94c5486d9deb06a51a239f96, user_id=8d6d8d05541f49eab3126ed60d5ee3a8, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:40.837743 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c7cf2-70db-48e6-b9bb-90b53b07a30b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:40.845684 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1672e-b134-4d46-a6ee-d77d949ee928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:40.848046 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1672e-b134-4d46-a6ee-d77d949ee928 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:40.861840 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1023/2062] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:40.863222 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1672e-b134-4d46-a6ee-d77d949ee928 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:40.876683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1672e-b134-4d46-a6ee-d77d949ee928 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:40.890599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1040/2063] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:40 2022] PUT /identity/v3/projects/b82578ab94c5486d9deb06a51a239f96/users/8d6d8d05541f49eab3126ed60d5ee3a8/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:40.899679 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b856c8-a7f4-4e40-8bec-ea1c397481b3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:40.901085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b856c8-a7f4-4e40-8bec-ea1c397481b3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:40.901840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b856c8-a7f4-4e40-8bec-ea1c397481b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:41.016259 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-31b856c8-a7f4-4e40-8bec-ea1c397481b3 None None] MFA Rules not processed for user `8d6d8d05541f49eab3126ed60d5ee3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:41.023435 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-31b856c8-a7f4-4e40-8bec-ea1c397481b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:41.035524 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae04e0-d63d-4be0-8852-bd5cfe74c1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:41.036593 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae04e0-d63d-4be0-8852-bd5cfe74c1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:41.037669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae04e0-d63d-4be0-8852-bd5cfe74c1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:41.038080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae04e0-d63d-4be0-8852-bd5cfe74c1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:41.038968 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae04e0-d63d-4be0-8852-bd5cfe74c1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:41.041053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae04e0-d63d-4be0-8852-bd5cfe74c1e8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:41.077482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1024/2064] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:40 2022] GET /identity/v3/roles => generated 1427 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:41.088381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae04e0-d63d-4be0-8852-bd5cfe74c1e8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:41.111175 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae04e0-d63d-4be0-8852-bd5cfe74c1e8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:41.128828 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69962016-733d-4d78-91af-ede99ff2c3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:41.129530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69962016-733d-4d78-91af-ede99ff2c3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:41.129818 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69962016-733d-4d78-91af-ede99ff2c3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:41.130090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69962016-733d-4d78-91af-ede99ff2c3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:41.130924 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69962016-733d-4d78-91af-ede99ff2c3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:41.144585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69962016-733d-4d78-91af-ede99ff2c3c2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:41.172731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1025/2065] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:41 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:43:41.186261 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69962016-733d-4d78-91af-ede99ff2c3c2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:41.217336 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69962016-733d-4d78-91af-ede99ff2c3c2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:41.248860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a51d29-432e-4a03-bcfa-6251cc66d004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:41.250199 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a51d29-432e-4a03-bcfa-6251cc66d004 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:41.262345 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a51d29-432e-4a03-bcfa-6251cc66d004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:41.262724 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a51d29-432e-4a03-bcfa-6251cc66d004 admin admin] PATH_INFO: `/v3/projects/ea14e5aa38da487bb1909ed6e6608dee/users/f7339b449de744fa83dd11acaacea08b/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:41.292294 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1041/2066] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:40 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:41.293667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b856c8-a7f4-4e40-8bec-ea1c397481b3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:41.305128 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:41.319145 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b856c8-a7f4-4e40-8bec-ea1c397481b3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:41.322335 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a51d29-432e-4a03-bcfa-6251cc66d004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea14e5aa38da487bb1909ed6e6608dee, user_id=f7339b449de744fa83dd11acaacea08b, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:41.337063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a51d29-432e-4a03-bcfa-6251cc66d004 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:41.337156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b7eaf-3c47-452e-9148-fa0d4b29c4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:41.337156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b7eaf-3c47-452e-9148-fa0d4b29c4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:41.337156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b7eaf-3c47-452e-9148-fa0d4b29c4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:41.337156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b7eaf-3c47-452e-9148-fa0d4b29c4a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:41.337446 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b7eaf-3c47-452e-9148-fa0d4b29c4a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:41.337446 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b7eaf-3c47-452e-9148-fa0d4b29c4a9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:41.353252 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:41.366383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1026/2067] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:41 2022] PUT /identity/v3/projects/ea14e5aa38da487bb1909ed6e6608dee/users/f7339b449de744fa83dd11acaacea08b/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:41.381559 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c03f07-8838-4587-8883-02f28493d51c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:41.381878 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c03f07-8838-4587-8883-02f28493d51c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:41.382173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c03f07-8838-4587-8883-02f28493d51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:41.420044 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1042/2068] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:41 2022] POST /identity/v3/projects => generated 400 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:41.429585 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b7eaf-3c47-452e-9148-fa0d4b29c4a9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:41.467466 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d9c03f07-8838-4587-8883-02f28493d51c None None] MFA Rules not processed for user `f7339b449de744fa83dd11acaacea08b`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:41.467466 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d9c03f07-8838-4587-8883-02f28493d51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:41.605543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b7eaf-3c47-452e-9148-fa0d4b29c4a9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:41.630206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeefda3-9505-414a-a428-260313caad64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:41.630206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeefda3-9505-414a-a428-260313caad64 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:41.630206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeefda3-9505-414a-a428-260313caad64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:41.630206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeefda3-9505-414a-a428-260313caad64 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:41.640697 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeefda3-9505-414a-a428-260313caad64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:41.642756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeefda3-9505-414a-a428-260313caad64 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:41.666983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1027/2069] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:41 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:41.672066 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c03f07-8838-4587-8883-02f28493d51c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:41.683014 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1043/2070] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:41 2022] POST /identity/v3/users => generated 307 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:41.685058 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeefda3-9505-414a-a428-260313caad64 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:41.703890 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeefda3-9505-414a-a428-260313caad64 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:41.715620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87cb88-d429-43b0-a055-2af988617195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:41.717873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87cb88-d429-43b0-a055-2af988617195 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:41.718337 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87cb88-d429-43b0-a055-2af988617195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:41.718812 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87cb88-d429-43b0-a055-2af988617195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:41.720072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87cb88-d429-43b0-a055-2af988617195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:41.722064 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87cb88-d429-43b0-a055-2af988617195 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:41.728752 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c03f07-8838-4587-8883-02f28493d51c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:41.742875 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1044/2071] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:41 2022] GET /identity/v3/roles => generated 1427 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:41.745305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87cb88-d429-43b0-a055-2af988617195 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:41.765658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c337394-e0c3-4321-aa8e-2c7b2b8e76fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:41.766269 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c337394-e0c3-4321-aa8e-2c7b2b8e76fa admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:41.766599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c337394-e0c3-4321-aa8e-2c7b2b8e76fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:41.766895 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c337394-e0c3-4321-aa8e-2c7b2b8e76fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:41.767606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c337394-e0c3-4321-aa8e-2c7b2b8e76fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:41.774106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87cb88-d429-43b0-a055-2af988617195 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:41.774394 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c337394-e0c3-4321-aa8e-2c7b2b8e76fa admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:41.784761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a5114-c0a9-415f-a656-dd3aeb1e8e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:41.786544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a5114-c0a9-415f-a656-dd3aeb1e8e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:41.787442 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a5114-c0a9-415f-a656-dd3aeb1e8e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:41.788039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a5114-c0a9-415f-a656-dd3aeb1e8e10 admin admin] PATH_INFO: `/v3/projects/6fbbfddc514441ecb238c0f54b9956d3/users/db9c6c9d729c4bd1ae5240a57c209885/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:41.829706 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1028/2072] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:41 2022] POST /identity/v3/projects => generated 410 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:41.835632 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c337394-e0c3-4321-aa8e-2c7b2b8e76fa admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:41.847928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a5114-c0a9-415f-a656-dd3aeb1e8e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fbbfddc514441ecb238c0f54b9956d3, user_id=db9c6c9d729c4bd1ae5240a57c209885, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:41.853391 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a5114-c0a9-415f-a656-dd3aeb1e8e10 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:41.885674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1045/2073] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:41 2022] PUT /identity/v3/projects/6fbbfddc514441ecb238c0f54b9956d3/users/db9c6c9d729c4bd1ae5240a57c209885/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:41.887373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a5114-c0a9-415f-a656-dd3aeb1e8e10 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:41.988892 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c337394-e0c3-4321-aa8e-2c7b2b8e76fa admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:42.023681 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a5114-c0a9-415f-a656-dd3aeb1e8e10 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:42.036687 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0eb579-6eb0-48c1-96ef-68830de8f6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:42.038731 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eb579-6eb0-48c1-96ef-68830de8f6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.039275 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eb579-6eb0-48c1-96ef-68830de8f6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.039995 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eb579-6eb0-48c1-96ef-68830de8f6bc admin admin] PATH_INFO: `/v3/users/96c4838e9d5e4064b1f78684725c4b05` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.043072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0eb579-6eb0-48c1-96ef-68830de8f6bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=96c4838e9d5e4064b1f78684725c4b05)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:42.045438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0eb579-6eb0-48c1-96ef-68830de8f6bc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:42.122967 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:42.126140 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07c34a-92a6-40b6-9b0a-bc128cc3afbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:42.127018 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07c34a-92a6-40b6-9b0a-bc128cc3afbf admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.127169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07c34a-92a6-40b6-9b0a-bc128cc3afbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.127463 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07c34a-92a6-40b6-9b0a-bc128cc3afbf admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.128126 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07c34a-92a6-40b6-9b0a-bc128cc3afbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:42.130392 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07c34a-92a6-40b6-9b0a-bc128cc3afbf admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:42.158951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2d0eb579-6eb0-48c1-96ef-68830de8f6bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96c4838e9d5e4064b1f78684725c4b05'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:42.180347 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1029/2074] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:41 2022] POST /identity/v3/users => generated 312 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:42.181860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07c34a-92a6-40b6-9b0a-bc128cc3afbf admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:42.188531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2d0eb579-6eb0-48c1-96ef-68830de8f6bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96c4838e9d5e4064b1f78684725c4b05'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:42.189272 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2d0eb579-6eb0-48c1-96ef-68830de8f6bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96c4838e9d5e4064b1f78684725c4b05'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:42.207386 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2d0eb579-6eb0-48c1-96ef-68830de8f6bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96c4838e9d5e4064b1f78684725c4b05'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:42.207817 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2d0eb579-6eb0-48c1-96ef-68830de8f6bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96c4838e9d5e4064b1f78684725c4b05'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:42.210651 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:42.216229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07c34a-92a6-40b6-9b0a-bc128cc3afbf admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:42.229073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc364b-503f-4369-a43d-7688376e4cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:42.229789 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc364b-503f-4369-a43d-7688376e4cce admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.230073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc364b-503f-4369-a43d-7688376e4cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.230437 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc364b-503f-4369-a43d-7688376e4cce admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.231123 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc364b-503f-4369-a43d-7688376e4cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:42.232762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc364b-503f-4369-a43d-7688376e4cce admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:42.247590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1046/2075] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:41 2022] DELETE /identity/v3/users/96c4838e9d5e4064b1f78684725c4b05 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:42.247590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0eb579-6eb0-48c1-96ef-68830de8f6bc admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:42.247590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2d0eb579-6eb0-48c1-96ef-68830de8f6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:42.279331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1030/2076] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:42 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:42.279331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c1f94-a072-4a01-824d-a205c02596d4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.279331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c1f94-a072-4a01-824d-a205c02596d4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.279331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c1f94-a072-4a01-824d-a205c02596d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.336023 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0d1c1f94-a072-4a01-824d-a205c02596d4 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:42.337292 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0d1c1f94-a072-4a01-824d-a205c02596d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:42.441519 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0eb579-6eb0-48c1-96ef-68830de8f6bc admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:42.456352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04a439-6fc9-4088-afd6-a1d8c47f5cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:42.457210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04a439-6fc9-4088-afd6-a1d8c47f5cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.457575 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04a439-6fc9-4088-afd6-a1d8c47f5cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.458078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04a439-6fc9-4088-afd6-a1d8c47f5cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.461355 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04a439-6fc9-4088-afd6-a1d8c47f5cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:42.463674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04a439-6fc9-4088-afd6-a1d8c47f5cc5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:42.509860 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1047/2077] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:42 2022] GET /identity/v3/roles => generated 1427 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:42.510598 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04a439-6fc9-4088-afd6-a1d8c47f5cc5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:42.525711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6b04a439-6fc9-4088-afd6-a1d8c47f5cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:42.554926 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04a439-6fc9-4088-afd6-a1d8c47f5cc5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:42.567293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e10be9-8c53-478b-b326-bd391da0bb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:42.568235 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e10be9-8c53-478b-b326-bd391da0bb0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.568525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e10be9-8c53-478b-b326-bd391da0bb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.568799 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e10be9-8c53-478b-b326-bd391da0bb0c admin admin] PATH_INFO: `/v3/projects/6fbbfddc514441ecb238c0f54b9956d3/users/db9c6c9d729c4bd1ae5240a57c209885/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.575666 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e10be9-8c53-478b-b326-bd391da0bb0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fbbfddc514441ecb238c0f54b9956d3, user_id=db9c6c9d729c4bd1ae5240a57c209885, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:42.583119 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e10be9-8c53-478b-b326-bd391da0bb0c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:42.593000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1031/2078] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:42.594872 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c1f94-a072-4a01-824d-a205c02596d4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:42.606801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1048/2079] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:42 2022] PUT /identity/v3/projects/6fbbfddc514441ecb238c0f54b9956d3/users/db9c6c9d729c4bd1ae5240a57c209885/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:42.610819 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e10be9-8c53-478b-b326-bd391da0bb0c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:42.614026 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-58e10be9-8c53-478b-b326-bd391da0bb0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:42.656880 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c1f94-a072-4a01-824d-a205c02596d4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:42.788223 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e10be9-8c53-478b-b326-bd391da0bb0c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:42.803478 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ebb26-4b3b-42e2-9d07-9b1f8010d9c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:42.804322 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ebb26-4b3b-42e2-9d07-9b1f8010d9c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.804708 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ebb26-4b3b-42e2-9d07-9b1f8010d9c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.805089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ebb26-4b3b-42e2-9d07-9b1f8010d9c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.811909 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb9752-3832-476c-bfc9-ca8c21eaf58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:42.813913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb9752-3832-476c-bfc9-ca8c21eaf58a admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.814417 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb9752-3832-476c-bfc9-ca8c21eaf58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.814945 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb9752-3832-476c-bfc9-ca8c21eaf58a admin admin] PATH_INFO: `/v3/projects/69b834ebc9ca4e03acc74ce59a0111bc/users/0f311e43289a43e89994827c5d93f942/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.819879 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ebb26-4b3b-42e2-9d07-9b1f8010d9c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:42.821996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ebb26-4b3b-42e2-9d07-9b1f8010d9c0 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:42.844815 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb9752-3832-476c-bfc9-ca8c21eaf58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b834ebc9ca4e03acc74ce59a0111bc, user_id=0f311e43289a43e89994827c5d93f942, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:42.846524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1049/2080] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:42.848178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96da97-35c3-4ba1-9be0-a574f5fe7ac3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.850413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb9752-3832-476c-bfc9-ca8c21eaf58a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:42.855878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96da97-35c3-4ba1-9be0-a574f5fe7ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.856410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96da97-35c3-4ba1-9be0-a574f5fe7ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.882883 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1032/2081] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:42 2022] PUT /identity/v3/projects/69b834ebc9ca4e03acc74ce59a0111bc/users/0f311e43289a43e89994827c5d93f942/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:42.887714 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb9752-3832-476c-bfc9-ca8c21eaf58a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:42.918303 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0e96da97-35c3-4ba1-9be0-a574f5fe7ac3 None None] MFA Rules not processed for user `db9c6c9d729c4bd1ae5240a57c209885`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:42.923103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0e96da97-35c3-4ba1-9be0-a574f5fe7ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:42.995255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:43.011327 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb9752-3832-476c-bfc9-ca8c21eaf58a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:43.022290 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b1e51-d7ad-4480-99ae-ebbd2a7c753e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:43.024090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b1e51-d7ad-4480-99ae-ebbd2a7c753e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:43.024706 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b1e51-d7ad-4480-99ae-ebbd2a7c753e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:43.025420 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b1e51-d7ad-4480-99ae-ebbd2a7c753e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:43.027354 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b1e51-d7ad-4480-99ae-ebbd2a7c753e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:43.031628 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b1e51-d7ad-4480-99ae-ebbd2a7c753e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:43.058797 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1033/2082] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:42 2022] GET /identity/v3/roles => generated 1427 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:43.060489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b1e51-d7ad-4480-99ae-ebbd2a7c753e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:43.082691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b1e51-d7ad-4480-99ae-ebbd2a7c753e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:43.102438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177970ab-d941-4038-9c51-105736322ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:43.104342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177970ab-d941-4038-9c51-105736322ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:43.106705 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177970ab-d941-4038-9c51-105736322ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:43.107400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177970ab-d941-4038-9c51-105736322ad9 admin admin] PATH_INFO: `/v3/projects/69b834ebc9ca4e03acc74ce59a0111bc/users/0f311e43289a43e89994827c5d93f942/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:43.112562 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1050/2083] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:42 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:43.114498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177970ab-d941-4038-9c51-105736322ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b834ebc9ca4e03acc74ce59a0111bc, user_id=0f311e43289a43e89994827c5d93f942, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:43.134814 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177970ab-d941-4038-9c51-105736322ad9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:43.137522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96da97-35c3-4ba1-9be0-a574f5fe7ac3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:43.141555 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0e96da97-35c3-4ba1-9be0-a574f5fe7ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:43.149223 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:43.184580 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1034/2084] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:43 2022] PUT /identity/v3/projects/69b834ebc9ca4e03acc74ce59a0111bc/users/0f311e43289a43e89994827c5d93f942/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:43.187842 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1f0d-30a0-4afa-8948-1a6bf1b247c7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:43.188399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1f0d-30a0-4afa-8948-1a6bf1b247c7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:43.188683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1f0d-30a0-4afa-8948-1a6bf1b247c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:43.280242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7a9f1f0d-30a0-4afa-8948-1a6bf1b247c7 None None] MFA Rules not processed for user `0f311e43289a43e89994827c5d93f942`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:43.281491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7a9f1f0d-30a0-4afa-8948-1a6bf1b247c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:43.289580 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96da97-35c3-4ba1-9be0-a574f5fe7ac3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:43.454522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc3ff4-f1bd-45bf-8c2f-8532f899d26c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:43.455274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc3ff4-f1bd-45bf-8c2f-8532f899d26c service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:43.456611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc3ff4-f1bd-45bf-8c2f-8532f899d26c service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:43.457507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc3ff4-f1bd-45bf-8c2f-8532f899d26c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:43.481356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1035/2085] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:43 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:43.509217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f1f0d-30a0-4afa-8948-1a6bf1b247c7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:43.512017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7a9f1f0d-30a0-4afa-8948-1a6bf1b247c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:43.607001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc3ff4-f1bd-45bf-8c2f-8532f899d26c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:43.608820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc3ff4-f1bd-45bf-8c2f-8532f899d26c service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:43.630988 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1051/2086] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:43 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:43.631881 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc3ff4-f1bd-45bf-8c2f-8532f899d26c service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:43.639965 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2adc3ff4-f1bd-45bf-8c2f-8532f899d26c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:43.654665 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc3ff4-f1bd-45bf-8c2f-8532f899d26c service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:43.664058 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2eb86f-48f9-45a0-a21a-81dba6fa290c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:43.665344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2eb86f-48f9-45a0-a21a-81dba6fa290c service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:43.667598 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2eb86f-48f9-45a0-a21a-81dba6fa290c service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:43.671263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2eb86f-48f9-45a0-a21a-81dba6fa290c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:43.686935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f1f0d-30a0-4afa-8948-1a6bf1b247c7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:43.692772 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2eb86f-48f9-45a0-a21a-81dba6fa290c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:43.694781 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2eb86f-48f9-45a0-a21a-81dba6fa290c service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:43.702350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2e903-a55a-4170-ba4e-3b07afb330c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:43.703308 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2e903-a55a-4170-ba4e-3b07afb330c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:43.703599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2e903-a55a-4170-ba4e-3b07afb330c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:43.703881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2e903-a55a-4170-ba4e-3b07afb330c7 admin admin] PATH_INFO: `/v3/projects/1c1d6785ad8343e0aab6433ea09939bd` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:43.712595 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2e903-a55a-4170-ba4e-3b07afb330c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1d6785ad8343e0aab6433ea09939bd)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:43.716238 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2e903-a55a-4170-ba4e-3b07afb330c7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:43.728734 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1052/2087] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:43 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:43.845971 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d7e2e903-a55a-4170-ba4e-3b07afb330c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1d6785ad8343e0aab6433ea09939bd', 'request_id': 'req-d7e2e903-a55a-4170-ba4e-3b07afb330c7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:43.867119 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d7e2e903-a55a-4170-ba4e-3b07afb330c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1d6785ad8343e0aab6433ea09939bd', 'request_id': 'req-d7e2e903-a55a-4170-ba4e-3b07afb330c7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:43.878744 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d7e2e903-a55a-4170-ba4e-3b07afb330c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1d6785ad8343e0aab6433ea09939bd', 'request_id': 'req-d7e2e903-a55a-4170-ba4e-3b07afb330c7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:43.900112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d7e2e903-a55a-4170-ba4e-3b07afb330c7 admin admin] The token cache is being invalidate because project 1c1d6785ad8343e0aab6433ea09939bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:43.900391 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d7e2e903-a55a-4170-ba4e-3b07afb330c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:43.901096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d7e2e903-a55a-4170-ba4e-3b07afb330c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:43.905780 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1036/2088] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:43 2022] DELETE /identity/v3/projects/1c1d6785ad8343e0aab6433ea09939bd => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:43.910254 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2eb86f-48f9-45a0-a21a-81dba6fa290c service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:43.943254 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2eb86f-48f9-45a0-a21a-81dba6fa290c service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:43.985302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:44.073446 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c41f4-915d-483b-98d4-d32b05392823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:44.074698 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c41f4-915d-483b-98d4-d32b05392823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:44.079578 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c41f4-915d-483b-98d4-d32b05392823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:44.080093 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c41f4-915d-483b-98d4-d32b05392823 admin admin] PATH_INFO: `/v3/users/2eb578e0994c4553881eef4d2129d8c4` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:44.081645 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c41f4-915d-483b-98d4-d32b05392823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eb578e0994c4553881eef4d2129d8c4)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:44.084635 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c41f4-915d-483b-98d4-d32b05392823 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:44.153394 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2e903-a55a-4170-ba4e-3b07afb330c7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:44.156453 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d7e2e903-a55a-4170-ba4e-3b07afb330c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:44.178737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-107c41f4-915d-483b-98d4-d32b05392823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eb578e0994c4553881eef4d2129d8c4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:44.198831 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:44.217115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-107c41f4-915d-483b-98d4-d32b05392823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eb578e0994c4553881eef4d2129d8c4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:44.217956 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-107c41f4-915d-483b-98d4-d32b05392823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eb578e0994c4553881eef4d2129d8c4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:44.232337 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-107c41f4-915d-483b-98d4-d32b05392823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eb578e0994c4553881eef4d2129d8c4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:44.235023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-107c41f4-915d-483b-98d4-d32b05392823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eb578e0994c4553881eef4d2129d8c4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:44.267274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1053/2089] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:43 2022] DELETE /identity/v3/users/2eb578e0994c4553881eef4d2129d8c4 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:44.312219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2e903-a55a-4170-ba4e-3b07afb330c7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:44.343392 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c41f4-915d-483b-98d4-d32b05392823 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:44.345531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-107c41f4-915d-483b-98d4-d32b05392823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:44.473624 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79180d5c-fc2b-41be-9ec5-c8b7e2159279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:44.475010 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79180d5c-fc2b-41be-9ec5-c8b7e2159279 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:44.475303 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79180d5c-fc2b-41be-9ec5-c8b7e2159279 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:44.475592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79180d5c-fc2b-41be-9ec5-c8b7e2159279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:44.477698 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-79180d5c-fc2b-41be-9ec5-c8b7e2159279 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:44.517123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c41f4-915d-483b-98d4-d32b05392823 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:44.527547 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b753f-6e4a-4963-9ff6-9a19b72802c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:44.528734 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b753f-6e4a-4963-9ff6-9a19b72802c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:44.529718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b753f-6e4a-4963-9ff6-9a19b72802c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:44.531028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b753f-6e4a-4963-9ff6-9a19b72802c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:44.534662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-228b753f-6e4a-4963-9ff6-9a19b72802c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:44.608301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79180d5c-fc2b-41be-9ec5-c8b7e2159279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:44.621724 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79180d5c-fc2b-41be-9ec5-c8b7e2159279 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:44.660196 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:44.664956 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b753f-6e4a-4963-9ff6-9a19b72802c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:44.666970 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b753f-6e4a-4963-9ff6-9a19b72802c3 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:44.669698 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1037/2090] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:44 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:44.691827 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1054/2091] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:44 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:44.883249 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79180d5c-fc2b-41be-9ec5-c8b7e2159279 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:44.885598 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-79180d5c-fc2b-41be-9ec5-c8b7e2159279 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:45.070329 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79180d5c-fc2b-41be-9ec5-c8b7e2159279 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:45.078470 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285c05e-d4cd-4380-86b9-aff46c3d4ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:45.080054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285c05e-d4cd-4380-86b9-aff46c3d4ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:45.080359 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285c05e-d4cd-4380-86b9-aff46c3d4ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:45.082834 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285c05e-d4cd-4380-86b9-aff46c3d4ddf admin admin] PATH_INFO: `/v3/projects/0246a37322e647099d8695762b59a541` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:45.089495 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285c05e-d4cd-4380-86b9-aff46c3d4ddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0246a37322e647099d8695762b59a541)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:45.093144 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285c05e-d4cd-4380-86b9-aff46c3d4ddf admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:45.212618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:45.301795 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a285c05e-d4cd-4380-86b9-aff46c3d4ddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0246a37322e647099d8695762b59a541', 'request_id': 'req-a285c05e-d4cd-4380-86b9-aff46c3d4ddf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:45.314134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a285c05e-d4cd-4380-86b9-aff46c3d4ddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0246a37322e647099d8695762b59a541', 'request_id': 'req-a285c05e-d4cd-4380-86b9-aff46c3d4ddf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:45.329880 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a285c05e-d4cd-4380-86b9-aff46c3d4ddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0246a37322e647099d8695762b59a541', 'request_id': 'req-a285c05e-d4cd-4380-86b9-aff46c3d4ddf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:45.365381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a285c05e-d4cd-4380-86b9-aff46c3d4ddf admin admin] The token cache is being invalidate because project 0246a37322e647099d8695762b59a541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:45.365723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a285c05e-d4cd-4380-86b9-aff46c3d4ddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:45.367786 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a285c05e-d4cd-4380-86b9-aff46c3d4ddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:45.370663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1038/2092] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:44 2022] DELETE /identity/v3/projects/0246a37322e647099d8695762b59a541 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:45.376476 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4eeba-dae4-487e-9d21-e3087b34a4f1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:45.377176 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4eeba-dae4-487e-9d21-e3087b34a4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:45.377419 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4eeba-dae4-487e-9d21-e3087b34a4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:45.412140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-cff4eeba-dae4-487e-9d21-e3087b34a4f1 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:45.416498 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cff4eeba-dae4-487e-9d21-e3087b34a4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:45.435099 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197780a-73f1-44ed-86a1-4e6845909c7e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:45.435503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197780a-73f1-44ed-86a1-4e6845909c7e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:45.435667 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197780a-73f1-44ed-86a1-4e6845909c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:45.483705 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f197780a-73f1-44ed-86a1-4e6845909c7e None None] MFA Rules not processed for user `713e3f20f94849c5bb6b88ba5af39868`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:45.485526 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f197780a-73f1-44ed-86a1-4e6845909c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:45.657628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1055/2093] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:45.658914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a7a59-58e4-4a5b-a441-d0df39e7c49d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:45.659212 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a7a59-58e4-4a5b-a441-d0df39e7c49d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:45.659503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a7a59-58e4-4a5b-a441-d0df39e7c49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:45.706063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1039/2094] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:45.709736 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54976e-616a-4bb2-adac-dd8cad3517a4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:45.710879 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54976e-616a-4bb2-adac-dd8cad3517a4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:45.711783 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7b2a7a59-58e4-4a5b-a441-d0df39e7c49d None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:45.712292 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54976e-616a-4bb2-adac-dd8cad3517a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:45.713051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7b2a7a59-58e4-4a5b-a441-d0df39e7c49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:45.740751 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1056/2095] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:45.752486 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a7a59-58e4-4a5b-a441-d0df39e7c49d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:45.767972 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7e54976e-616a-4bb2-adac-dd8cad3517a4 None None] MFA Rules not processed for user `713e3f20f94849c5bb6b88ba5af39868`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:45.769366 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7e54976e-616a-4bb2-adac-dd8cad3517a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:45.777216 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a7a59-58e4-4a5b-a441-d0df39e7c49d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:45.778978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1040/2096] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:45.800618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54976e-616a-4bb2-adac-dd8cad3517a4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:45.801428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdefc8-c86a-4e76-b16f-364822293ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:45.810949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdefc8-c86a-4e76-b16f-364822293ccc admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:45.810949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdefc8-c86a-4e76-b16f-364822293ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:45.810949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdefc8-c86a-4e76-b16f-364822293ccc admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:45.815548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfdefc8-c86a-4e76-b16f-364822293ccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:45.815548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfdefc8-c86a-4e76-b16f-364822293ccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:45.817081 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfdefc8-c86a-4e76-b16f-364822293ccc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:45.820060 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7e54976e-616a-4bb2-adac-dd8cad3517a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:45.862124 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1057/2097] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:43:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:43:45.869367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdefc8-c86a-4e76-b16f-364822293ccc admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:45.886681 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdefc8-c86a-4e76-b16f-364822293ccc admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:45.895188 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395c857-6663-41e7-82a4-75b0a8788b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:45.896475 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395c857-6663-41e7-82a4-75b0a8788b27 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:45.897586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395c857-6663-41e7-82a4-75b0a8788b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:45.898089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395c857-6663-41e7-82a4-75b0a8788b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:45.899105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395c857-6663-41e7-82a4-75b0a8788b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:45.901689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395c857-6663-41e7-82a4-75b0a8788b27 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:45.989052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1058/2098] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:45 2022] POST /identity/v3/projects => generated 386 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:43:45.992853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395c857-6663-41e7-82a4-75b0a8788b27 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:46.015490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54976e-616a-4bb2-adac-dd8cad3517a4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.132285 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:46.204137 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395c857-6663-41e7-82a4-75b0a8788b27 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.212857 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a5b4c-3999-44b3-a3df-a3d6b92734e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.215417 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbf09b-6e0d-47d4-b0fd-13172d09ccfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.216493 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbf09b-6e0d-47d4-b0fd-13172d09ccfc admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.216848 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a5b4c-3999-44b3-a3df-a3d6b92734e5 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.217120 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbf09b-6e0d-47d4-b0fd-13172d09ccfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.217311 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a5b4c-3999-44b3-a3df-a3d6b92734e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.217596 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbf09b-6e0d-47d4-b0fd-13172d09ccfc admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.217778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a5b4c-3999-44b3-a3df-a3d6b92734e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.218524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbf09b-6e0d-47d4-b0fd-13172d09ccfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.221903 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbf09b-6e0d-47d4-b0fd-13172d09ccfc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.259881 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1059/2099] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:45 2022] POST /identity/v3/users => generated 294 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:46.269368 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbf09b-6e0d-47d4-b0fd-13172d09ccfc admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:46.285151 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbf09b-6e0d-47d4-b0fd-13172d09ccfc admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.299711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c4485-3372-48f8-bc7e-65f9450d9b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.300422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c4485-3372-48f8-bc7e-65f9450d9b33 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.300875 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c4485-3372-48f8-bc7e-65f9450d9b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.301384 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c4485-3372-48f8-bc7e-65f9450d9b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.303056 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c4485-3372-48f8-bc7e-65f9450d9b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.305976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c4485-3372-48f8-bc7e-65f9450d9b33 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.320944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1060/2100] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:46 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:46.324271 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a5b4c-3999-44b3-a3df-a3d6b92734e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.325376 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c4485-3372-48f8-bc7e-65f9450d9b33 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:46.326702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a5b4c-3999-44b3-a3df-a3d6b92734e5 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.339095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c4485-3372-48f8-bc7e-65f9450d9b33 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.340705 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1041/2101] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:46.350390 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93a91e-d90d-4fa0-b50e-7e3575c1db68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.351614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93a91e-d90d-4fa0-b50e-7e3575c1db68 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.352067 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93a91e-d90d-4fa0-b50e-7e3575c1db68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.352525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93a91e-d90d-4fa0-b50e-7e3575c1db68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.353816 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93a91e-d90d-4fa0-b50e-7e3575c1db68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.356492 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93a91e-d90d-4fa0-b50e-7e3575c1db68 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.371375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1061/2102] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:46 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:43:46.377420 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a5b4c-3999-44b3-a3df-a3d6b92734e5 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:46.395143 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a5b4c-3999-44b3-a3df-a3d6b92734e5 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.402095 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c215c76-ebf6-4bb7-bff5-7b448feb808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.402095 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c215c76-ebf6-4bb7-bff5-7b448feb808e admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.402095 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c215c76-ebf6-4bb7-bff5-7b448feb808e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.402657 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c215c76-ebf6-4bb7-bff5-7b448feb808e admin admin] PATH_INFO: `/v3/projects/568189bbf3ca476e9cd17f8d701d0003/users/4afc235a043e402c9004a223278fc820/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.427200 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c215c76-ebf6-4bb7-bff5-7b448feb808e admin admin] RBAC: Authorizing `identity:create_grant(project_id=568189bbf3ca476e9cd17f8d701d0003, user_id=4afc235a043e402c9004a223278fc820, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.431810 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c215c76-ebf6-4bb7-bff5-7b448feb808e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.451012 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1042/2103] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:46 2022] PUT /identity/v3/projects/568189bbf3ca476e9cd17f8d701d0003/users/4afc235a043e402c9004a223278fc820/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:46.461445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba46909-ce37-45c2-9230-557ad8e24b4d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.462148 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba46909-ce37-45c2-9230-557ad8e24b4d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.462148 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba46909-ce37-45c2-9230-557ad8e24b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.509712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-eba46909-ce37-45c2-9230-557ad8e24b4d None None] MFA Rules not processed for user `4afc235a043e402c9004a223278fc820`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:46.511086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-eba46909-ce37-45c2-9230-557ad8e24b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:46.521301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:46.612556 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1062/2104] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:46.627335 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c215c76-ebf6-4bb7-bff5-7b448feb808e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:46.632574 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9c215c76-ebf6-4bb7-bff5-7b448feb808e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:46.697646 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377f723-62f6-4176-a581-458a9081497a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.698852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377f723-62f6-4176-a581-458a9081497a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.699250 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377f723-62f6-4176-a581-458a9081497a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.701435 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1063/2105] 10.222.0.110 () {54 vars in 917 bytes} [Thu May 26 16:43:46 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:43:46.711163 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79c292-b1ee-4f3a-b7e5-81dd8a2dd552 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.711670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79c292-b1ee-4f3a-b7e5-81dd8a2dd552 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.712027 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79c292-b1ee-4f3a-b7e5-81dd8a2dd552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.740460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c215c76-ebf6-4bb7-bff5-7b448feb808e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.740653 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6e79c292-b1ee-4f3a-b7e5-81dd8a2dd552 None None] MFA Rules not processed for user `f2411c1c780449e1a24fecb747cc3761`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:46.742029 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6e79c292-b1ee-4f3a-b7e5-81dd8a2dd552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:46.749046 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097944a-4a94-4bd5-a9f8-c9f5bb62ae2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.750108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097944a-4a94-4bd5-a9f8-c9f5bb62ae2b service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.750629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097944a-4a94-4bd5-a9f8-c9f5bb62ae2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.751097 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097944a-4a94-4bd5-a9f8-c9f5bb62ae2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.767230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097944a-4a94-4bd5-a9f8-c9f5bb62ae2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.769878 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097944a-4a94-4bd5-a9f8-c9f5bb62ae2b service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.786659 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1043/2106] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:46.812519 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1064/2107] 10.222.0.110 () {58 vars in 1014 bytes} [Thu May 26 16:43:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:46.828483 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097944a-4a94-4bd5-a9f8-c9f5bb62ae2b service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:46.830642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2097944a-4a94-4bd5-a9f8-c9f5bb62ae2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:46.850871 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097944a-4a94-4bd5-a9f8-c9f5bb62ae2b service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.858087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c40f21-c222-404b-acf0-06f18f0ca28a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.859178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c40f21-c222-404b-acf0-06f18f0ca28a service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.859866 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c40f21-c222-404b-acf0-06f18f0ca28a service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.860110 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c40f21-c222-404b-acf0-06f18f0ca28a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.873398 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c40f21-c222-404b-acf0-06f18f0ca28a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.876158 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c40f21-c222-404b-acf0-06f18f0ca28a service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.894796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1044/2108] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:43:47.566360 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1773c52-45b4-479c-9815-96819e079a69 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:47.566979 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1773c52-45b4-479c-9815-96819e079a69 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:47.566979 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1773c52-45b4-479c-9815-96819e079a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:47.599349 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d1773c52-45b4-479c-9815-96819e079a69 None None] MFA Rules not processed for user `713e3f20f94849c5bb6b88ba5af39868`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:47.600878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d1773c52-45b4-479c-9815-96819e079a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:47.737134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1065/2109] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:52.541926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c40f21-c222-404b-acf0-06f18f0ca28a service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:52.544588 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-21c40f21-c222-404b-acf0-06f18f0ca28a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:52.696058 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:52.765092 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c40f21-c222-404b-acf0-06f18f0ca28a service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:52.790954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d3eab-ca6a-423b-bbe5-4a5c0effb63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:52.795497 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d3eab-ca6a-423b-bbe5-4a5c0effb63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:52.802040 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d3eab-ca6a-423b-bbe5-4a5c0effb63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:52.802757 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d3eab-ca6a-423b-bbe5-4a5c0effb63a admin admin] PATH_INFO: `/v3/users/8d6d8d05541f49eab3126ed60d5ee3a8` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:52.807352 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d3eab-ca6a-423b-bbe5-4a5c0effb63a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d6d8d05541f49eab3126ed60d5ee3a8)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:52.819740 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d3eab-ca6a-423b-bbe5-4a5c0effb63a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:53.088952 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-505d3eab-ca6a-423b-bbe5-4a5c0effb63a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d6d8d05541f49eab3126ed60d5ee3a8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:53.090534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-505d3eab-ca6a-423b-bbe5-4a5c0effb63a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d6d8d05541f49eab3126ed60d5ee3a8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:53.131203 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-505d3eab-ca6a-423b-bbe5-4a5c0effb63a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d6d8d05541f49eab3126ed60d5ee3a8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:53.133925 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-505d3eab-ca6a-423b-bbe5-4a5c0effb63a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d6d8d05541f49eab3126ed60d5ee3a8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:53.154532 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-505d3eab-ca6a-423b-bbe5-4a5c0effb63a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d6d8d05541f49eab3126ed60d5ee3a8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:53.237951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1045/2110] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:52 2022] DELETE /identity/v3/users/8d6d8d05541f49eab3126ed60d5ee3a8 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:53.243157 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f48a8b-fe26-411f-b593-1deb7d9cbe5a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:53.244069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f48a8b-fe26-411f-b593-1deb7d9cbe5a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:53.244631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f48a8b-fe26-411f-b593-1deb7d9cbe5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:53.291909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-97f48a8b-fe26-411f-b593-1deb7d9cbe5a None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:53.293392 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-97f48a8b-fe26-411f-b593-1deb7d9cbe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:53.519798 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1066/2111] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:53.534819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d3eab-ca6a-423b-bbe5-4a5c0effb63a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:53.538015 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-505d3eab-ca6a-423b-bbe5-4a5c0effb63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:53.688170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d3eab-ca6a-423b-bbe5-4a5c0effb63a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:53.695638 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b7341-6df5-4a63-9537-7096daa36e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:53.696518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b7341-6df5-4a63-9537-7096daa36e5b service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:53.696879 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b7341-6df5-4a63-9537-7096daa36e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:53.697367 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b7341-6df5-4a63-9537-7096daa36e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:53.710532 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b7341-6df5-4a63-9537-7096daa36e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:53.713112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b7341-6df5-4a63-9537-7096daa36e5b service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:53.741722 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1046/2112] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:54.284570 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f48a8b-fe26-411f-b593-1deb7d9cbe5a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:54.287942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-97f48a8b-fe26-411f-b593-1deb7d9cbe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:54.304386 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:54.313927 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f48a8b-fe26-411f-b593-1deb7d9cbe5a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:54.345836 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76a8b8-1df8-4a53-8d01-f57e9678f748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:54.350295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76a8b8-1df8-4a53-8d01-f57e9678f748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:54.351579 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76a8b8-1df8-4a53-8d01-f57e9678f748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:54.352102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76a8b8-1df8-4a53-8d01-f57e9678f748 admin admin] PATH_INFO: `/v3/users/f7339b449de744fa83dd11acaacea08b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:54.358286 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76a8b8-1df8-4a53-8d01-f57e9678f748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7339b449de744fa83dd11acaacea08b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:54.361685 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76a8b8-1df8-4a53-8d01-f57e9678f748 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:54.525862 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5e76a8b8-1df8-4a53-8d01-f57e9678f748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7339b449de744fa83dd11acaacea08b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:54.542423 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5e76a8b8-1df8-4a53-8d01-f57e9678f748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7339b449de744fa83dd11acaacea08b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:54.543252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5e76a8b8-1df8-4a53-8d01-f57e9678f748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7339b449de744fa83dd11acaacea08b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:54.555740 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5e76a8b8-1df8-4a53-8d01-f57e9678f748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7339b449de744fa83dd11acaacea08b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:54.556909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5e76a8b8-1df8-4a53-8d01-f57e9678f748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7339b449de744fa83dd11acaacea08b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:54.604867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1067/2113] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:54 2022] DELETE /identity/v3/users/f7339b449de744fa83dd11acaacea08b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:54.606973 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832edc7c-36f2-4128-aa3a-0d177bccb85a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:54.607489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832edc7c-36f2-4128-aa3a-0d177bccb85a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:54.607784 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832edc7c-36f2-4128-aa3a-0d177bccb85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:54.686632 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-832edc7c-36f2-4128-aa3a-0d177bccb85a None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:54.707451 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-832edc7c-36f2-4128-aa3a-0d177bccb85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:54.834170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76a8b8-1df8-4a53-8d01-f57e9678f748 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:54.837160 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5e76a8b8-1df8-4a53-8d01-f57e9678f748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:54.898376 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1047/2114] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:54.913811 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832edc7c-36f2-4128-aa3a-0d177bccb85a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:54.925990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-832edc7c-36f2-4128-aa3a-0d177bccb85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:54.942416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:55.045314 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76a8b8-1df8-4a53-8d01-f57e9678f748 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:55.054700 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef4cf8-fa4a-4b8b-aaf2-0dc0c91a8552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:55.056971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef4cf8-fa4a-4b8b-aaf2-0dc0c91a8552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:55.058029 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef4cf8-fa4a-4b8b-aaf2-0dc0c91a8552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:55.058497 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef4cf8-fa4a-4b8b-aaf2-0dc0c91a8552 admin admin] PATH_INFO: `/v3/projects/b82578ab94c5486d9deb06a51a239f96` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:55.060683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef4cf8-fa4a-4b8b-aaf2-0dc0c91a8552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b82578ab94c5486d9deb06a51a239f96)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:55.064953 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef4cf8-fa4a-4b8b-aaf2-0dc0c91a8552 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:55.069525 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832edc7c-36f2-4128-aa3a-0d177bccb85a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:55.081260 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9efd6-9869-4b3a-b086-acfd3f9db983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:55.083252 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9efd6-9869-4b3a-b086-acfd3f9db983 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:55.084148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9efd6-9869-4b3a-b086-acfd3f9db983 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:55.084967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9efd6-9869-4b3a-b086-acfd3f9db983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:55.105128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9efd6-9869-4b3a-b086-acfd3f9db983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:55.106749 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9efd6-9869-4b3a-b086-acfd3f9db983 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:55.119871 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1048/2115] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:55.209455 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b7ef4cf8-fa4a-4b8b-aaf2-0dc0c91a8552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b82578ab94c5486d9deb06a51a239f96', 'request_id': 'req-b7ef4cf8-fa4a-4b8b-aaf2-0dc0c91a8552'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:55.220095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b7ef4cf8-fa4a-4b8b-aaf2-0dc0c91a8552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b82578ab94c5486d9deb06a51a239f96', 'request_id': 'req-b7ef4cf8-fa4a-4b8b-aaf2-0dc0c91a8552'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:55.234630 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b7ef4cf8-fa4a-4b8b-aaf2-0dc0c91a8552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b82578ab94c5486d9deb06a51a239f96', 'request_id': 'req-b7ef4cf8-fa4a-4b8b-aaf2-0dc0c91a8552'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:55.258108 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b7ef4cf8-fa4a-4b8b-aaf2-0dc0c91a8552 admin admin] The token cache is being invalidate because project b82578ab94c5486d9deb06a51a239f96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:55.258532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b7ef4cf8-fa4a-4b8b-aaf2-0dc0c91a8552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:55.259562 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b7ef4cf8-fa4a-4b8b-aaf2-0dc0c91a8552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:55.263647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1068/2116] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:54 2022] DELETE /identity/v3/projects/b82578ab94c5486d9deb06a51a239f96 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:55.271805 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9efd6-9869-4b3a-b086-acfd3f9db983 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:55.294051 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9efd6-9869-4b3a-b086-acfd3f9db983 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:55.496320 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e20449-1839-42ce-81ee-ad6ac869516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:55.497727 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e20449-1839-42ce-81ee-ad6ac869516f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:55.498115 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e20449-1839-42ce-81ee-ad6ac869516f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:55.498496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e20449-1839-42ce-81ee-ad6ac869516f admin admin] PATH_INFO: `/v3/users/db9c6c9d729c4bd1ae5240a57c209885` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:55.500629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e20449-1839-42ce-81ee-ad6ac869516f admin admin] RBAC: Authorizing `identity:delete_user(user_id=db9c6c9d729c4bd1ae5240a57c209885)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:55.503831 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e20449-1839-42ce-81ee-ad6ac869516f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:55.644402 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-85e20449-1839-42ce-81ee-ad6ac869516f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db9c6c9d729c4bd1ae5240a57c209885'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:55.645940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-85e20449-1839-42ce-81ee-ad6ac869516f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db9c6c9d729c4bd1ae5240a57c209885'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:55.655296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-85e20449-1839-42ce-81ee-ad6ac869516f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db9c6c9d729c4bd1ae5240a57c209885'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:55.656564 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-85e20449-1839-42ce-81ee-ad6ac869516f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db9c6c9d729c4bd1ae5240a57c209885'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:55.669517 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-85e20449-1839-42ce-81ee-ad6ac869516f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db9c6c9d729c4bd1ae5240a57c209885'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:55.706261 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1049/2117] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:55 2022] DELETE /identity/v3/users/db9c6c9d729c4bd1ae5240a57c209885 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:56.031357 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef4cf8-fa4a-4b8b-aaf2-0dc0c91a8552 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:56.034169 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b7ef4cf8-fa4a-4b8b-aaf2-0dc0c91a8552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:56.061935 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef4cf8-fa4a-4b8b-aaf2-0dc0c91a8552 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:56.067587 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:56.145766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb6093-15e9-4667-ba7e-8fe01da91732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:56.147089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb6093-15e9-4667-ba7e-8fe01da91732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:56.147600 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb6093-15e9-4667-ba7e-8fe01da91732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:56.148099 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb6093-15e9-4667-ba7e-8fe01da91732 admin admin] PATH_INFO: `/v3/users/4afc235a043e402c9004a223278fc820` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:56.150167 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb6093-15e9-4667-ba7e-8fe01da91732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4afc235a043e402c9004a223278fc820)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:56.152669 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb6093-15e9-4667-ba7e-8fe01da91732 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:56.247961 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b8eb6093-15e9-4667-ba7e-8fe01da91732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4afc235a043e402c9004a223278fc820'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.301089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b8eb6093-15e9-4667-ba7e-8fe01da91732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4afc235a043e402c9004a223278fc820'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.304533 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b8eb6093-15e9-4667-ba7e-8fe01da91732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4afc235a043e402c9004a223278fc820'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.318125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e20449-1839-42ce-81ee-ad6ac869516f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:56.323492 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-85e20449-1839-42ce-81ee-ad6ac869516f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:56.325735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b8eb6093-15e9-4667-ba7e-8fe01da91732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4afc235a043e402c9004a223278fc820'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.327886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b8eb6093-15e9-4667-ba7e-8fe01da91732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4afc235a043e402c9004a223278fc820'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.362098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e20449-1839-42ce-81ee-ad6ac869516f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:56.383860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fe126-fe19-44e1-9e65-e6ef4f718eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:56.386989 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fe126-fe19-44e1-9e65-e6ef4f718eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:56.387968 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fe126-fe19-44e1-9e65-e6ef4f718eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:56.389011 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fe126-fe19-44e1-9e65-e6ef4f718eaa admin admin] PATH_INFO: `/v3/projects/ea14e5aa38da487bb1909ed6e6608dee` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:56.389405 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1069/2118] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:56 2022] DELETE /identity/v3/users/4afc235a043e402c9004a223278fc820 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:56.392629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fe126-fe19-44e1-9e65-e6ef4f718eaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea14e5aa38da487bb1909ed6e6608dee)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:56.402487 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c94a75-8de0-4571-b044-8d4dd5e41fef None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:56.402952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c94a75-8de0-4571-b044-8d4dd5e41fef None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:56.403312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c94a75-8de0-4571-b044-8d4dd5e41fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:56.403441 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fe126-fe19-44e1-9e65-e6ef4f718eaa admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:56.460688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-54c94a75-8de0-4571-b044-8d4dd5e41fef None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:56.462165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-54c94a75-8de0-4571-b044-8d4dd5e41fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:56.475422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:56.572836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ba4fe126-fe19-44e1-9e65-e6ef4f718eaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea14e5aa38da487bb1909ed6e6608dee', 'request_id': 'req-ba4fe126-fe19-44e1-9e65-e6ef4f718eaa'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.597611 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ba4fe126-fe19-44e1-9e65-e6ef4f718eaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea14e5aa38da487bb1909ed6e6608dee', 'request_id': 'req-ba4fe126-fe19-44e1-9e65-e6ef4f718eaa'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.624442 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ba4fe126-fe19-44e1-9e65-e6ef4f718eaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea14e5aa38da487bb1909ed6e6608dee', 'request_id': 'req-ba4fe126-fe19-44e1-9e65-e6ef4f718eaa'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.641011 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ba4fe126-fe19-44e1-9e65-e6ef4f718eaa admin admin] The token cache is being invalidate because project ea14e5aa38da487bb1909ed6e6608dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:56.641998 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ba4fe126-fe19-44e1-9e65-e6ef4f718eaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.643512 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ba4fe126-fe19-44e1-9e65-e6ef4f718eaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.646020 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1050/2119] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:56 2022] DELETE /identity/v3/projects/ea14e5aa38da487bb1909ed6e6608dee => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:56.647249 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fe126-fe19-44e1-9e65-e6ef4f718eaa admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:56.649224 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ba4fe126-fe19-44e1-9e65-e6ef4f718eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:56.665942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1070/2120] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:56.668065 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c94a75-8de0-4571-b044-8d4dd5e41fef None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:56.685975 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-54c94a75-8de0-4571-b044-8d4dd5e41fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:56.710899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c94a75-8de0-4571-b044-8d4dd5e41fef None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:56.756067 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:56.771326 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fe126-fe19-44e1-9e65-e6ef4f718eaa admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:56.794562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa7f91-7043-4014-8fc9-acdb2fa67199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:56.798544 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa7f91-7043-4014-8fc9-acdb2fa67199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:56.799267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa7f91-7043-4014-8fc9-acdb2fa67199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:56.799895 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa7f91-7043-4014-8fc9-acdb2fa67199 admin admin] PATH_INFO: `/v3/projects/6fbbfddc514441ecb238c0f54b9956d3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:56.802395 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa7f91-7043-4014-8fc9-acdb2fa67199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fbbfddc514441ecb238c0f54b9956d3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:56.806557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa7f91-7043-4014-8fc9-acdb2fa67199 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:56.815065 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2a969-017b-4065-89ec-831410008389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:56.816140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2a969-017b-4065-89ec-831410008389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:56.816574 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2a969-017b-4065-89ec-831410008389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:56.816961 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2a969-017b-4065-89ec-831410008389 admin admin] PATH_INFO: `/v3/users/0f311e43289a43e89994827c5d93f942` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:56.819998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2a969-017b-4065-89ec-831410008389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f311e43289a43e89994827c5d93f942)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:56.822467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2a969-017b-4065-89ec-831410008389 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:56.918702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5df2a969-017b-4065-89ec-831410008389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f311e43289a43e89994827c5d93f942'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.931476 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dafa7f91-7043-4014-8fc9-acdb2fa67199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fbbfddc514441ecb238c0f54b9956d3', 'request_id': 'req-dafa7f91-7043-4014-8fc9-acdb2fa67199'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.939439 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5df2a969-017b-4065-89ec-831410008389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f311e43289a43e89994827c5d93f942'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.940795 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5df2a969-017b-4065-89ec-831410008389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f311e43289a43e89994827c5d93f942'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.942415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dafa7f91-7043-4014-8fc9-acdb2fa67199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fbbfddc514441ecb238c0f54b9956d3', 'request_id': 'req-dafa7f91-7043-4014-8fc9-acdb2fa67199'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.950630 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5df2a969-017b-4065-89ec-831410008389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f311e43289a43e89994827c5d93f942'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.951859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5df2a969-017b-4065-89ec-831410008389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f311e43289a43e89994827c5d93f942'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.955465 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dafa7f91-7043-4014-8fc9-acdb2fa67199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fbbfddc514441ecb238c0f54b9956d3', 'request_id': 'req-dafa7f91-7043-4014-8fc9-acdb2fa67199'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.972607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dafa7f91-7043-4014-8fc9-acdb2fa67199 admin admin] The token cache is being invalidate because project 6fbbfddc514441ecb238c0f54b9956d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:56.973057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dafa7f91-7043-4014-8fc9-acdb2fa67199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.973783 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1071/2121] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:43:56 2022] DELETE /identity/v3/users/0f311e43289a43e89994827c5d93f942 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:56.974863 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dafa7f91-7043-4014-8fc9-acdb2fa67199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:56.975072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2a969-017b-4065-89ec-831410008389 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:56.977419 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5df2a969-017b-4065-89ec-831410008389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:56.977663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1051/2122] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:56 2022] DELETE /identity/v3/projects/6fbbfddc514441ecb238c0f54b9956d3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:56.983601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd859310-e104-484f-aae4-473b8ba80538 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:56.983853 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd859310-e104-484f-aae4-473b8ba80538 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:56.984109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd859310-e104-484f-aae4-473b8ba80538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:57.014929 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dd859310-e104-484f-aae4-473b8ba80538 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:57.017486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dd859310-e104-484f-aae4-473b8ba80538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:57.101581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:57.116125 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2a969-017b-4065-89ec-831410008389 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:57.126309 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50d435-f3cc-422e-8ce3-bbc3a0de0ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:57.128116 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50d435-f3cc-422e-8ce3-bbc3a0de0ffd service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:57.128638 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50d435-f3cc-422e-8ce3-bbc3a0de0ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:57.129943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50d435-f3cc-422e-8ce3-bbc3a0de0ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:57.133001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-de50d435-f3cc-422e-8ce3-bbc3a0de0ffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:57.167170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1052/2123] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:57.171562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd7c92-11e2-44a7-91b8-33ad85185f58 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:57.171978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd7c92-11e2-44a7-91b8-33ad85185f58 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:57.172526 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd7c92-11e2-44a7-91b8-33ad85185f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:57.215640 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7afd7c92-11e2-44a7-91b8-33ad85185f58 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:57.218419 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7afd7c92-11e2-44a7-91b8-33ad85185f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:57.235852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1053/2124] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:57.241489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd7c92-11e2-44a7-91b8-33ad85185f58 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:57.243680 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:57.246855 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50d435-f3cc-422e-8ce3-bbc3a0de0ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:57.249357 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50d435-f3cc-422e-8ce3-bbc3a0de0ffd service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:57.258903 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd7c92-11e2-44a7-91b8-33ad85185f58 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:57.265303 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d64aba-ac70-4cf8-b5fb-cbbae66186e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:57.266389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d64aba-ac70-4cf8-b5fb-cbbae66186e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:57.266713 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d64aba-ac70-4cf8-b5fb-cbbae66186e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:57.266994 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d64aba-ac70-4cf8-b5fb-cbbae66186e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:57.267892 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d64aba-ac70-4cf8-b5fb-cbbae66186e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:57.268273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d64aba-ac70-4cf8-b5fb-cbbae66186e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:57.270284 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1072/2125] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:57.270726 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d64aba-ac70-4cf8-b5fb-cbbae66186e1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:57.295012 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1054/2126] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:43:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:43:57.302269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50d435-f3cc-422e-8ce3-bbc3a0de0ffd service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:57.320492 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50d435-f3cc-422e-8ce3-bbc3a0de0ffd service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:57.330970 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e64469-6d32-4598-a546-428dbc197e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:57.332154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e64469-6d32-4598-a546-428dbc197e35 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:57.332848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e64469-6d32-4598-a546-428dbc197e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:57.333380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e64469-6d32-4598-a546-428dbc197e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:57.334658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e64469-6d32-4598-a546-428dbc197e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:57.338102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e64469-6d32-4598-a546-428dbc197e35 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:57.415438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d64aba-ac70-4cf8-b5fb-cbbae66186e1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:57.416193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1073/2127] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:57 2022] POST /identity/v3/projects => generated 384 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:43:57.418924 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-19d64aba-ac70-4cf8-b5fb-cbbae66186e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:57.422278 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e64469-6d32-4598-a546-428dbc197e35 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:57.449581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d64aba-ac70-4cf8-b5fb-cbbae66186e1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:57.577059 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e64469-6d32-4598-a546-428dbc197e35 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:57.605570 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820c22a-3914-41ac-bc98-eaaf9d538e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:57.606973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820c22a-3914-41ac-bc98-eaaf9d538e32 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:57.607210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820c22a-3914-41ac-bc98-eaaf9d538e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:57.612404 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820c22a-3914-41ac-bc98-eaaf9d538e32 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:57.615568 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820c22a-3914-41ac-bc98-eaaf9d538e32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:57.620451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820c22a-3914-41ac-bc98-eaaf9d538e32 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:57.665228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1074/2128] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:57 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:43:57.673416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820c22a-3914-41ac-bc98-eaaf9d538e32 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:57.718006 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820c22a-3914-41ac-bc98-eaaf9d538e32 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:57.728098 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ad5aa-671b-44a5-bceb-82f5aad0ad4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:57.730113 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ad5aa-671b-44a5-bceb-82f5aad0ad4c admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:57.730595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ad5aa-671b-44a5-bceb-82f5aad0ad4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:57.730995 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ad5aa-671b-44a5-bceb-82f5aad0ad4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:57.732023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ad5aa-671b-44a5-bceb-82f5aad0ad4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:57.734227 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ad5aa-671b-44a5-bceb-82f5aad0ad4c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:57.749940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67ef02-f8cc-428a-880c-59dc64c92b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:57.750949 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67ef02-f8cc-428a-880c-59dc64c92b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:57.751239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67ef02-f8cc-428a-880c-59dc64c92b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:57.751653 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67ef02-f8cc-428a-880c-59dc64c92b28 admin admin] PATH_INFO: `/v3/projects/69b834ebc9ca4e03acc74ce59a0111bc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:57.754512 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67ef02-f8cc-428a-880c-59dc64c92b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b834ebc9ca4e03acc74ce59a0111bc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:57.757436 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67ef02-f8cc-428a-880c-59dc64c92b28 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:57.787281 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1075/2129] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:57 2022] GET /identity/v3/roles => generated 1427 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:57.789406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ad5aa-671b-44a5-bceb-82f5aad0ad4c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:57.830497 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ad5aa-671b-44a5-bceb-82f5aad0ad4c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:57.853455 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea77474-b520-4715-b2c1-29917ccad3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:57.856124 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77474-b520-4715-b2c1-29917ccad3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:57.856450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77474-b520-4715-b2c1-29917ccad3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:57.857064 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77474-b520-4715-b2c1-29917ccad3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:57.858047 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea77474-b520-4715-b2c1-29917ccad3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:57.860882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea77474-b520-4715-b2c1-29917ccad3e8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:57.891017 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1076/2130] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:57 2022] GET /identity/v3/roles => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:57.892664 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea77474-b520-4715-b2c1-29917ccad3e8 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:57.909943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea77474-b520-4715-b2c1-29917ccad3e8 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:57.936026 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9f67ef02-f8cc-428a-880c-59dc64c92b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b834ebc9ca4e03acc74ce59a0111bc', 'request_id': 'req-9f67ef02-f8cc-428a-880c-59dc64c92b28'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:57.950532 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9f67ef02-f8cc-428a-880c-59dc64c92b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b834ebc9ca4e03acc74ce59a0111bc', 'request_id': 'req-9f67ef02-f8cc-428a-880c-59dc64c92b28'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:57.980716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9f67ef02-f8cc-428a-880c-59dc64c92b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b834ebc9ca4e03acc74ce59a0111bc', 'request_id': 'req-9f67ef02-f8cc-428a-880c-59dc64c92b28'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:58.014033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e0f4d-ae39-4405-ba83-394ee2b18a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:58.015201 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e0f4d-ae39-4405-ba83-394ee2b18a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.015538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e0f4d-ae39-4405-ba83-394ee2b18a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.015935 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e0f4d-ae39-4405-ba83-394ee2b18a9f admin admin] PATH_INFO: `/v3/projects/8ffac4d7279944f9902387dca19c482a/users/71d30af735b643128517e6c640b722f3/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.023102 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9f67ef02-f8cc-428a-880c-59dc64c92b28 admin admin] The token cache is being invalidate because project 69b834ebc9ca4e03acc74ce59a0111bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:58.023593 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9f67ef02-f8cc-428a-880c-59dc64c92b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:58.035993 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9f67ef02-f8cc-428a-880c-59dc64c92b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:58.039690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1055/2131] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:57 2022] DELETE /identity/v3/projects/69b834ebc9ca4e03acc74ce59a0111bc => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:58.046997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c92921-24f2-47d9-8920-13990c424de2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.047597 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c92921-24f2-47d9-8920-13990c424de2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.047991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c92921-24f2-47d9-8920-13990c424de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.064891 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e0f4d-ae39-4405-ba83-394ee2b18a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ffac4d7279944f9902387dca19c482a, user_id=71d30af735b643128517e6c640b722f3, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:58.070996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e0f4d-ae39-4405-ba83-394ee2b18a9f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:58.084674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-82c92921-24f2-47d9-8920-13990c424de2 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:58.088638 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-82c92921-24f2-47d9-8920-13990c424de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:58.107758 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1077/2132] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:57 2022] PUT /identity/v3/projects/8ffac4d7279944f9902387dca19c482a/users/71d30af735b643128517e6c640b722f3/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:58.138339 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd55bd-2d26-4e84-bbf6-c16f12691e57 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.143303 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd55bd-2d26-4e84-bbf6-c16f12691e57 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.144206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd55bd-2d26-4e84-bbf6-c16f12691e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.184094 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:58.213756 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-45dd55bd-2d26-4e84-bbf6-c16f12691e57 None None] MFA Rules not processed for user `71d30af735b643128517e6c640b722f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:58.216420 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-45dd55bd-2d26-4e84-bbf6-c16f12691e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:58.226158 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1056/2133] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:58.228673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300d98c-3143-4f05-9bda-382f3ae156d0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.228991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300d98c-3143-4f05-9bda-382f3ae156d0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.229265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300d98c-3143-4f05-9bda-382f3ae156d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.253508 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:58.265472 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0300d98c-3143-4f05-9bda-382f3ae156d0 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:58.268325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0300d98c-3143-4f05-9bda-382f3ae156d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:58.286326 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1057/2134] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:58.292826 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300d98c-3143-4f05-9bda-382f3ae156d0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:58.327167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300d98c-3143-4f05-9bda-382f3ae156d0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:58.339543 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026fe37-ce38-41b7-b227-50c882cedb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:58.340708 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026fe37-ce38-41b7-b227-50c882cedb52 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.341477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026fe37-ce38-41b7-b227-50c882cedb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.342025 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026fe37-ce38-41b7-b227-50c882cedb52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.343650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026fe37-ce38-41b7-b227-50c882cedb52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:58.345660 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026fe37-ce38-41b7-b227-50c882cedb52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:58.348250 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026fe37-ce38-41b7-b227-50c882cedb52 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:58.385501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1058/2135] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:43:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:58.391411 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026fe37-ce38-41b7-b227-50c882cedb52 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:58.411141 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026fe37-ce38-41b7-b227-50c882cedb52 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:58.427250 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccad776-2f15-49b6-85ee-3ae4336b9f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:58.429030 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1078/2136] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:58.429898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccad776-2f15-49b6-85ee-3ae4336b9f37 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.430627 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccad776-2f15-49b6-85ee-3ae4336b9f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.431107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccad776-2f15-49b6-85ee-3ae4336b9f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.432496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccad776-2f15-49b6-85ee-3ae4336b9f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:58.435941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd55bd-2d26-4e84-bbf6-c16f12691e57 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:58.436616 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccad776-2f15-49b6-85ee-3ae4336b9f37 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:58.452018 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-45dd55bd-2d26-4e84-bbf6-c16f12691e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:58.467365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd55bd-2d26-4e84-bbf6-c16f12691e57 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:58.479456 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ea7c3-4d6b-4bd2-bb1f-79ae468053c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:58.480748 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ea7c3-4d6b-4bd2-bb1f-79ae468053c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.480748 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ea7c3-4d6b-4bd2-bb1f-79ae468053c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.483108 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ea7c3-4d6b-4bd2-bb1f-79ae468053c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.483108 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ea7c3-4d6b-4bd2-bb1f-79ae468053c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:58.489053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ea7c3-4d6b-4bd2-bb1f-79ae468053c1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:58.520903 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1059/2137] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:58 2022] POST /identity/v3/projects => generated 376 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:43:58.525286 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccad776-2f15-49b6-85ee-3ae4336b9f37 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:58.529590 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5ccad776-2f15-49b6-85ee-3ae4336b9f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:58.532209 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1079/2138] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:58 2022] POST /identity/v3/projects => generated 382 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:58.536454 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ea7c3-4d6b-4bd2-bb1f-79ae468053c1 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:58.622191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccad776-2f15-49b6-85ee-3ae4336b9f37 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:58.711949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ea7c3-4d6b-4bd2-bb1f-79ae468053c1 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:58.721027 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6970bc-308d-45f9-b4d6-929ee8733da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:58.722059 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6970bc-308d-45f9-b4d6-929ee8733da7 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.723054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6970bc-308d-45f9-b4d6-929ee8733da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.723579 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6970bc-308d-45f9-b4d6-929ee8733da7 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.724937 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6970bc-308d-45f9-b4d6-929ee8733da7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:58.728352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6970bc-308d-45f9-b4d6-929ee8733da7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:58.752854 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ad40c-bc24-4be9-a1bc-f22e3cd8fbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:58.754507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ad40c-bc24-4be9-a1bc-f22e3cd8fbbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.754846 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ad40c-bc24-4be9-a1bc-f22e3cd8fbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.755119 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ad40c-bc24-4be9-a1bc-f22e3cd8fbbb admin admin] PATH_INFO: `/v3/projects/568189bbf3ca476e9cd17f8d701d0003` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.756468 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ad40c-bc24-4be9-a1bc-f22e3cd8fbbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=568189bbf3ca476e9cd17f8d701d0003)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:58.758477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ad40c-bc24-4be9-a1bc-f22e3cd8fbbb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:58.767711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1080/2139] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:58 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:58.767711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6970bc-308d-45f9-b4d6-929ee8733da7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:58.788693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6970bc-308d-45f9-b4d6-929ee8733da7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:58.797234 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e057df8-20a7-4571-9461-1338d6ef1ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:58.798488 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e057df8-20a7-4571-9461-1338d6ef1ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.799042 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e057df8-20a7-4571-9461-1338d6ef1ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.799726 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e057df8-20a7-4571-9461-1338d6ef1ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.801591 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e057df8-20a7-4571-9461-1338d6ef1ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:58.804753 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e057df8-20a7-4571-9461-1338d6ef1ac1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:58.836036 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-af5ad40c-bc24-4be9-a1bc-f22e3cd8fbbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '568189bbf3ca476e9cd17f8d701d0003', 'request_id': 'req-af5ad40c-bc24-4be9-a1bc-f22e3cd8fbbb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:58.843291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1081/2140] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:58 2022] POST /identity/v3/users => generated 298 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:58.845204 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e057df8-20a7-4571-9461-1338d6ef1ac1 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:58.852581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-af5ad40c-bc24-4be9-a1bc-f22e3cd8fbbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '568189bbf3ca476e9cd17f8d701d0003', 'request_id': 'req-af5ad40c-bc24-4be9-a1bc-f22e3cd8fbbb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:58.855274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:58.858402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e057df8-20a7-4571-9461-1338d6ef1ac1 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:58.868562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-af5ad40c-bc24-4be9-a1bc-f22e3cd8fbbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '568189bbf3ca476e9cd17f8d701d0003', 'request_id': 'req-af5ad40c-bc24-4be9-a1bc-f22e3cd8fbbb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:58.896832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-af5ad40c-bc24-4be9-a1bc-f22e3cd8fbbb admin admin] The token cache is being invalidate because project 568189bbf3ca476e9cd17f8d701d0003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:58.897430 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-af5ad40c-bc24-4be9-a1bc-f22e3cd8fbbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:58.899941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-af5ad40c-bc24-4be9-a1bc-f22e3cd8fbbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:58.907662 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1060/2141] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:43:58 2022] DELETE /identity/v3/projects/568189bbf3ca476e9cd17f8d701d0003 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:58.907662 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ad40c-bc24-4be9-a1bc-f22e3cd8fbbb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:58.907662 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-af5ad40c-bc24-4be9-a1bc-f22e3cd8fbbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:58.962848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ed559-033e-4f55-8c48-70f5a045a92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:58.963885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ed559-033e-4f55-8c48-70f5a045a92c admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.964265 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ed559-033e-4f55-8c48-70f5a045a92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.964743 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ed559-033e-4f55-8c48-70f5a045a92c admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.965903 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ed559-033e-4f55-8c48-70f5a045a92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:58.969015 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ed559-033e-4f55-8c48-70f5a045a92c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:58.982627 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:58.999962 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1082/2142] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:58 2022] GET /identity/v3/roles => generated 1427 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:59.003609 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64970dba-1944-4072-b99e-06ad8689b0c5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.005388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64970dba-1944-4072-b99e-06ad8689b0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.006110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64970dba-1944-4072-b99e-06ad8689b0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.030496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ad40c-bc24-4be9-a1bc-f22e3cd8fbbb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:59.034289 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-64970dba-1944-4072-b99e-06ad8689b0c5 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:59.035752 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-64970dba-1944-4072-b99e-06ad8689b0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:59.037743 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70c494-fc54-47c2-a1cb-666525944ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:59.038680 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70c494-fc54-47c2-a1cb-666525944ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.039088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70c494-fc54-47c2-a1cb-666525944ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.039558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70c494-fc54-47c2-a1cb-666525944ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.040900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70c494-fc54-47c2-a1cb-666525944ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:59.043237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70c494-fc54-47c2-a1cb-666525944ed3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:59.047170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1083/2143] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:59.048560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64970dba-1944-4072-b99e-06ad8689b0c5 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:59.050050 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-64970dba-1944-4072-b99e-06ad8689b0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:59.060453 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1061/2144] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:58 2022] GET /identity/v3/roles => generated 1427 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:59.062424 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed414a-52fa-4007-8cb8-335186929dd0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.064257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed414a-52fa-4007-8cb8-335186929dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.064257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed414a-52fa-4007-8cb8-335186929dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.072394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64970dba-1944-4072-b99e-06ad8689b0c5 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:59.082817 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdc3f9-91ac-4bf7-8d2f-f7ce0b3a3a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:59.083859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdc3f9-91ac-4bf7-8d2f-f7ce0b3a3a36 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.084304 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdc3f9-91ac-4bf7-8d2f-f7ce0b3a3a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.084736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdc3f9-91ac-4bf7-8d2f-f7ce0b3a3a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.085723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdc3f9-91ac-4bf7-8d2f-f7ce0b3a3a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:59.087486 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdc3f9-91ac-4bf7-8d2f-f7ce0b3a3a36 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:59.092929 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e5ed414a-52fa-4007-8cb8-335186929dd0 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:59.094774 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e5ed414a-52fa-4007-8cb8-335186929dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:59.103755 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1084/2145] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:59 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:59.104825 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1062/2146] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:59.105183 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdc3f9-91ac-4bf7-8d2f-f7ce0b3a3a36 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:59.115212 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed414a-52fa-4007-8cb8-335186929dd0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:59.133066 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdc3f9-91ac-4bf7-8d2f-f7ce0b3a3a36 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:59.136019 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed414a-52fa-4007-8cb8-335186929dd0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:59.138990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb12d3-2fbf-4ea7-9494-81e0741aef93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:59.139900 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb12d3-2fbf-4ea7-9494-81e0741aef93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.140187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb12d3-2fbf-4ea7-9494-81e0741aef93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.141084 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb12d3-2fbf-4ea7-9494-81e0741aef93 admin admin] PATH_INFO: `/v3/projects/eb42d87edd1846f8844c97faf5b964ab/users/3dc8da69b2804e6299ed1bee1807faec/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.144451 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a2399-d684-40e5-a763-5d4a82ca2aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:59.147130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a2399-d684-40e5-a763-5d4a82ca2aff admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.147548 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a2399-d684-40e5-a763-5d4a82ca2aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.148036 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a2399-d684-40e5-a763-5d4a82ca2aff admin admin] PATH_INFO: `/v3/projects/936a59bc658642299dcf147c2edb8a9d/users/6f397bf708d64e16befce9daf1de323b/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.185580 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb12d3-2fbf-4ea7-9494-81e0741aef93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb42d87edd1846f8844c97faf5b964ab, user_id=3dc8da69b2804e6299ed1bee1807faec, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:59.190316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb12d3-2fbf-4ea7-9494-81e0741aef93 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:59.190555 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a2399-d684-40e5-a763-5d4a82ca2aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=936a59bc658642299dcf147c2edb8a9d, user_id=6f397bf708d64e16befce9daf1de323b, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:59.197159 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a2399-d684-40e5-a763-5d4a82ca2aff admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:59.215410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1085/2147] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:59 2022] PUT /identity/v3/projects/eb42d87edd1846f8844c97faf5b964ab/users/3dc8da69b2804e6299ed1bee1807faec/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:59.216696 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb12d3-2fbf-4ea7-9494-81e0741aef93 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:59.225728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1063/2148] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:59 2022] PUT /identity/v3/projects/936a59bc658642299dcf147c2edb8a9d/users/6f397bf708d64e16befce9daf1de323b/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:59.225728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a2399-d684-40e5-a763-5d4a82ca2aff admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:59.312484 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb12d3-2fbf-4ea7-9494-81e0741aef93 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:59.322408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b85b68-0f6f-4299-a64a-60ee3b7cb2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:59.323110 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a2399-d684-40e5-a763-5d4a82ca2aff admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:59.323339 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b85b68-0f6f-4299-a64a-60ee3b7cb2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.323644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b85b68-0f6f-4299-a64a-60ee3b7cb2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.324129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b85b68-0f6f-4299-a64a-60ee3b7cb2c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.325502 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b85b68-0f6f-4299-a64a-60ee3b7cb2c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:59.326187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b85b68-0f6f-4299-a64a-60ee3b7cb2c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:59.328387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8eb47-1a4f-4c2e-b8f6-937e5500dce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:59.329100 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b85b68-0f6f-4299-a64a-60ee3b7cb2c5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:59.329290 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8eb47-1a4f-4c2e-b8f6-937e5500dce5 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.329650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8eb47-1a4f-4c2e-b8f6-937e5500dce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.329937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8eb47-1a4f-4c2e-b8f6-937e5500dce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.330748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8eb47-1a4f-4c2e-b8f6-937e5500dce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:59.332888 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8eb47-1a4f-4c2e-b8f6-937e5500dce5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:59.353929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1086/2149] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:43:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:59.369702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1064/2150] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:59 2022] GET /identity/v3/roles => generated 1427 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:59.369702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8eb47-1a4f-4c2e-b8f6-937e5500dce5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:59.372303 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddce87-f5db-46df-98d6-cd62bb9c5532 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.375280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddce87-f5db-46df-98d6-cd62bb9c5532 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.376014 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddce87-f5db-46df-98d6-cd62bb9c5532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.382283 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8eb47-1a4f-4c2e-b8f6-937e5500dce5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:59.387735 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec9c54-bd90-4f1d-954f-040ff8de2071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:59.388504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec9c54-bd90-4f1d-954f-040ff8de2071 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.388869 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec9c54-bd90-4f1d-954f-040ff8de2071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.389219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec9c54-bd90-4f1d-954f-040ff8de2071 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.389941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec9c54-bd90-4f1d-954f-040ff8de2071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:59.392033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec9c54-bd90-4f1d-954f-040ff8de2071 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:59.428677 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1bddce87-f5db-46df-98d6-cd62bb9c5532 None None] MFA Rules not processed for user `6f397bf708d64e16befce9daf1de323b`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:59.430123 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1bddce87-f5db-46df-98d6-cd62bb9c5532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:59.435392 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1065/2151] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:43:59 2022] POST /identity/v3/projects => generated 374 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:59.436687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec9c54-bd90-4f1d-954f-040ff8de2071 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:59.498685 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:59.592625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec9c54-bd90-4f1d-954f-040ff8de2071 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:59.602195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1087/2152] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:59.604781 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddce87-f5db-46df-98d6-cd62bb9c5532 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:59.613626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff52ade-1132-4b0f-9aea-ce9e5b16dc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:59.615342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff52ade-1132-4b0f-9aea-ce9e5b16dc86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.615838 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff52ade-1132-4b0f-9aea-ce9e5b16dc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.616328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff52ade-1132-4b0f-9aea-ce9e5b16dc86 admin admin] PATH_INFO: `/v3/projects/eb42d87edd1846f8844c97faf5b964ab/users/3dc8da69b2804e6299ed1bee1807faec/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.620706 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff52ade-1132-4b0f-9aea-ce9e5b16dc86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb42d87edd1846f8844c97faf5b964ab, user_id=3dc8da69b2804e6299ed1bee1807faec, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:59.626980 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff52ade-1132-4b0f-9aea-ce9e5b16dc86 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:59.628367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddce87-f5db-46df-98d6-cd62bb9c5532 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:59.639493 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59edaa-2000-44cc-af2a-0d17143a5b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:59.640774 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59edaa-2000-44cc-af2a-0d17143a5b8f admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.641514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59edaa-2000-44cc-af2a-0d17143a5b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.642095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59edaa-2000-44cc-af2a-0d17143a5b8f admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.643789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59edaa-2000-44cc-af2a-0d17143a5b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:59.648387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59edaa-2000-44cc-af2a-0d17143a5b8f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:59.672568 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1066/2153] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:43:59 2022] PUT /identity/v3/projects/eb42d87edd1846f8844c97faf5b964ab/users/3dc8da69b2804e6299ed1bee1807faec/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:59.674007 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff52ade-1132-4b0f-9aea-ce9e5b16dc86 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:59.681334 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0ff52ade-1132-4b0f-9aea-ce9e5b16dc86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:59.691716 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1088/2154] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:43:59 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:59.694269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a35cfa-9d99-4f2c-ad16-0144a9917cdd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.695088 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a35cfa-9d99-4f2c-ad16-0144a9917cdd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.695504 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a35cfa-9d99-4f2c-ad16-0144a9917cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.736311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-79a35cfa-9d99-4f2c-ad16-0144a9917cdd None None] MFA Rules not processed for user `3dc8da69b2804e6299ed1bee1807faec`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:59.738603 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-79a35cfa-9d99-4f2c-ad16-0144a9917cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:59.759665 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:59.818306 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff52ade-1132-4b0f-9aea-ce9e5b16dc86 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:59.824181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c64040-1781-49cd-a257-770bb4be3349 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '363d16eebb3f40a1be71506961cc3c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:59.824877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c64040-1781-49cd-a257-770bb4be3349 service glance] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.825328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c64040-1781-49cd-a257-770bb4be3349 service glance] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.825761 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c64040-1781-49cd-a257-770bb4be3349 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.939224 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c64040-1781-49cd-a257-770bb4be3349 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:59.941022 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c64040-1781-49cd-a257-770bb4be3349 service glance] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:59.955642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1067/2155] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:43:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:59.956771 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c64040-1781-49cd-a257-770bb4be3349 service glance] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:00.004340 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1089/2156] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:43:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:00.060295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a35cfa-9d99-4f2c-ad16-0144a9917cdd None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:00.062541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-79a35cfa-9d99-4f2c-ad16-0144a9917cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:00.102189 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c64040-1781-49cd-a257-770bb4be3349 service glance] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:00.107932 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ae223-b7b7-4988-bb23-fc9a2613428c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:00.108763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ae223-b7b7-4988-bb23-fc9a2613428c admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:00.109060 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ae223-b7b7-4988-bb23-fc9a2613428c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:00.109338 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ae223-b7b7-4988-bb23-fc9a2613428c admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:00.110104 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ae223-b7b7-4988-bb23-fc9a2613428c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:00.112084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ae223-b7b7-4988-bb23-fc9a2613428c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:00.130356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1068/2157] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:43:59 2022] GET /identity/v3/roles => generated 1427 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:00.132235 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ae223-b7b7-4988-bb23-fc9a2613428c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:00.147657 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ae223-b7b7-4988-bb23-fc9a2613428c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:00.153764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100c3d7-79f2-4a9e-9bd1-935ba565a27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:00.154801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100c3d7-79f2-4a9e-9bd1-935ba565a27e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:00.155584 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100c3d7-79f2-4a9e-9bd1-935ba565a27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:00.156052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100c3d7-79f2-4a9e-9bd1-935ba565a27e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:00.156974 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100c3d7-79f2-4a9e-9bd1-935ba565a27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:00.158830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100c3d7-79f2-4a9e-9bd1-935ba565a27e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:00.163344 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:00.170475 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a35cfa-9d99-4f2c-ad16-0144a9917cdd None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:00.177055 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c599ec-f89b-4dcd-93c2-2b1bcc523118 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:00.179253 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c599ec-f89b-4dcd-93c2-2b1bcc523118 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:00.179253 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c599ec-f89b-4dcd-93c2-2b1bcc523118 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:00.179648 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c599ec-f89b-4dcd-93c2-2b1bcc523118 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:00.184715 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1069/2158] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:00 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:00.193503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100c3d7-79f2-4a9e-9bd1-935ba565a27e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:00.224367 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100c3d7-79f2-4a9e-9bd1-935ba565a27e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:00.237513 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b49b9-9c2a-4293-843c-2b2bff21664f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:00.238595 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b49b9-9c2a-4293-843c-2b2bff21664f admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:00.238894 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b49b9-9c2a-4293-843c-2b2bff21664f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:00.239208 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b49b9-9c2a-4293-843c-2b2bff21664f admin admin] PATH_INFO: `/v3/projects/820e73968d5148ceb83293d792efdd56/users/e9aeb94770024f30bc155ad87b71badc/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:00.269128 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c599ec-f89b-4dcd-93c2-2b1bcc523118 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:00.273129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c599ec-f89b-4dcd-93c2-2b1bcc523118 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:00.279454 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b49b9-9c2a-4293-843c-2b2bff21664f admin admin] RBAC: Authorizing `identity:create_grant(project_id=820e73968d5148ceb83293d792efdd56, user_id=e9aeb94770024f30bc155ad87b71badc, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:00.282559 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b49b9-9c2a-4293-843c-2b2bff21664f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:00.322863 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1070/2159] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:44:00 2022] PUT /identity/v3/projects/820e73968d5148ceb83293d792efdd56/users/e9aeb94770024f30bc155ad87b71badc/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:00.322985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1090/2160] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:00.324943 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531ca12-4d2f-4272-ab78-f8eefa9ae8ff None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:00.325347 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531ca12-4d2f-4272-ab78-f8eefa9ae8ff None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:00.325572 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531ca12-4d2f-4272-ab78-f8eefa9ae8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:00.424468 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0531ca12-4d2f-4272-ab78-f8eefa9ae8ff None None] MFA Rules not processed for user `e9aeb94770024f30bc155ad87b71badc`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:00.433006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0531ca12-4d2f-4272-ab78-f8eefa9ae8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:00.538070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c599ec-f89b-4dcd-93c2-2b1bcc523118 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:00.560330 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c599ec-f89b-4dcd-93c2-2b1bcc523118 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:00.659341 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1071/2161] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:00.666463 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531ca12-4d2f-4272-ab78-f8eefa9ae8ff None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:00.689893 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022539e0-e43f-47dc-a7db-90ad8fb07ad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:00.690635 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022539e0-e43f-47dc-a7db-90ad8fb07ad6 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:00.691182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022539e0-e43f-47dc-a7db-90ad8fb07ad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:00.691478 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022539e0-e43f-47dc-a7db-90ad8fb07ad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:00.695283 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-022539e0-e43f-47dc-a7db-90ad8fb07ad6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:00.818645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531ca12-4d2f-4272-ab78-f8eefa9ae8ff None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:00.828430 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3421bb-ca3d-413b-b0a6-ef6dc9ed7ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:00.829561 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3421bb-ca3d-413b-b0a6-ef6dc9ed7ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:00.830046 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3421bb-ca3d-413b-b0a6-ef6dc9ed7ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:00.830524 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3421bb-ca3d-413b-b0a6-ef6dc9ed7ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:00.838728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3421bb-ca3d-413b-b0a6-ef6dc9ed7ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:00.841246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3421bb-ca3d-413b-b0a6-ef6dc9ed7ac8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:00.931509 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022539e0-e43f-47dc-a7db-90ad8fb07ad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:00.933552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022539e0-e43f-47dc-a7db-90ad8fb07ad6 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:00.947521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1072/2162] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:44:00 2022] POST /identity/v3/projects => generated 374 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:44:00.950361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593129d-3334-497c-a6a5-f07ef550ec15 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:00.950681 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593129d-3334-497c-a6a5-f07ef550ec15 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:00.951132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593129d-3334-497c-a6a5-f07ef550ec15 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:00.952984 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1091/2163] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:00.953927 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1073/2164] 10.222.0.110 () {54 vars in 926 bytes} [Thu May 26 16:44:00 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:44:00.958542 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022539e0-e43f-47dc-a7db-90ad8fb07ad6 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:00.979247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022539e0-e43f-47dc-a7db-90ad8fb07ad6 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:00.986437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:01.109454 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7490f63-40a2-4cac-8716-e9f945ed581d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:01.114131 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7490f63-40a2-4cac-8716-e9f945ed581d admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:01.115264 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7490f63-40a2-4cac-8716-e9f945ed581d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:01.116553 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7490f63-40a2-4cac-8716-e9f945ed581d admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:01.120151 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7490f63-40a2-4cac-8716-e9f945ed581d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:01.125912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7490f63-40a2-4cac-8716-e9f945ed581d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:01.184044 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1092/2165] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:44:00 2022] POST /identity/v3/users => generated 294 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:01.185783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593129d-3334-497c-a6a5-f07ef550ec15 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:01.206788 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593129d-3334-497c-a6a5-f07ef550ec15 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:01.218443 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec383024-0db2-4951-8101-b129a6b24252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:01.219643 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec383024-0db2-4951-8101-b129a6b24252 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:01.221471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec383024-0db2-4951-8101-b129a6b24252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:01.222778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec383024-0db2-4951-8101-b129a6b24252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:01.223762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec383024-0db2-4951-8101-b129a6b24252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:01.245283 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec383024-0db2-4951-8101-b129a6b24252 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:01.266755 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7490f63-40a2-4cac-8716-e9f945ed581d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:01.273316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1074/2166] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:01 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:01.285851 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7490f63-40a2-4cac-8716-e9f945ed581d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:01.290970 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9661d2a-b0be-4035-a0c3-10aeb878b3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:01.291916 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661d2a-b0be-4035-a0c3-10aeb878b3fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:01.292210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661d2a-b0be-4035-a0c3-10aeb878b3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:01.292591 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661d2a-b0be-4035-a0c3-10aeb878b3fc admin admin] PATH_INFO: `/v3/projects/9769cb835bf84f9ca0998b760697f36b/users/0df9242e85714764a39f0728e28e757c/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:01.321350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7e858-8d73-4510-920d-c37eebbbd18f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:01.321979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7e858-8d73-4510-920d-c37eebbbd18f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:01.322502 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7e858-8d73-4510-920d-c37eebbbd18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:01.342861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9661d2a-b0be-4035-a0c3-10aeb878b3fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9769cb835bf84f9ca0998b760697f36b, user_id=0df9242e85714764a39f0728e28e757c, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:01.350293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9661d2a-b0be-4035-a0c3-10aeb878b3fc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:01.353932 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2fb7e858-8d73-4510-920d-c37eebbbd18f None None] MFA Rules not processed for user `9ffef7640dd1487ab2ea91fc0f4be9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:01.355859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2fb7e858-8d73-4510-920d-c37eebbbd18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:01.399468 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1093/2167] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:44:01 2022] PUT /identity/v3/projects/9769cb835bf84f9ca0998b760697f36b/users/0df9242e85714764a39f0728e28e757c/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:01.403592 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9661d2a-b0be-4035-a0c3-10aeb878b3fc admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:01.455166 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:01.578172 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1075/2168] 10.222.0.110 () {58 vars in 1023 bytes} [Thu May 26 16:44:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:01.600523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7e858-8d73-4510-920d-c37eebbbd18f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:01.602951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2fb7e858-8d73-4510-920d-c37eebbbd18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:01.610342 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9661d2a-b0be-4035-a0c3-10aeb878b3fc admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:01.622965 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a66eec-2822-41b8-bc01-f4cb298f91aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:01.624460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a66eec-2822-41b8-bc01-f4cb298f91aa admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:01.625038 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a66eec-2822-41b8-bc01-f4cb298f91aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:01.625648 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a66eec-2822-41b8-bc01-f4cb298f91aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:01.628035 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a66eec-2822-41b8-bc01-f4cb298f91aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:01.628253 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7e858-8d73-4510-920d-c37eebbbd18f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:01.632911 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a66eec-2822-41b8-bc01-f4cb298f91aa admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:01.674027 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1094/2169] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:01 2022] GET /identity/v3/roles => generated 1427 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:44:01.678263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a66eec-2822-41b8-bc01-f4cb298f91aa admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:01.714289 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a66eec-2822-41b8-bc01-f4cb298f91aa admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:01.723072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88c2ae-4d59-4027-9037-8109fa6da17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:01.724735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88c2ae-4d59-4027-9037-8109fa6da17a admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:01.725333 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88c2ae-4d59-4027-9037-8109fa6da17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:01.725628 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88c2ae-4d59-4027-9037-8109fa6da17a admin admin] PATH_INFO: `/v3/projects/9769cb835bf84f9ca0998b760697f36b/users/0df9242e85714764a39f0728e28e757c/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:01.729927 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88c2ae-4d59-4027-9037-8109fa6da17a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9769cb835bf84f9ca0998b760697f36b, user_id=0df9242e85714764a39f0728e28e757c, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:01.735078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88c2ae-4d59-4027-9037-8109fa6da17a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:01.757556 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eca1d1-820b-4c72-ba26-caa63413757c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ffef7640dd1487ab2ea91fc0f4be9e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:01.758347 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1095/2170] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:44:01 2022] PUT /identity/v3/projects/9769cb835bf84f9ca0998b760697f36b/users/0df9242e85714764a39f0728e28e757c/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:01.758483 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eca1d1-820b-4c72-ba26-caa63413757c service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:01.758672 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eca1d1-820b-4c72-ba26-caa63413757c service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:01.759084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eca1d1-820b-4c72-ba26-caa63413757c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:01.759278 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88c2ae-4d59-4027-9037-8109fa6da17a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:01.774014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eca1d1-820b-4c72-ba26-caa63413757c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:01.777284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eca1d1-820b-4c72-ba26-caa63413757c service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:01.796201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1076/2171] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:44:01.798298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aed522-8366-4302-aa23-5b4aa9aa823b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:01.799238 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aed522-8366-4302-aa23-5b4aa9aa823b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:01.799879 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aed522-8366-4302-aa23-5b4aa9aa823b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:01.852223 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-88aed522-8366-4302-aa23-5b4aa9aa823b None None] MFA Rules not processed for user `0df9242e85714764a39f0728e28e757c`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:01.858824 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-88aed522-8366-4302-aa23-5b4aa9aa823b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:01.928960 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:01.952206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88c2ae-4d59-4027-9037-8109fa6da17a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:01.963708 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5e998-86f8-4d11-ba97-ef3ade1c5366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:01.965243 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5e998-86f8-4d11-ba97-ef3ade1c5366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:01.965734 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5e998-86f8-4d11-ba97-ef3ade1c5366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:01.966250 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5e998-86f8-4d11-ba97-ef3ade1c5366 admin admin] PATH_INFO: `/v3/users/71d30af735b643128517e6c640b722f3` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:01.968727 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5e998-86f8-4d11-ba97-ef3ade1c5366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71d30af735b643128517e6c640b722f3)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:01.973397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5e998-86f8-4d11-ba97-ef3ade1c5366 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:02.015646 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1077/2172] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:02.030132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aed522-8366-4302-aa23-5b4aa9aa823b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:02.031552 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-88aed522-8366-4302-aa23-5b4aa9aa823b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:02.090909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4cd5e998-86f8-4d11-ba97-ef3ade1c5366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71d30af735b643128517e6c640b722f3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.118026 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4cd5e998-86f8-4d11-ba97-ef3ade1c5366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71d30af735b643128517e6c640b722f3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.118826 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4cd5e998-86f8-4d11-ba97-ef3ade1c5366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71d30af735b643128517e6c640b722f3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.130544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4cd5e998-86f8-4d11-ba97-ef3ade1c5366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71d30af735b643128517e6c640b722f3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.131785 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4cd5e998-86f8-4d11-ba97-ef3ade1c5366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71d30af735b643128517e6c640b722f3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.134425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:02.141367 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aed522-8366-4302-aa23-5b4aa9aa823b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:02.149913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec2e10-9a13-443a-beed-cc45c8e27376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:02.151359 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec2e10-9a13-443a-beed-cc45c8e27376 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:02.151688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec2e10-9a13-443a-beed-cc45c8e27376 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:02.151975 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec2e10-9a13-443a-beed-cc45c8e27376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:02.154541 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c5ec2e10-9a13-443a-beed-cc45c8e27376 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:02.163260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1096/2173] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:44:01 2022] DELETE /identity/v3/users/71d30af735b643128517e6c640b722f3 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:02.167878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d9151-ef22-4570-bcaf-e0e3ba37fa6b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:02.168178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d9151-ef22-4570-bcaf-e0e3ba37fa6b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:02.168454 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d9151-ef22-4570-bcaf-e0e3ba37fa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:02.192795 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d66d9151-ef22-4570-bcaf-e0e3ba37fa6b None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:02.194144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d66d9151-ef22-4570-bcaf-e0e3ba37fa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:02.334667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1097/2174] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:02.338688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d9151-ef22-4570-bcaf-e0e3ba37fa6b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:02.340465 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d66d9151-ef22-4570-bcaf-e0e3ba37fa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:02.406942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec2e10-9a13-443a-beed-cc45c8e27376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:02.410666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec2e10-9a13-443a-beed-cc45c8e27376 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:02.450427 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d9151-ef22-4570-bcaf-e0e3ba37fa6b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:02.457161 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7cb8e5-1cc9-4b76-b8c5-281f6cc885d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:02.457161 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cb8e5-1cc9-4b76-b8c5-281f6cc885d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:02.457763 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cb8e5-1cc9-4b76-b8c5-281f6cc885d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:02.458215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cb8e5-1cc9-4b76-b8c5-281f6cc885d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:02.462975 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1078/2175] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:44:02.486287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7cb8e5-1cc9-4b76-b8c5-281f6cc885d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:02.494254 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7cb8e5-1cc9-4b76-b8c5-281f6cc885d7 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:02.515767 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1098/2176] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:44:02.586251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec2e10-9a13-443a-beed-cc45c8e27376 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:02.589538 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c5ec2e10-9a13-443a-beed-cc45c8e27376 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:02.636812 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec2e10-9a13-443a-beed-cc45c8e27376 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:02.649246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab5f6b-2f61-4c57-8548-6d26fa1ced7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:02.650957 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab5f6b-2f61-4c57-8548-6d26fa1ced7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:02.651461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab5f6b-2f61-4c57-8548-6d26fa1ced7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:02.652285 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab5f6b-2f61-4c57-8548-6d26fa1ced7f admin admin] PATH_INFO: `/v3/users/f2d78730896c4d3e8deb9082c83688f0` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:02.656005 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab5f6b-2f61-4c57-8548-6d26fa1ced7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d78730896c4d3e8deb9082c83688f0)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:02.661361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab5f6b-2f61-4c57-8548-6d26fa1ced7f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:02.758745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-06ab5f6b-2f61-4c57-8548-6d26fa1ced7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d78730896c4d3e8deb9082c83688f0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.759622 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-06ab5f6b-2f61-4c57-8548-6d26fa1ced7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d78730896c4d3e8deb9082c83688f0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.772877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-06ab5f6b-2f61-4c57-8548-6d26fa1ced7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d78730896c4d3e8deb9082c83688f0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.773406 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-06ab5f6b-2f61-4c57-8548-6d26fa1ced7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d78730896c4d3e8deb9082c83688f0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.788419 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-06ab5f6b-2f61-4c57-8548-6d26fa1ced7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d78730896c4d3e8deb9082c83688f0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.820309 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1079/2177] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:44:02 2022] DELETE /identity/v3/users/f2d78730896c4d3e8deb9082c83688f0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:03.021745 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7cb8e5-1cc9-4b76-b8c5-281f6cc885d7 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:03.023612 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5e7cb8e5-1cc9-4b76-b8c5-281f6cc885d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:03.043153 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7cb8e5-1cc9-4b76-b8c5-281f6cc885d7 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:03.060884 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:03.159571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be3a22-9ddd-4fcf-a2e3-acc536aed6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:03.159571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be3a22-9ddd-4fcf-a2e3-acc536aed6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:03.159571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be3a22-9ddd-4fcf-a2e3-acc536aed6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:03.159571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be3a22-9ddd-4fcf-a2e3-acc536aed6a2 admin admin] PATH_INFO: `/v3/projects/8ffac4d7279944f9902387dca19c482a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:03.161499 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be3a22-9ddd-4fcf-a2e3-acc536aed6a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ffac4d7279944f9902387dca19c482a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:03.165949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be3a22-9ddd-4fcf-a2e3-acc536aed6a2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:03.233251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab5f6b-2f61-4c57-8548-6d26fa1ced7f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:03.248264 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-06ab5f6b-2f61-4c57-8548-6d26fa1ced7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:03.279985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab5f6b-2f61-4c57-8548-6d26fa1ced7f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:03.290088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415a784-211f-438e-9c0e-997c7eeb3bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:03.291751 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415a784-211f-438e-9c0e-997c7eeb3bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:03.292039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415a784-211f-438e-9c0e-997c7eeb3bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:03.295205 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415a784-211f-438e-9c0e-997c7eeb3bbb admin admin] PATH_INFO: `/v3/projects/6d0913158bb94346b0885f8b42be3c54` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:03.300007 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415a784-211f-438e-9c0e-997c7eeb3bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d0913158bb94346b0885f8b42be3c54)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:03.302153 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415a784-211f-438e-9c0e-997c7eeb3bbb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:03.350121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a5be3a22-9ddd-4fcf-a2e3-acc536aed6a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ffac4d7279944f9902387dca19c482a', 'request_id': 'req-a5be3a22-9ddd-4fcf-a2e3-acc536aed6a2'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.366455 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a5be3a22-9ddd-4fcf-a2e3-acc536aed6a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ffac4d7279944f9902387dca19c482a', 'request_id': 'req-a5be3a22-9ddd-4fcf-a2e3-acc536aed6a2'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.383581 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a5be3a22-9ddd-4fcf-a2e3-acc536aed6a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ffac4d7279944f9902387dca19c482a', 'request_id': 'req-a5be3a22-9ddd-4fcf-a2e3-acc536aed6a2'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.410744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a5be3a22-9ddd-4fcf-a2e3-acc536aed6a2 admin admin] The token cache is being invalidate because project 8ffac4d7279944f9902387dca19c482a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:03.411117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a5be3a22-9ddd-4fcf-a2e3-acc536aed6a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.412765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a5be3a22-9ddd-4fcf-a2e3-acc536aed6a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.422789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1099/2178] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:44:03 2022] DELETE /identity/v3/projects/8ffac4d7279944f9902387dca19c482a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:03.425924 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be3a22-9ddd-4fcf-a2e3-acc536aed6a2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:03.432877 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a5be3a22-9ddd-4fcf-a2e3-acc536aed6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:03.443609 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f415a784-211f-438e-9c0e-997c7eeb3bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d0913158bb94346b0885f8b42be3c54', 'request_id': 'req-f415a784-211f-438e-9c0e-997c7eeb3bbb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.460764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f415a784-211f-438e-9c0e-997c7eeb3bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d0913158bb94346b0885f8b42be3c54', 'request_id': 'req-f415a784-211f-438e-9c0e-997c7eeb3bbb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.488410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f415a784-211f-438e-9c0e-997c7eeb3bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d0913158bb94346b0885f8b42be3c54', 'request_id': 'req-f415a784-211f-438e-9c0e-997c7eeb3bbb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.507651 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:03.523582 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f415a784-211f-438e-9c0e-997c7eeb3bbb admin admin] The token cache is being invalidate because project 6d0913158bb94346b0885f8b42be3c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:03.525620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f415a784-211f-438e-9c0e-997c7eeb3bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.527450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f415a784-211f-438e-9c0e-997c7eeb3bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.535467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1080/2179] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:44:03 2022] DELETE /identity/v3/projects/6d0913158bb94346b0885f8b42be3c54 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:03.545297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415a784-211f-438e-9c0e-997c7eeb3bbb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:03.551798 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f415a784-211f-438e-9c0e-997c7eeb3bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:03.598009 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be3a22-9ddd-4fcf-a2e3-acc536aed6a2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:03.673521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415a784-211f-438e-9c0e-997c7eeb3bbb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:03.679188 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7525f-4e47-45b9-aa0d-a8624f798f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:03.680276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7525f-4e47-45b9-aa0d-a8624f798f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:03.680661 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7525f-4e47-45b9-aa0d-a8624f798f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:03.681033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7525f-4e47-45b9-aa0d-a8624f798f3b admin admin] PATH_INFO: `/v3/users/5826cbef64ba441c8d26bb3c697cf349` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:03.682598 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7525f-4e47-45b9-aa0d-a8624f798f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5826cbef64ba441c8d26bb3c697cf349)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:03.684688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7525f-4e47-45b9-aa0d-a8624f798f3b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:03.723458 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:03.737254 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332e96c-2a94-453f-8f7f-9690898cd38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:03.738860 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332e96c-2a94-453f-8f7f-9690898cd38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:03.739762 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332e96c-2a94-453f-8f7f-9690898cd38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:03.740667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332e96c-2a94-453f-8f7f-9690898cd38e admin admin] PATH_INFO: `/v3/users/3dc8da69b2804e6299ed1bee1807faec` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:03.743054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332e96c-2a94-453f-8f7f-9690898cd38e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc8da69b2804e6299ed1bee1807faec)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:03.745536 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332e96c-2a94-453f-8f7f-9690898cd38e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:03.760716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1fd7525f-4e47-45b9-aa0d-a8624f798f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5826cbef64ba441c8d26bb3c697cf349'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.761668 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1fd7525f-4e47-45b9-aa0d-a8624f798f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5826cbef64ba441c8d26bb3c697cf349'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.776220 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1fd7525f-4e47-45b9-aa0d-a8624f798f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5826cbef64ba441c8d26bb3c697cf349'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.777278 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1fd7525f-4e47-45b9-aa0d-a8624f798f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5826cbef64ba441c8d26bb3c697cf349'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.792911 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1fd7525f-4e47-45b9-aa0d-a8624f798f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5826cbef64ba441c8d26bb3c697cf349'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.828218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1081/2180] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:44:03 2022] DELETE /identity/v3/users/5826cbef64ba441c8d26bb3c697cf349 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:03.838617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a332e96c-2a94-453f-8f7f-9690898cd38e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc8da69b2804e6299ed1bee1807faec'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.864580 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a332e96c-2a94-453f-8f7f-9690898cd38e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc8da69b2804e6299ed1bee1807faec'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.866256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a332e96c-2a94-453f-8f7f-9690898cd38e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc8da69b2804e6299ed1bee1807faec'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.890614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a332e96c-2a94-453f-8f7f-9690898cd38e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc8da69b2804e6299ed1bee1807faec'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.891407 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a332e96c-2a94-453f-8f7f-9690898cd38e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc8da69b2804e6299ed1bee1807faec'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.919433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1100/2181] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:44:03 2022] DELETE /identity/v3/users/3dc8da69b2804e6299ed1bee1807faec => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:04.120491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7525f-4e47-45b9-aa0d-a8624f798f3b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:04.123863 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1fd7525f-4e47-45b9-aa0d-a8624f798f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:04.269182 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7525f-4e47-45b9-aa0d-a8624f798f3b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:04.294612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:04.358693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd498b-3083-4c91-85d4-b4507713df27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:04.358693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd498b-3083-4c91-85d4-b4507713df27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.358693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd498b-3083-4c91-85d4-b4507713df27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.358693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd498b-3083-4c91-85d4-b4507713df27 admin admin] PATH_INFO: `/v3/projects/ebc7000e202947c7bb269e7457bf6a3a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.360484 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd498b-3083-4c91-85d4-b4507713df27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc7000e202947c7bb269e7457bf6a3a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:04.363564 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd498b-3083-4c91-85d4-b4507713df27 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:04.414477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332e96c-2a94-453f-8f7f-9690898cd38e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:04.417441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a332e96c-2a94-453f-8f7f-9690898cd38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:04.438758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-97fd498b-3083-4c91-85d4-b4507713df27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc7000e202947c7bb269e7457bf6a3a', 'request_id': 'req-97fd498b-3083-4c91-85d4-b4507713df27'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:04.468350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332e96c-2a94-453f-8f7f-9690898cd38e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:04.471403 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-97fd498b-3083-4c91-85d4-b4507713df27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc7000e202947c7bb269e7457bf6a3a', 'request_id': 'req-97fd498b-3083-4c91-85d4-b4507713df27'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:04.489861 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-97fd498b-3083-4c91-85d4-b4507713df27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc7000e202947c7bb269e7457bf6a3a', 'request_id': 'req-97fd498b-3083-4c91-85d4-b4507713df27'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:04.509587 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-97fd498b-3083-4c91-85d4-b4507713df27 admin admin] The token cache is being invalidate because project ebc7000e202947c7bb269e7457bf6a3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:04.510404 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-97fd498b-3083-4c91-85d4-b4507713df27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:04.511617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-97fd498b-3083-4c91-85d4-b4507713df27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:04.519393 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1082/2182] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:44:04 2022] DELETE /identity/v3/projects/ebc7000e202947c7bb269e7457bf6a3a => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:04.535118 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1f881-dd5e-4344-bc63-ee7ca8038196 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.535118 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1f881-dd5e-4344-bc63-ee7ca8038196 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.535118 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1f881-dd5e-4344-bc63-ee7ca8038196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.573981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-aff1f881-dd5e-4344-bc63-ee7ca8038196 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:04.575913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aff1f881-dd5e-4344-bc63-ee7ca8038196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:04.578159 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4966ffa-2322-42df-8e44-4100428b610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:04.580127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4966ffa-2322-42df-8e44-4100428b610d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.580600 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4966ffa-2322-42df-8e44-4100428b610d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.580974 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4966ffa-2322-42df-8e44-4100428b610d admin admin] PATH_INFO: `/v3/projects/eb42d87edd1846f8844c97faf5b964ab` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.583995 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4966ffa-2322-42df-8e44-4100428b610d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb42d87edd1846f8844c97faf5b964ab)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:04.588080 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4966ffa-2322-42df-8e44-4100428b610d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:04.591767 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1083/2183] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:04.602427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261ca57-b412-4755-9b36-e06e5bd3c811 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.602811 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261ca57-b412-4755-9b36-e06e5bd3c811 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.603050 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261ca57-b412-4755-9b36-e06e5bd3c811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.637798 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e261ca57-b412-4755-9b36-e06e5bd3c811 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:04.639630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e261ca57-b412-4755-9b36-e06e5bd3c811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:04.651932 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1084/2184] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:04.658340 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261ca57-b412-4755-9b36-e06e5bd3c811 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:04.675001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261ca57-b412-4755-9b36-e06e5bd3c811 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:04.681595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d4966ffa-2322-42df-8e44-4100428b610d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb42d87edd1846f8844c97faf5b964ab', 'request_id': 'req-d4966ffa-2322-42df-8e44-4100428b610d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:04.689463 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d4966ffa-2322-42df-8e44-4100428b610d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb42d87edd1846f8844c97faf5b964ab', 'request_id': 'req-d4966ffa-2322-42df-8e44-4100428b610d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:04.703515 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d4966ffa-2322-42df-8e44-4100428b610d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb42d87edd1846f8844c97faf5b964ab', 'request_id': 'req-d4966ffa-2322-42df-8e44-4100428b610d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:04.721307 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d4966ffa-2322-42df-8e44-4100428b610d admin admin] The token cache is being invalidate because project eb42d87edd1846f8844c97faf5b964ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:04.721693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d4966ffa-2322-42df-8e44-4100428b610d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:04.723109 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d4966ffa-2322-42df-8e44-4100428b610d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:04.730228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1101/2185] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:44:04 2022] DELETE /identity/v3/projects/eb42d87edd1846f8844c97faf5b964ab => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:04.738318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512e975-3ab6-4c39-a82e-28205c7c667f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.738840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512e975-3ab6-4c39-a82e-28205c7c667f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.739806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512e975-3ab6-4c39-a82e-28205c7c667f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.749722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:04.766924 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a512e975-3ab6-4c39-a82e-28205c7c667f None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:04.770499 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a512e975-3ab6-4c39-a82e-28205c7c667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:04.773285 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e358be0-5780-48a3-8ab5-6c958b7bd1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:04.774341 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e358be0-5780-48a3-8ab5-6c958b7bd1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.774489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e358be0-5780-48a3-8ab5-6c958b7bd1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.775040 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e358be0-5780-48a3-8ab5-6c958b7bd1d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.775610 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e358be0-5780-48a3-8ab5-6c958b7bd1d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:04.776081 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e358be0-5780-48a3-8ab5-6c958b7bd1d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:04.778212 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e358be0-5780-48a3-8ab5-6c958b7bd1d0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:04.792106 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1085/2186] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:44:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:04.794755 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1102/2187] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:04.805746 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e358be0-5780-48a3-8ab5-6c958b7bd1d0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:04.807609 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721f444-586d-45aa-ac0e-b346f364fc3f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.808092 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721f444-586d-45aa-ac0e-b346f364fc3f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.808768 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721f444-586d-45aa-ac0e-b346f364fc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.810498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8e358be0-5780-48a3-8ab5-6c958b7bd1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:04.827047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e358be0-5780-48a3-8ab5-6c958b7bd1d0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:04.841571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f721f444-586d-45aa-ac0e-b346f364fc3f None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:04.843558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f721f444-586d-45aa-ac0e-b346f364fc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:04.845034 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d304c3a-d0c8-4402-847c-9a394817cfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:04.847959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d304c3a-d0c8-4402-847c-9a394817cfc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.848754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d304c3a-d0c8-4402-847c-9a394817cfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.849383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d304c3a-d0c8-4402-847c-9a394817cfc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.852133 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d304c3a-d0c8-4402-847c-9a394817cfc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:04.856283 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1103/2188] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:04.857213 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d304c3a-d0c8-4402-847c-9a394817cfc6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:04.861855 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721f444-586d-45aa-ac0e-b346f364fc3f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:04.878925 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721f444-586d-45aa-ac0e-b346f364fc3f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:04.887951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e4726-0943-4602-9aa2-6ac82772cb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:04.889416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e4726-0943-4602-9aa2-6ac82772cb0c admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.889916 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e4726-0943-4602-9aa2-6ac82772cb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.890429 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e4726-0943-4602-9aa2-6ac82772cb0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.891837 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e4726-0943-4602-9aa2-6ac82772cb0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:04.892375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e4726-0943-4602-9aa2-6ac82772cb0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:04.896142 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e4726-0943-4602-9aa2-6ac82772cb0c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:04.910656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1086/2189] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:44:04 2022] POST /identity/v3/projects => generated 384 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:04.917104 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d304c3a-d0c8-4402-847c-9a394817cfc6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:04.927547 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1104/2190] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:44:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:04.938048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e4726-0943-4602-9aa2-6ac82772cb0c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:04.944897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:04.958175 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e4726-0943-4602-9aa2-6ac82772cb0c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:05.035522 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d304c3a-d0c8-4402-847c-9a394817cfc6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:05.041714 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b887d5-83ba-4f15-8280-b14f65b2458a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:05.042502 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b887d5-83ba-4f15-8280-b14f65b2458a admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.042902 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b887d5-83ba-4f15-8280-b14f65b2458a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.043297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b887d5-83ba-4f15-8280-b14f65b2458a admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.044154 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b887d5-83ba-4f15-8280-b14f65b2458a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:05.046877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b887d5-83ba-4f15-8280-b14f65b2458a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:05.065609 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2445a-d99c-4811-9f74-21711cf8367a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:05.067315 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2445a-d99c-4811-9f74-21711cf8367a admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.067790 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2445a-d99c-4811-9f74-21711cf8367a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.068215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2445a-d99c-4811-9f74-21711cf8367a admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.069217 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2445a-d99c-4811-9f74-21711cf8367a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:05.070188 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1087/2191] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:44:04 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:44:05.072335 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2445a-d99c-4811-9f74-21711cf8367a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:05.074616 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b887d5-83ba-4f15-8280-b14f65b2458a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:05.086103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b887d5-83ba-4f15-8280-b14f65b2458a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:05.093796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff63ed-6d92-4374-9b73-4c181df87c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:05.094797 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff63ed-6d92-4374-9b73-4c181df87c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.095266 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff63ed-6d92-4374-9b73-4c181df87c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.095567 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff63ed-6d92-4374-9b73-4c181df87c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.096991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff63ed-6d92-4374-9b73-4c181df87c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:05.099400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff63ed-6d92-4374-9b73-4c181df87c55 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:05.109686 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1105/2192] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:44:04 2022] POST /identity/v3/projects => generated 372 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:05.115634 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2445a-d99c-4811-9f74-21711cf8367a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:05.121527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1088/2193] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:05 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:05.127224 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff63ed-6d92-4374-9b73-4c181df87c55 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:05.140832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff63ed-6d92-4374-9b73-4c181df87c55 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:05.216028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2445a-d99c-4811-9f74-21711cf8367a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:05.221142 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84ea75-c32f-4b3e-8988-9dab868a67d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:05.221886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84ea75-c32f-4b3e-8988-9dab868a67d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.222198 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84ea75-c32f-4b3e-8988-9dab868a67d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.223816 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84ea75-c32f-4b3e-8988-9dab868a67d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.223816 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84ea75-c32f-4b3e-8988-9dab868a67d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:05.225408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84ea75-c32f-4b3e-8988-9dab868a67d2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:05.253951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42dd5c-5d0d-4bb8-9e9e-a9f52028c41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:05.254686 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42dd5c-5d0d-4bb8-9e9e-a9f52028c41f admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.254981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42dd5c-5d0d-4bb8-9e9e-a9f52028c41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.255309 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42dd5c-5d0d-4bb8-9e9e-a9f52028c41f admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.255980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1106/2194] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:44:05 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:44:05.256101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42dd5c-5d0d-4bb8-9e9e-a9f52028c41f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:05.257741 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42dd5c-5d0d-4bb8-9e9e-a9f52028c41f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:05.261053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84ea75-c32f-4b3e-8988-9dab868a67d2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:05.270758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1089/2195] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:05 2022] GET /identity/v3/roles => generated 1427 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:44:05.272414 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84ea75-c32f-4b3e-8988-9dab868a67d2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:05.275243 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42dd5c-5d0d-4bb8-9e9e-a9f52028c41f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:05.280581 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a249a-e82e-43b2-8a66-14596ed45c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:05.282328 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a249a-e82e-43b2-8a66-14596ed45c8b admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.283248 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a249a-e82e-43b2-8a66-14596ed45c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.283835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a249a-e82e-43b2-8a66-14596ed45c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.286498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42dd5c-5d0d-4bb8-9e9e-a9f52028c41f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:05.286887 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a249a-e82e-43b2-8a66-14596ed45c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:05.288684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a249a-e82e-43b2-8a66-14596ed45c8b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:05.291471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca60156-d236-4da1-8e6e-fed072e51c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:05.292378 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca60156-d236-4da1-8e6e-fed072e51c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.292662 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca60156-d236-4da1-8e6e-fed072e51c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.292935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca60156-d236-4da1-8e6e-fed072e51c53 admin admin] PATH_INFO: `/v3/projects/81bfd8843bfb46b68575bee10c1675e6/users/1a7ac675e0f14b1b849c482d972196ff/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.310033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1107/2196] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:05 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:05.312754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca60156-d236-4da1-8e6e-fed072e51c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81bfd8843bfb46b68575bee10c1675e6, user_id=1a7ac675e0f14b1b849c482d972196ff, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:05.313171 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a249a-e82e-43b2-8a66-14596ed45c8b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:05.319050 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca60156-d236-4da1-8e6e-fed072e51c53 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:05.325945 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a249a-e82e-43b2-8a66-14596ed45c8b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:05.332375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e8902-b9d6-4e8a-b4a4-4d5dc0dd80f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:05.333104 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e8902-b9d6-4e8a-b4a4-4d5dc0dd80f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.333395 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e8902-b9d6-4e8a-b4a4-4d5dc0dd80f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.333678 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e8902-b9d6-4e8a-b4a4-4d5dc0dd80f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.334418 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e8902-b9d6-4e8a-b4a4-4d5dc0dd80f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:05.336146 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e8902-b9d6-4e8a-b4a4-4d5dc0dd80f9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:05.339957 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1090/2197] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:44:05 2022] PUT /identity/v3/projects/81bfd8843bfb46b68575bee10c1675e6/users/1a7ac675e0f14b1b849c482d972196ff/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:05.348914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1108/2198] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:05 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:05.356508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca60156-d236-4da1-8e6e-fed072e51c53 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:05.357953 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181dec9-5805-40c1-ab26-f5ff036730e4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.358478 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181dec9-5805-40c1-ab26-f5ff036730e4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.358958 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181dec9-5805-40c1-ab26-f5ff036730e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.404238 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a181dec9-5805-40c1-ab26-f5ff036730e4 None None] MFA Rules not processed for user `1a7ac675e0f14b1b849c482d972196ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:05.406484 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a181dec9-5805-40c1-ab26-f5ff036730e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:05.441251 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:05.448522 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca60156-d236-4da1-8e6e-fed072e51c53 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:05.455588 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff36340-2cae-4db1-a940-2ad8fd214b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:05.456542 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff36340-2cae-4db1-a940-2ad8fd214b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.456867 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff36340-2cae-4db1-a940-2ad8fd214b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.457175 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff36340-2cae-4db1-a940-2ad8fd214b07 admin admin] PATH_INFO: `/v3/projects/b913a578b426496d864891f42e089927/users/2a238fdd6d9341e8ba494086f74ab048/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.479530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:05.493804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff36340-2cae-4db1-a940-2ad8fd214b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b913a578b426496d864891f42e089927, user_id=2a238fdd6d9341e8ba494086f74ab048, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:05.500877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff36340-2cae-4db1-a940-2ad8fd214b07 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:05.525531 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1091/2199] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:44:05 2022] PUT /identity/v3/projects/b913a578b426496d864891f42e089927/users/2a238fdd6d9341e8ba494086f74ab048/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:05.542864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2150319-f7e9-49c7-9051-727b39a63124 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.543267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2150319-f7e9-49c7-9051-727b39a63124 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.543668 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2150319-f7e9-49c7-9051-727b39a63124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.545711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1109/2200] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:05.568196 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181dec9-5805-40c1-ab26-f5ff036730e4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:05.569871 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a181dec9-5805-40c1-ab26-f5ff036730e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:05.606137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b2150319-f7e9-49c7-9051-727b39a63124 None None] MFA Rules not processed for user `2a238fdd6d9341e8ba494086f74ab048`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:05.610421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b2150319-f7e9-49c7-9051-727b39a63124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:05.702445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181dec9-5805-40c1-ab26-f5ff036730e4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:05.767245 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1092/2201] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:05.769307 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2150319-f7e9-49c7-9051-727b39a63124 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:05.771970 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b2150319-f7e9-49c7-9051-727b39a63124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:05.834112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4380e1-0f3a-4a53-8ad8-763d13e97ed9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:05.835110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4380e1-0f3a-4a53-8ad8-763d13e97ed9 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.835470 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4380e1-0f3a-4a53-8ad8-763d13e97ed9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.836261 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4380e1-0f3a-4a53-8ad8-763d13e97ed9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.925904 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4380e1-0f3a-4a53-8ad8-763d13e97ed9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:05.928782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4380e1-0f3a-4a53-8ad8-763d13e97ed9 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:05.930768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2150319-f7e9-49c7-9051-727b39a63124 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:05.938909 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f32c5-d341-411e-b0e1-f57ef861493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:05.940054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f32c5-d341-411e-b0e1-f57ef861493a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.940481 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f32c5-d341-411e-b0e1-f57ef861493a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.940928 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f32c5-d341-411e-b0e1-f57ef861493a admin admin] PATH_INFO: `/v3/users/e9aeb94770024f30bc155ad87b71badc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.943115 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f32c5-d341-411e-b0e1-f57ef861493a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9aeb94770024f30bc155ad87b71badc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:05.945628 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f32c5-d341-411e-b0e1-f57ef861493a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:05.947082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1110/2202] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:44:05.949821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4380e1-0f3a-4a53-8ad8-763d13e97ed9 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:05.952599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7f4380e1-0f3a-4a53-8ad8-763d13e97ed9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:05.975574 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4380e1-0f3a-4a53-8ad8-763d13e97ed9 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:05.982320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bc9a1-2ff3-4699-839c-1f381ea04159 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:05.983144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bc9a1-2ff3-4699-839c-1f381ea04159 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.983474 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bc9a1-2ff3-4699-839c-1f381ea04159 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.983829 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bc9a1-2ff3-4699-839c-1f381ea04159 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.997798 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bc9a1-2ff3-4699-839c-1f381ea04159 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:05.999922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bc9a1-2ff3-4699-839c-1f381ea04159 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:06.017341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1111/2203] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:06.018331 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bc9a1-2ff3-4699-839c-1f381ea04159 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:06.038092 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bc9a1-2ff3-4699-839c-1f381ea04159 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:06.046445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c78940-5ea1-422e-8573-6ed0c834cfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:06.048194 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c78940-5ea1-422e-8573-6ed0c834cfb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:06.048682 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c78940-5ea1-422e-8573-6ed0c834cfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:06.049156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c78940-5ea1-422e-8573-6ed0c834cfb1 admin admin] PATH_INFO: `/v3/users/1a7ac675e0f14b1b849c482d972196ff` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:06.052159 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c78940-5ea1-422e-8573-6ed0c834cfb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a7ac675e0f14b1b849c482d972196ff)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:06.055789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c78940-5ea1-422e-8573-6ed0c834cfb1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:06.060005 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-604f32c5-d341-411e-b0e1-f57ef861493a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9aeb94770024f30bc155ad87b71badc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:06.061040 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-604f32c5-d341-411e-b0e1-f57ef861493a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9aeb94770024f30bc155ad87b71badc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:06.075776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-604f32c5-d341-411e-b0e1-f57ef861493a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9aeb94770024f30bc155ad87b71badc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:06.077163 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-604f32c5-d341-411e-b0e1-f57ef861493a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9aeb94770024f30bc155ad87b71badc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:06.088720 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:06.091729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-604f32c5-d341-411e-b0e1-f57ef861493a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9aeb94770024f30bc155ad87b71badc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:06.116584 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:06.133389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1093/2204] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:44:05 2022] DELETE /identity/v3/users/e9aeb94770024f30bc155ad87b71badc => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:06.140585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbc91c-a4a6-4046-a533-27a06d0aa3c4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:06.141471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbc91c-a4a6-4046-a533-27a06d0aa3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:06.142074 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbc91c-a4a6-4046-a533-27a06d0aa3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:06.167132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-62c78940-5ea1-422e-8573-6ed0c834cfb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a7ac675e0f14b1b849c482d972196ff'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:06.177150 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-21cbc91c-a4a6-4046-a533-27a06d0aa3c4 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:06.178655 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-21cbc91c-a4a6-4046-a533-27a06d0aa3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:06.207982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-62c78940-5ea1-422e-8573-6ed0c834cfb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a7ac675e0f14b1b849c482d972196ff'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:06.210955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-62c78940-5ea1-422e-8573-6ed0c834cfb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a7ac675e0f14b1b849c482d972196ff'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:06.229554 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-62c78940-5ea1-422e-8573-6ed0c834cfb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a7ac675e0f14b1b849c482d972196ff'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:06.231463 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-62c78940-5ea1-422e-8573-6ed0c834cfb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a7ac675e0f14b1b849c482d972196ff'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:06.264008 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1112/2205] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:44:06 2022] DELETE /identity/v3/users/1a7ac675e0f14b1b849c482d972196ff => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:06.269636 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ecb5d-e6b2-49ec-8dcf-9132ddcf8b86 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:06.270088 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ecb5d-e6b2-49ec-8dcf-9132ddcf8b86 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:06.271343 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ecb5d-e6b2-49ec-8dcf-9132ddcf8b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:06.303797 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ae0ecb5d-e6b2-49ec-8dcf-9132ddcf8b86 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:06.307085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ae0ecb5d-e6b2-49ec-8dcf-9132ddcf8b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:06.343949 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1094/2206] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:06.355209 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbc91c-a4a6-4046-a533-27a06d0aa3c4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:06.358431 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-21cbc91c-a4a6-4046-a533-27a06d0aa3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:06.467926 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1113/2207] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:06.483493 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ecb5d-e6b2-49ec-8dcf-9132ddcf8b86 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:06.486346 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ae0ecb5d-e6b2-49ec-8dcf-9132ddcf8b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:06.536748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbc91c-a4a6-4046-a533-27a06d0aa3c4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:06.643253 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ecb5d-e6b2-49ec-8dcf-9132ddcf8b86 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:06.653226 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec4e73-9d06-494e-a868-4b796ee91073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:06.654477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec4e73-9d06-494e-a868-4b796ee91073 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:06.654477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec4e73-9d06-494e-a868-4b796ee91073 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:06.654477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec4e73-9d06-494e-a868-4b796ee91073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:06.680367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec4e73-9d06-494e-a868-4b796ee91073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:06.683097 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec4e73-9d06-494e-a868-4b796ee91073 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:06.687910 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac613f0-71e0-449e-9332-efd3f996bd86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:06.688762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac613f0-71e0-449e-9332-efd3f996bd86 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:06.689163 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac613f0-71e0-449e-9332-efd3f996bd86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:06.689733 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac613f0-71e0-449e-9332-efd3f996bd86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:06.703924 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac613f0-71e0-449e-9332-efd3f996bd86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:06.705935 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1114/2208] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:06.706110 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac613f0-71e0-449e-9332-efd3f996bd86 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:06.721308 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1095/2209] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:44:07.410436 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec4e73-9d06-494e-a868-4b796ee91073 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.412376 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-81ec4e73-9d06-494e-a868-4b796ee91073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:07.435979 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec4e73-9d06-494e-a868-4b796ee91073 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:07.446291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c98f7-dd7a-41ad-a47a-a5245c0ae818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:07.448114 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c98f7-dd7a-41ad-a47a-a5245c0ae818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.448257 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c98f7-dd7a-41ad-a47a-a5245c0ae818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.448664 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c98f7-dd7a-41ad-a47a-a5245c0ae818 admin admin] PATH_INFO: `/v3/projects/81bfd8843bfb46b68575bee10c1675e6` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.451002 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c98f7-dd7a-41ad-a47a-a5245c0ae818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81bfd8843bfb46b68575bee10c1675e6)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:07.452738 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c98f7-dd7a-41ad-a47a-a5245c0ae818 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:07.497898 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:07.536759 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f25c98f7-dd7a-41ad-a47a-a5245c0ae818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81bfd8843bfb46b68575bee10c1675e6', 'request_id': 'req-f25c98f7-dd7a-41ad-a47a-a5245c0ae818'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:07.547093 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f25c98f7-dd7a-41ad-a47a-a5245c0ae818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81bfd8843bfb46b68575bee10c1675e6', 'request_id': 'req-f25c98f7-dd7a-41ad-a47a-a5245c0ae818'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:07.561982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f25c98f7-dd7a-41ad-a47a-a5245c0ae818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81bfd8843bfb46b68575bee10c1675e6', 'request_id': 'req-f25c98f7-dd7a-41ad-a47a-a5245c0ae818'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:07.594479 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f25c98f7-dd7a-41ad-a47a-a5245c0ae818 admin admin] The token cache is being invalidate because project 81bfd8843bfb46b68575bee10c1675e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:07.595024 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f25c98f7-dd7a-41ad-a47a-a5245c0ae818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:07.596161 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f25c98f7-dd7a-41ad-a47a-a5245c0ae818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:07.599487 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1115/2210] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:44:07 2022] DELETE /identity/v3/projects/81bfd8843bfb46b68575bee10c1675e6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:07.607336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed92be-063b-44d9-b67c-e20fd6aa7915 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.608012 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed92be-063b-44d9-b67c-e20fd6aa7915 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.608452 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac613f0-71e0-449e-9332-efd3f996bd86 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.609206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed92be-063b-44d9-b67c-e20fd6aa7915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.611306 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5ac613f0-71e0-449e-9332-efd3f996bd86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:07.644419 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1aed92be-063b-44d9-b67c-e20fd6aa7915 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:07.644937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac613f0-71e0-449e-9332-efd3f996bd86 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:07.647823 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1aed92be-063b-44d9-b67c-e20fd6aa7915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:07.739874 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:07.747990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1116/2211] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:07.751558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643fb1d-3300-43fc-ab40-62500cb1f9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:07.752681 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643fb1d-3300-43fc-ab40-62500cb1f9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.752999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643fb1d-3300-43fc-ab40-62500cb1f9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.753282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643fb1d-3300-43fc-ab40-62500cb1f9d0 admin admin] PATH_INFO: `/v3/projects/820e73968d5148ceb83293d792efdd56` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.754921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643fb1d-3300-43fc-ab40-62500cb1f9d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=820e73968d5148ceb83293d792efdd56)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:07.758166 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643fb1d-3300-43fc-ab40-62500cb1f9d0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:07.761201 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0493f7-017a-42da-8f4b-d6529c2239cd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.761625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0493f7-017a-42da-8f4b-d6529c2239cd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.762034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0493f7-017a-42da-8f4b-d6529c2239cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.784901 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3b0493f7-017a-42da-8f4b-d6529c2239cd None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:07.786147 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3b0493f7-017a-42da-8f4b-d6529c2239cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:07.802081 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1117/2212] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:07.805271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0493f7-017a-42da-8f4b-d6529c2239cd None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.820315 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0493f7-017a-42da-8f4b-d6529c2239cd None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:07.853103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4643fb1d-3300-43fc-ab40-62500cb1f9d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '820e73968d5148ceb83293d792efdd56', 'request_id': 'req-4643fb1d-3300-43fc-ab40-62500cb1f9d0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:07.870481 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4643fb1d-3300-43fc-ab40-62500cb1f9d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '820e73968d5148ceb83293d792efdd56', 'request_id': 'req-4643fb1d-3300-43fc-ab40-62500cb1f9d0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:07.878620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4643fb1d-3300-43fc-ab40-62500cb1f9d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '820e73968d5148ceb83293d792efdd56', 'request_id': 'req-4643fb1d-3300-43fc-ab40-62500cb1f9d0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:07.896768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4643fb1d-3300-43fc-ab40-62500cb1f9d0 admin admin] The token cache is being invalidate because project 820e73968d5148ceb83293d792efdd56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:07.897411 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4643fb1d-3300-43fc-ab40-62500cb1f9d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:07.899473 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4643fb1d-3300-43fc-ab40-62500cb1f9d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:07.901284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1096/2213] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:44:07 2022] DELETE /identity/v3/projects/820e73968d5148ceb83293d792efdd56 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:07.907651 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643fb1d-3300-43fc-ab40-62500cb1f9d0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.910402 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4643fb1d-3300-43fc-ab40-62500cb1f9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:07.935912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0a401-ac2d-4323-aa67-a4f989629a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:07.937152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0a401-ac2d-4323-aa67-a4f989629a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.937491 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0a401-ac2d-4323-aa67-a4f989629a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.938055 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0a401-ac2d-4323-aa67-a4f989629a94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.939191 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0a401-ac2d-4323-aa67-a4f989629a94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:07.939521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0a401-ac2d-4323-aa67-a4f989629a94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:07.941718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0a401-ac2d-4323-aa67-a4f989629a94 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:07.962736 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1118/2214] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:44:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:07.964385 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0a401-ac2d-4323-aa67-a4f989629a94 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.966867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0da0a401-ac2d-4323-aa67-a4f989629a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:07.987954 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0a401-ac2d-4323-aa67-a4f989629a94 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:07.997440 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b150a-140f-447d-96df-cdbb11fd44c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:07.998754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b150a-140f-447d-96df-cdbb11fd44c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.999230 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b150a-140f-447d-96df-cdbb11fd44c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.999657 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b150a-140f-447d-96df-cdbb11fd44c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.000654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b150a-140f-447d-96df-cdbb11fd44c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:08.004261 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b150a-140f-447d-96df-cdbb11fd44c6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:08.056721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1119/2215] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:44:07 2022] POST /identity/v3/projects => generated 374 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:08.061742 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b150a-140f-447d-96df-cdbb11fd44c6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:08.068863 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643fb1d-3300-43fc-ab40-62500cb1f9d0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:08.108605 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:08.223694 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b150a-140f-447d-96df-cdbb11fd44c6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:08.233267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde2ac0-c90a-4176-b751-33829dc3b713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:08.235731 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde2ac0-c90a-4176-b751-33829dc3b713 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.238615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde2ac0-c90a-4176-b751-33829dc3b713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.238615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde2ac0-c90a-4176-b751-33829dc3b713 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.238615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde2ac0-c90a-4176-b751-33829dc3b713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:08.242693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde2ac0-c90a-4176-b751-33829dc3b713 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:08.258243 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe0aa2-8345-480a-9073-c70b87893539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:08.262428 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe0aa2-8345-480a-9073-c70b87893539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.263384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe0aa2-8345-480a-9073-c70b87893539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.265431 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe0aa2-8345-480a-9073-c70b87893539 admin admin] PATH_INFO: `/v3/users/0df9242e85714764a39f0728e28e757c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.267178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe0aa2-8345-480a-9073-c70b87893539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df9242e85714764a39f0728e28e757c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:08.270666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe0aa2-8345-480a-9073-c70b87893539 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:08.275263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1120/2216] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:44:08 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:44:08.279025 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde2ac0-c90a-4176-b751-33829dc3b713 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:08.294561 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde2ac0-c90a-4176-b751-33829dc3b713 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:08.302339 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415a9ab-e83d-4562-90fb-13d14e9cbe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:08.303381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415a9ab-e83d-4562-90fb-13d14e9cbe6c admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.304018 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415a9ab-e83d-4562-90fb-13d14e9cbe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.304923 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415a9ab-e83d-4562-90fb-13d14e9cbe6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.306281 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415a9ab-e83d-4562-90fb-13d14e9cbe6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:08.309542 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415a9ab-e83d-4562-90fb-13d14e9cbe6c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:08.333047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:08.337915 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1121/2217] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:08 2022] GET /identity/v3/roles => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:08.339416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415a9ab-e83d-4562-90fb-13d14e9cbe6c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:08.356030 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fbbe0aa2-8345-480a-9073-c70b87893539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df9242e85714764a39f0728e28e757c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:08.356900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fbbe0aa2-8345-480a-9073-c70b87893539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df9242e85714764a39f0728e28e757c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:08.361074 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415a9ab-e83d-4562-90fb-13d14e9cbe6c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:08.368458 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d4ada-8068-498d-86b8-6e5c3a45964d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:08.369144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d4ada-8068-498d-86b8-6e5c3a45964d admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.369432 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d4ada-8068-498d-86b8-6e5c3a45964d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.369711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d4ada-8068-498d-86b8-6e5c3a45964d admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.370634 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d4ada-8068-498d-86b8-6e5c3a45964d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:08.373829 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fbbe0aa2-8345-480a-9073-c70b87893539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df9242e85714764a39f0728e28e757c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:08.374054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d4ada-8068-498d-86b8-6e5c3a45964d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:08.374850 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fbbe0aa2-8345-480a-9073-c70b87893539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df9242e85714764a39f0728e28e757c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:08.396222 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1122/2218] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:08 2022] GET /identity/v3/roles => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:08.401702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d4ada-8068-498d-86b8-6e5c3a45964d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:08.404061 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-964d4ada-8068-498d-86b8-6e5c3a45964d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:08.411856 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fbbe0aa2-8345-480a-9073-c70b87893539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df9242e85714764a39f0728e28e757c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:08.423195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d4ada-8068-498d-86b8-6e5c3a45964d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:08.429559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d48f8-a1ac-4242-bbf2-115b0de20168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:08.430490 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d48f8-a1ac-4242-bbf2-115b0de20168 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.430864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d48f8-a1ac-4242-bbf2-115b0de20168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.431155 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d48f8-a1ac-4242-bbf2-115b0de20168 admin admin] PATH_INFO: `/v3/projects/0334b140a76840ed96a6f66bd13d93fc/users/285c842f86504046b4952efe1abbe666/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.443796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1097/2219] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:44:07 2022] DELETE /identity/v3/users/0df9242e85714764a39f0728e28e757c => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:08.448429 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d48f8-a1ac-4242-bbf2-115b0de20168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0334b140a76840ed96a6f66bd13d93fc, user_id=285c842f86504046b4952efe1abbe666, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:08.451210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d48f8-a1ac-4242-bbf2-115b0de20168 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:08.478789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1123/2220] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:44:08 2022] PUT /identity/v3/projects/0334b140a76840ed96a6f66bd13d93fc/users/285c842f86504046b4952efe1abbe666/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:08.495549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f668c0-a785-4b90-8d12-32e9c42354e3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.496603 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f668c0-a785-4b90-8d12-32e9c42354e3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.497373 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f668c0-a785-4b90-8d12-32e9c42354e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.548087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e0f668c0-a785-4b90-8d12-32e9c42354e3 None None] MFA Rules not processed for user `285c842f86504046b4952efe1abbe666`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:08.549140 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e0f668c0-a785-4b90-8d12-32e9c42354e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:08.720807 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1098/2221] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:08.735205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d48f8-a1ac-4242-bbf2-115b0de20168 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:08.738911 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e58d48f8-a1ac-4242-bbf2-115b0de20168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:08.849095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d48f8-a1ac-4242-bbf2-115b0de20168 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:08.852982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13b162-66a4-4a9c-a3f5-533e4cc06623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:08.853648 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13b162-66a4-4a9c-a3f5-533e4cc06623 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.853938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13b162-66a4-4a9c-a3f5-533e4cc06623 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.854213 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13b162-66a4-4a9c-a3f5-533e4cc06623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.866436 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13b162-66a4-4a9c-a3f5-533e4cc06623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:08.869345 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13b162-66a4-4a9c-a3f5-533e4cc06623 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:08.886948 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1124/2222] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:08.911425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f668c0-a785-4b90-8d12-32e9c42354e3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:08.911670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13b162-66a4-4a9c-a3f5-533e4cc06623 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:08.913665 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e0f668c0-a785-4b90-8d12-32e9c42354e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:09.036448 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f668c0-a785-4b90-8d12-32e9c42354e3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:09.042997 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13b162-66a4-4a9c-a3f5-533e4cc06623 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:09.046748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a386d-bb12-4ea0-ba17-7c43b225ae78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:09.048278 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a386d-bb12-4ea0-ba17-7c43b225ae78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:09.048837 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a386d-bb12-4ea0-ba17-7c43b225ae78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:09.049386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a386d-bb12-4ea0-ba17-7c43b225ae78 admin admin] PATH_INFO: `/v3/projects/9769cb835bf84f9ca0998b760697f36b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:09.050809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af2de3-3275-49e2-9e9a-27c116845a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:09.052002 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a386d-bb12-4ea0-ba17-7c43b225ae78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9769cb835bf84f9ca0998b760697f36b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:09.052176 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af2de3-3275-49e2-9e9a-27c116845a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:09.052451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af2de3-3275-49e2-9e9a-27c116845a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:09.052966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af2de3-3275-49e2-9e9a-27c116845a05 admin admin] PATH_INFO: `/v3/users/285c842f86504046b4952efe1abbe666` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:09.054556 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af2de3-3275-49e2-9e9a-27c116845a05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=285c842f86504046b4952efe1abbe666)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:09.055084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a386d-bb12-4ea0-ba17-7c43b225ae78 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:09.058089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af2de3-3275-49e2-9e9a-27c116845a05 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:09.074041 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:09.138633 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d1af2de3-3275-49e2-9e9a-27c116845a05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '285c842f86504046b4952efe1abbe666'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:09.141966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:09.147023 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-122a386d-bb12-4ea0-ba17-7c43b225ae78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9769cb835bf84f9ca0998b760697f36b', 'request_id': 'req-122a386d-bb12-4ea0-ba17-7c43b225ae78'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:09.159107 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d1af2de3-3275-49e2-9e9a-27c116845a05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '285c842f86504046b4952efe1abbe666'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:09.160060 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d1af2de3-3275-49e2-9e9a-27c116845a05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '285c842f86504046b4952efe1abbe666'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:09.160534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-122a386d-bb12-4ea0-ba17-7c43b225ae78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9769cb835bf84f9ca0998b760697f36b', 'request_id': 'req-122a386d-bb12-4ea0-ba17-7c43b225ae78'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:09.171069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d1af2de3-3275-49e2-9e9a-27c116845a05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '285c842f86504046b4952efe1abbe666'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:09.171929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d1af2de3-3275-49e2-9e9a-27c116845a05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '285c842f86504046b4952efe1abbe666'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:09.172707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-122a386d-bb12-4ea0-ba17-7c43b225ae78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9769cb835bf84f9ca0998b760697f36b', 'request_id': 'req-122a386d-bb12-4ea0-ba17-7c43b225ae78'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:09.189704 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-122a386d-bb12-4ea0-ba17-7c43b225ae78 admin admin] The token cache is being invalidate because project 9769cb835bf84f9ca0998b760697f36b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:09.190729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-122a386d-bb12-4ea0-ba17-7c43b225ae78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:09.191623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-122a386d-bb12-4ea0-ba17-7c43b225ae78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:09.197963 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1125/2223] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:44:08 2022] DELETE /identity/v3/users/285c842f86504046b4952efe1abbe666 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:09.198261 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1099/2224] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:44:08 2022] DELETE /identity/v3/projects/9769cb835bf84f9ca0998b760697f36b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:09.200708 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27f422-0879-4833-891e-316b66c2055a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:09.201195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35b99b-5457-473e-a570-c28331153a9f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:09.201374 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27f422-0879-4833-891e-316b66c2055a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:09.201691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27f422-0879-4833-891e-316b66c2055a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:09.201787 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35b99b-5457-473e-a570-c28331153a9f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:09.202196 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35b99b-5457-473e-a570-c28331153a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:09.233411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-cc35b99b-5457-473e-a570-c28331153a9f None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:09.234821 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9c27f422-0879-4833-891e-316b66c2055a None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:09.235083 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cc35b99b-5457-473e-a570-c28331153a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:09.236921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9c27f422-0879-4833-891e-316b66c2055a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:09.316739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1126/2225] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:09.338631 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1100/2226] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:09.345794 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35b99b-5457-473e-a570-c28331153a9f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:09.346617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc05fb6-3b5a-4fff-a39a-e035427a25a7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:09.347085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc05fb6-3b5a-4fff-a39a-e035427a25a7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:09.347497 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc05fb6-3b5a-4fff-a39a-e035427a25a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:09.347693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cc35b99b-5457-473e-a570-c28331153a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:09.371843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3bc05fb6-3b5a-4fff-a39a-e035427a25a7 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:09.373377 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3bc05fb6-3b5a-4fff-a39a-e035427a25a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:09.383719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1101/2227] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:09.389846 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc05fb6-3b5a-4fff-a39a-e035427a25a7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:09.401745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc05fb6-3b5a-4fff-a39a-e035427a25a7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:09.406840 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa92ff6-e94b-41bd-94f2-373f294f86aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:09.407528 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa92ff6-e94b-41bd-94f2-373f294f86aa admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:09.407817 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa92ff6-e94b-41bd-94f2-373f294f86aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:09.408104 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa92ff6-e94b-41bd-94f2-373f294f86aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:09.408845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa92ff6-e94b-41bd-94f2-373f294f86aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:09.409168 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa92ff6-e94b-41bd-94f2-373f294f86aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:09.410861 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa92ff6-e94b-41bd-94f2-373f294f86aa admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:09.426356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1102/2228] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:44:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:09.431424 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa92ff6-e94b-41bd-94f2-373f294f86aa admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:09.448416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35b99b-5457-473e-a570-c28331153a9f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:09.452843 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7918d8-1a0e-47e2-b209-41d441a5f6c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:09.453826 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7918d8-1a0e-47e2-b209-41d441a5f6c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:09.454271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7918d8-1a0e-47e2-b209-41d441a5f6c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:09.454826 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7918d8-1a0e-47e2-b209-41d441a5f6c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:09.457155 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa92ff6-e94b-41bd-94f2-373f294f86aa admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:09.465115 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a05b1-713d-46ee-b4c4-6217035efce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:09.467298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a05b1-713d-46ee-b4c4-6217035efce7 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:09.467597 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a05b1-713d-46ee-b4c4-6217035efce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:09.467919 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a05b1-713d-46ee-b4c4-6217035efce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:09.469340 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a05b1-713d-46ee-b4c4-6217035efce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:09.471721 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a05b1-713d-46ee-b4c4-6217035efce7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:09.473494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7918d8-1a0e-47e2-b209-41d441a5f6c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:09.476195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7918d8-1a0e-47e2-b209-41d441a5f6c0 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:09.498187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1127/2229] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:09.510089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1103/2230] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:44:09 2022] POST /identity/v3/projects => generated 386 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:09.520891 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7918d8-1a0e-47e2-b209-41d441a5f6c0 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:09.539993 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7918d8-1a0e-47e2-b209-41d441a5f6c0 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:09.577664 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:09.633930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc5c60-476d-4445-836f-0f226d450dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:09.634500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc5c60-476d-4445-836f-0f226d450dfc admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:09.635147 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc5c60-476d-4445-836f-0f226d450dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:09.635423 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc5c60-476d-4445-836f-0f226d450dfc admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:09.636506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc5c60-476d-4445-836f-0f226d450dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:09.639089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc5c60-476d-4445-836f-0f226d450dfc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:09.680697 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1128/2231] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:44:09 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:09.682898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a05b1-713d-46ee-b4c4-6217035efce7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:09.719967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a05b1-713d-46ee-b4c4-6217035efce7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:09.740327 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63900cd8-4bb6-471f-a186-b22111566d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:09.746811 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63900cd8-4bb6-471f-a186-b22111566d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:09.747516 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63900cd8-4bb6-471f-a186-b22111566d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:09.747788 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63900cd8-4bb6-471f-a186-b22111566d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:09.759604 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63900cd8-4bb6-471f-a186-b22111566d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:09.759604 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63900cd8-4bb6-471f-a186-b22111566d7d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:09.795934 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1104/2232] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:09 2022] GET /identity/v3/roles => generated 1427 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:09.802814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc5c60-476d-4445-836f-0f226d450dfc admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:09.921826 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc5c60-476d-4445-836f-0f226d450dfc admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:09.944675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9bc54-c71a-444d-a34c-67f475726275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:09.945780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9bc54-c71a-444d-a34c-67f475726275 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:09.946362 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9bc54-c71a-444d-a34c-67f475726275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:09.946949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9bc54-c71a-444d-a34c-67f475726275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:09.948197 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9bc54-c71a-444d-a34c-67f475726275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:09.950409 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9bc54-c71a-444d-a34c-67f475726275 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:09.966508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63900cd8-4bb6-471f-a186-b22111566d7d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:09.970896 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1129/2233] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:09 2022] GET /identity/v3/roles => generated 1427 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:09.972598 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-63900cd8-4bb6-471f-a186-b22111566d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:09.976795 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9bc54-c71a-444d-a34c-67f475726275 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:09.994410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9bc54-c71a-444d-a34c-67f475726275 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:10.002868 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb6cd2-da9f-4d80-8540-3554faa9b7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:10.004401 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb6cd2-da9f-4d80-8540-3554faa9b7dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:10.004859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb6cd2-da9f-4d80-8540-3554faa9b7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:10.005399 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb6cd2-da9f-4d80-8540-3554faa9b7dd admin admin] PATH_INFO: `/v3/projects/3d126fe12a8042319d7639f0bf30dc16/users/966205034da94e35a9445b2266ca1166/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:10.042282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb6cd2-da9f-4d80-8540-3554faa9b7dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d126fe12a8042319d7639f0bf30dc16, user_id=966205034da94e35a9445b2266ca1166, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:10.048369 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb6cd2-da9f-4d80-8540-3554faa9b7dd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:10.070563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1130/2234] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:44:09 2022] PUT /identity/v3/projects/3d126fe12a8042319d7639f0bf30dc16/users/966205034da94e35a9445b2266ca1166/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:10.091236 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df180520-0589-4515-9f89-80d7b47f1fb2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:10.092592 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df180520-0589-4515-9f89-80d7b47f1fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:10.092592 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df180520-0589-4515-9f89-80d7b47f1fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:10.150491 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-df180520-0589-4515-9f89-80d7b47f1fb2 None None] MFA Rules not processed for user `966205034da94e35a9445b2266ca1166`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:10.152714 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-df180520-0589-4515-9f89-80d7b47f1fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:10.184880 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63900cd8-4bb6-471f-a186-b22111566d7d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:10.233341 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:10.309082 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2e488-e890-424e-9b1d-628c65a2afca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:10.311474 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2e488-e890-424e-9b1d-628c65a2afca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:10.312072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2e488-e890-424e-9b1d-628c65a2afca admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:10.312612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2e488-e890-424e-9b1d-628c65a2afca admin admin] PATH_INFO: `/v3/projects/0334b140a76840ed96a6f66bd13d93fc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:10.315703 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2e488-e890-424e-9b1d-628c65a2afca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0334b140a76840ed96a6f66bd13d93fc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:10.320321 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2e488-e890-424e-9b1d-628c65a2afca admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:10.345162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1131/2235] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:10.363674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df180520-0589-4515-9f89-80d7b47f1fb2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:10.365880 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-df180520-0589-4515-9f89-80d7b47f1fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:10.424813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:10.451212 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-01c2e488-e890-424e-9b1d-628c65a2afca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0334b140a76840ed96a6f66bd13d93fc', 'request_id': 'req-01c2e488-e890-424e-9b1d-628c65a2afca'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:10.475014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-01c2e488-e890-424e-9b1d-628c65a2afca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0334b140a76840ed96a6f66bd13d93fc', 'request_id': 'req-01c2e488-e890-424e-9b1d-628c65a2afca'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:10.481979 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-01c2e488-e890-424e-9b1d-628c65a2afca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0334b140a76840ed96a6f66bd13d93fc', 'request_id': 'req-01c2e488-e890-424e-9b1d-628c65a2afca'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:10.505773 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df180520-0589-4515-9f89-80d7b47f1fb2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:10.513786 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-01c2e488-e890-424e-9b1d-628c65a2afca admin admin] The token cache is being invalidate because project 0334b140a76840ed96a6f66bd13d93fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:10.513988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-01c2e488-e890-424e-9b1d-628c65a2afca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:10.516398 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-01c2e488-e890-424e-9b1d-628c65a2afca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:10.519695 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1105/2236] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:44:09 2022] DELETE /identity/v3/projects/0334b140a76840ed96a6f66bd13d93fc => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:10.525088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd6dc8-bc3d-43b8-bb8d-ed1cefd8cb8f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:10.525408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd6dc8-bc3d-43b8-bb8d-ed1cefd8cb8f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:10.525658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd6dc8-bc3d-43b8-bb8d-ed1cefd8cb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:10.587551 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75779fbe-c504-45c9-8071-948eddcbcffd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:10.589107 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75779fbe-c504-45c9-8071-948eddcbcffd service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:10.589727 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75779fbe-c504-45c9-8071-948eddcbcffd service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:10.590226 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75779fbe-c504-45c9-8071-948eddcbcffd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:10.593779 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-75779fbe-c504-45c9-8071-948eddcbcffd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:10.595844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6bbd6dc8-bc3d-43b8-bb8d-ed1cefd8cb8f None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:10.597333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6bbd6dc8-bc3d-43b8-bb8d-ed1cefd8cb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:10.672402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75779fbe-c504-45c9-8071-948eddcbcffd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:10.674055 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75779fbe-c504-45c9-8071-948eddcbcffd service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:10.686675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1132/2237] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:10.717575 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1106/2238] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:10.731725 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252b816-3258-42ff-a088-15c66a19f1d8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:10.731935 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252b816-3258-42ff-a088-15c66a19f1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:10.732170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252b816-3258-42ff-a088-15c66a19f1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:10.754040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b252b816-3258-42ff-a088-15c66a19f1d8 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:10.755319 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b252b816-3258-42ff-a088-15c66a19f1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:10.769485 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1133/2239] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:10.774313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd6dc8-bc3d-43b8-bb8d-ed1cefd8cb8f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:10.788467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd6dc8-bc3d-43b8-bb8d-ed1cefd8cb8f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:10.795242 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc0b64-45ac-42ea-b269-7163193b924c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:10.795936 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc0b64-45ac-42ea-b269-7163193b924c admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:10.796225 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc0b64-45ac-42ea-b269-7163193b924c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:10.796511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc0b64-45ac-42ea-b269-7163193b924c admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:10.797258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc0b64-45ac-42ea-b269-7163193b924c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:10.797574 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc0b64-45ac-42ea-b269-7163193b924c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:10.799232 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc0b64-45ac-42ea-b269-7163193b924c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:10.817608 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1107/2240] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:44:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:10.822379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252b816-3258-42ff-a088-15c66a19f1d8 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:10.842110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252b816-3258-42ff-a088-15c66a19f1d8 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:10.849033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2452d97-308a-424c-bb88-1ebe030e4544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:10.849986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2452d97-308a-424c-bb88-1ebe030e4544 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:10.850510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2452d97-308a-424c-bb88-1ebe030e4544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:10.851306 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2452d97-308a-424c-bb88-1ebe030e4544 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:10.852488 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2452d97-308a-424c-bb88-1ebe030e4544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:10.855510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2452d97-308a-424c-bb88-1ebe030e4544 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:10.900088 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1134/2241] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:44:10 2022] POST /identity/v3/projects => generated 384 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:10.904792 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc0b64-45ac-42ea-b269-7163193b924c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:10.926867 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc0b64-45ac-42ea-b269-7163193b924c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:10.958461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:11.036958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112af5f-9d6e-422f-a579-2361c6fa5578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:11.038165 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112af5f-9d6e-422f-a579-2361c6fa5578 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.038722 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112af5f-9d6e-422f-a579-2361c6fa5578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.039231 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112af5f-9d6e-422f-a579-2361c6fa5578 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.040522 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112af5f-9d6e-422f-a579-2361c6fa5578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:11.044190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112af5f-9d6e-422f-a579-2361c6fa5578 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:11.083535 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1108/2242] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:44:10 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:11.088477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2452d97-308a-424c-bb88-1ebe030e4544 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.109208 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2452d97-308a-424c-bb88-1ebe030e4544 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:11.121512 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dab80d-2678-4851-95a1-9aad69f2ca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:11.122906 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dab80d-2678-4851-95a1-9aad69f2ca6f admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.123688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dab80d-2678-4851-95a1-9aad69f2ca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.126611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dab80d-2678-4851-95a1-9aad69f2ca6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.126611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dab80d-2678-4851-95a1-9aad69f2ca6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:11.130353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dab80d-2678-4851-95a1-9aad69f2ca6f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:11.148473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1135/2243] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:11 2022] GET /identity/v3/roles => generated 1427 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:44:11.152550 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112af5f-9d6e-422f-a579-2361c6fa5578 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.166679 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112af5f-9d6e-422f-a579-2361c6fa5578 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:11.179680 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ffd84-6c07-41a1-badc-54bb154c6560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:11.181008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ffd84-6c07-41a1-badc-54bb154c6560 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.181891 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ffd84-6c07-41a1-badc-54bb154c6560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.182006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ffd84-6c07-41a1-badc-54bb154c6560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.183446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ffd84-6c07-41a1-badc-54bb154c6560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:11.187417 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ffd84-6c07-41a1-badc-54bb154c6560 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:11.213886 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1109/2244] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:11 2022] GET /identity/v3/roles => generated 1427 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:11.216666 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dab80d-2678-4851-95a1-9aad69f2ca6f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.237888 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dab80d-2678-4851-95a1-9aad69f2ca6f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:11.254895 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede977bc-ba6d-4fa6-a78f-30a230bd20ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:11.254895 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede977bc-ba6d-4fa6-a78f-30a230bd20ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.254895 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede977bc-ba6d-4fa6-a78f-30a230bd20ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.254895 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede977bc-ba6d-4fa6-a78f-30a230bd20ea admin admin] PATH_INFO: `/v3/projects/e26e38cc2753497eae647ebee3e8b333/users/84f1cf25da624d97840c252d8a218881/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.269866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede977bc-ba6d-4fa6-a78f-30a230bd20ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26e38cc2753497eae647ebee3e8b333, user_id=84f1cf25da624d97840c252d8a218881, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:11.272620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede977bc-ba6d-4fa6-a78f-30a230bd20ea admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:11.288652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1136/2245] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:44:11 2022] PUT /identity/v3/projects/e26e38cc2753497eae647ebee3e8b333/users/84f1cf25da624d97840c252d8a218881/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:11.299429 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4d18f-29ef-4ac7-9a0f-69185a6d23db None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.300281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4d18f-29ef-4ac7-9a0f-69185a6d23db None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.300537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4d18f-29ef-4ac7-9a0f-69185a6d23db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.330912 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-eda4d18f-29ef-4ac7-9a0f-69185a6d23db None None] MFA Rules not processed for user `84f1cf25da624d97840c252d8a218881`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:11.332151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-eda4d18f-29ef-4ac7-9a0f-69185a6d23db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:11.430736 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1110/2246] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:11.437369 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede977bc-ba6d-4fa6-a78f-30a230bd20ea admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.480935 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:11.527609 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede977bc-ba6d-4fa6-a78f-30a230bd20ea admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:11.533246 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966a46e-979f-4f27-9073-0c266914bf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:11.534375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966a46e-979f-4f27-9073-0c266914bf62 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.534684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966a46e-979f-4f27-9073-0c266914bf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.534959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966a46e-979f-4f27-9073-0c266914bf62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.535773 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966a46e-979f-4f27-9073-0c266914bf62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:11.537764 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966a46e-979f-4f27-9073-0c266914bf62 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:11.577052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1137/2247] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:44:11 2022] POST /identity/v3/projects => generated 386 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:11.584394 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4d18f-29ef-4ac7-9a0f-69185a6d23db None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.600313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4d18f-29ef-4ac7-9a0f-69185a6d23db None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:11.694990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e9deb-12f3-4092-ac2d-36e791ea9385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:11.696198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e9deb-12f3-4092-ac2d-36e791ea9385 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.696198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e9deb-12f3-4092-ac2d-36e791ea9385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.696198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e9deb-12f3-4092-ac2d-36e791ea9385 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.696198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e9deb-12f3-4092-ac2d-36e791ea9385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:11.696198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e9deb-12f3-4092-ac2d-36e791ea9385 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:11.733518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1111/2248] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:44:11 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:11.741294 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966a46e-979f-4f27-9073-0c266914bf62 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.753981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966a46e-979f-4f27-9073-0c266914bf62 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:11.759368 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb3b3f-f81a-4707-a7a0-55b0c661e8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:11.760165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb3b3f-f81a-4707-a7a0-55b0c661e8df admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.760556 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb3b3f-f81a-4707-a7a0-55b0c661e8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.761022 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb3b3f-f81a-4707-a7a0-55b0c661e8df admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.761925 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb3b3f-f81a-4707-a7a0-55b0c661e8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:11.768539 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb3b3f-f81a-4707-a7a0-55b0c661e8df admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:11.790979 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1138/2249] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:11 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:11.797149 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e9deb-12f3-4092-ac2d-36e791ea9385 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.814883 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e9deb-12f3-4092-ac2d-36e791ea9385 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:11.828866 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737ca50-8597-4dc9-8735-3451e9ca187a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:11.829721 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737ca50-8597-4dc9-8735-3451e9ca187a admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.830217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737ca50-8597-4dc9-8735-3451e9ca187a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.831273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737ca50-8597-4dc9-8735-3451e9ca187a admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.832048 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737ca50-8597-4dc9-8735-3451e9ca187a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:11.834411 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737ca50-8597-4dc9-8735-3451e9ca187a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:11.855851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1112/2250] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:11 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:11.857664 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb3b3f-f81a-4707-a7a0-55b0c661e8df admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.873514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb3b3f-f81a-4707-a7a0-55b0c661e8df admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:11.881099 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795bcbe-69cd-4bb6-8924-fc01ef85d0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:11.882013 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795bcbe-69cd-4bb6-8924-fc01ef85d0be admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.882303 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795bcbe-69cd-4bb6-8924-fc01ef85d0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.882609 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795bcbe-69cd-4bb6-8924-fc01ef85d0be admin admin] PATH_INFO: `/v3/projects/456256aa131e489ba180b5d7c27561ef/users/ef5ef358fc32451584ba1bad717294ed/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.907815 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795bcbe-69cd-4bb6-8924-fc01ef85d0be admin admin] RBAC: Authorizing `identity:create_grant(project_id=456256aa131e489ba180b5d7c27561ef, user_id=ef5ef358fc32451584ba1bad717294ed, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:11.913729 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795bcbe-69cd-4bb6-8924-fc01ef85d0be admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:11.931837 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1139/2251] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:44:11 2022] PUT /identity/v3/projects/456256aa131e489ba180b5d7c27561ef/users/ef5ef358fc32451584ba1bad717294ed/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:11.951420 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47199337-b8d5-46a7-a675-38223c8aa24c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.951775 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47199337-b8d5-46a7-a675-38223c8aa24c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.952241 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47199337-b8d5-46a7-a675-38223c8aa24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.980281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:12.000055 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-47199337-b8d5-46a7-a675-38223c8aa24c None None] MFA Rules not processed for user `ef5ef358fc32451584ba1bad717294ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:12.001799 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-47199337-b8d5-46a7-a675-38223c8aa24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:12.139033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1113/2252] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:12.144573 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795bcbe-69cd-4bb6-8924-fc01ef85d0be admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:12.313831 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795bcbe-69cd-4bb6-8924-fc01ef85d0be admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:12.319260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba1883-57a4-40a6-a534-5aed9cb957de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:12.320069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba1883-57a4-40a6-a534-5aed9cb957de admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:12.320421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba1883-57a4-40a6-a534-5aed9cb957de admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:12.320774 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba1883-57a4-40a6-a534-5aed9cb957de admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:12.321818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba1883-57a4-40a6-a534-5aed9cb957de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:12.331995 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba1883-57a4-40a6-a534-5aed9cb957de admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:12.392425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1140/2253] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:44:12 2022] POST /identity/v3/projects => generated 386 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:12.394256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47199337-b8d5-46a7-a675-38223c8aa24c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:12.412613 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47199337-b8d5-46a7-a675-38223c8aa24c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:12.517259 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63e103-62f8-4982-b9e8-b88bda528b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:12.518914 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63e103-62f8-4982-b9e8-b88bda528b94 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:12.519368 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63e103-62f8-4982-b9e8-b88bda528b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:12.519807 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63e103-62f8-4982-b9e8-b88bda528b94 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:12.520808 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63e103-62f8-4982-b9e8-b88bda528b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:12.532055 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63e103-62f8-4982-b9e8-b88bda528b94 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:12.579378 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1114/2254] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:44:12 2022] POST /identity/v3/users => generated 300 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:12.581713 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba1883-57a4-40a6-a534-5aed9cb957de admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:12.595848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba1883-57a4-40a6-a534-5aed9cb957de admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:12.604130 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36cc6d-1bff-40cd-8f53-7691cf43c3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:12.605301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36cc6d-1bff-40cd-8f53-7691cf43c3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:12.605818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36cc6d-1bff-40cd-8f53-7691cf43c3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:12.606153 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36cc6d-1bff-40cd-8f53-7691cf43c3c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:12.608436 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36cc6d-1bff-40cd-8f53-7691cf43c3c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:12.610249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36cc6d-1bff-40cd-8f53-7691cf43c3c5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:12.643603 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63e103-62f8-4982-b9e8-b88bda528b94 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:12.643739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1141/2255] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:12 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:12.652685 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63e103-62f8-4982-b9e8-b88bda528b94 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:12.662785 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b9ced-1bdd-4200-a0b7-b06854dc36eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:12.663710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b9ced-1bdd-4200-a0b7-b06854dc36eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:12.664287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b9ced-1bdd-4200-a0b7-b06854dc36eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:12.664855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b9ced-1bdd-4200-a0b7-b06854dc36eb admin admin] PATH_INFO: `/v3/projects/a10c5ad5e2a24734b0acdfae40413f5b/users/fd53b8c8b89f423199274f0856f2e910/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:12.694187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b9ced-1bdd-4200-a0b7-b06854dc36eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a10c5ad5e2a24734b0acdfae40413f5b, user_id=fd53b8c8b89f423199274f0856f2e910, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:12.697346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b9ced-1bdd-4200-a0b7-b06854dc36eb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:12.722712 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1115/2256] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:44:12 2022] PUT /identity/v3/projects/a10c5ad5e2a24734b0acdfae40413f5b/users/fd53b8c8b89f423199274f0856f2e910/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:12.724584 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36cc6d-1bff-40cd-8f53-7691cf43c3c5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:12.749520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36cc6d-1bff-40cd-8f53-7691cf43c3c5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:12.855358 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:12.872745 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff30be-060a-413b-aa12-b1c37e9178e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:12.873554 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff30be-060a-413b-aa12-b1c37e9178e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:12.874056 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff30be-060a-413b-aa12-b1c37e9178e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:12.874410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff30be-060a-413b-aa12-b1c37e9178e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:12.875687 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff30be-060a-413b-aa12-b1c37e9178e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:12.881724 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff30be-060a-413b-aa12-b1c37e9178e1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:12.898621 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1142/2257] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:12 2022] GET /identity/v3/roles => generated 1427 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:12.903251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b9ced-1bdd-4200-a0b7-b06854dc36eb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:12.920524 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b9ced-1bdd-4200-a0b7-b06854dc36eb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:12.933678 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db1cad-441f-40ae-8588-2ce8639f9d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:12.935208 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db1cad-441f-40ae-8588-2ce8639f9d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:12.935681 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db1cad-441f-40ae-8588-2ce8639f9d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:12.936421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db1cad-441f-40ae-8588-2ce8639f9d6c admin admin] PATH_INFO: `/v3/projects/a10c5ad5e2a24734b0acdfae40413f5b/users/fd53b8c8b89f423199274f0856f2e910/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:12.939219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db1cad-441f-40ae-8588-2ce8639f9d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a10c5ad5e2a24734b0acdfae40413f5b, user_id=fd53b8c8b89f423199274f0856f2e910, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:12.943390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db1cad-441f-40ae-8588-2ce8639f9d6c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:12.966341 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1116/2258] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:44:12 2022] PUT /identity/v3/projects/a10c5ad5e2a24734b0acdfae40413f5b/users/fd53b8c8b89f423199274f0856f2e910/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:12.982676 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ffe28-a70c-4279-9f14-e1e6fe48d4fd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:12.983113 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ffe28-a70c-4279-9f14-e1e6fe48d4fd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:12.983537 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ffe28-a70c-4279-9f14-e1e6fe48d4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:13.040361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f79ffe28-a70c-4279-9f14-e1e6fe48d4fd None None] MFA Rules not processed for user `fd53b8c8b89f423199274f0856f2e910`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:13.042027 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f79ffe28-a70c-4279-9f14-e1e6fe48d4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:13.198495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1143/2259] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:13.219119 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db1cad-441f-40ae-8588-2ce8639f9d6c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:13.222204 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-53db1cad-441f-40ae-8588-2ce8639f9d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:13.327311 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db1cad-441f-40ae-8588-2ce8639f9d6c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:13.333957 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7418d4b-43bd-4322-932e-a9d86bf31b88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:13.335567 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7418d4b-43bd-4322-932e-a9d86bf31b88 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:13.336038 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7418d4b-43bd-4322-932e-a9d86bf31b88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:13.338930 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7418d4b-43bd-4322-932e-a9d86bf31b88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:13.346787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:13.448673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7418d4b-43bd-4322-932e-a9d86bf31b88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:13.450114 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7418d4b-43bd-4322-932e-a9d86bf31b88 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:13.460924 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1117/2260] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:13.665584 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ffe28-a70c-4279-9f14-e1e6fe48d4fd None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:13.669242 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f79ffe28-a70c-4279-9f14-e1e6fe48d4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:13.769304 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ffe28-a70c-4279-9f14-e1e6fe48d4fd None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:13.776263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade5b44-70e6-4068-aa49-e9aa09dc7e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:13.777566 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade5b44-70e6-4068-aa49-e9aa09dc7e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:13.778084 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade5b44-70e6-4068-aa49-e9aa09dc7e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:13.778483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade5b44-70e6-4068-aa49-e9aa09dc7e4e admin admin] PATH_INFO: `/v3/users/966205034da94e35a9445b2266ca1166` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:13.780671 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade5b44-70e6-4068-aa49-e9aa09dc7e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=966205034da94e35a9445b2266ca1166)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:13.783000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade5b44-70e6-4068-aa49-e9aa09dc7e4e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:13.883763 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4ade5b44-70e6-4068-aa49-e9aa09dc7e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966205034da94e35a9445b2266ca1166'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:13.925038 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4ade5b44-70e6-4068-aa49-e9aa09dc7e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966205034da94e35a9445b2266ca1166'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:13.926488 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4ade5b44-70e6-4068-aa49-e9aa09dc7e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966205034da94e35a9445b2266ca1166'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:13.941175 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4ade5b44-70e6-4068-aa49-e9aa09dc7e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966205034da94e35a9445b2266ca1166'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:13.944164 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4ade5b44-70e6-4068-aa49-e9aa09dc7e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966205034da94e35a9445b2266ca1166'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:13.960857 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:13.963458 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1144/2261] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:44:13 2022] DELETE /identity/v3/users/966205034da94e35a9445b2266ca1166 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:13.967545 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124733f1-fbce-4ca9-b736-01d81de826c4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:13.968088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124733f1-fbce-4ca9-b736-01d81de826c4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:13.968469 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124733f1-fbce-4ca9-b736-01d81de826c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:13.989201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-124733f1-fbce-4ca9-b736-01d81de826c4 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:13.990694 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-124733f1-fbce-4ca9-b736-01d81de826c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:14.091583 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1118/2262] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:14.105188 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade5b44-70e6-4068-aa49-e9aa09dc7e4e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:14.107282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4ade5b44-70e6-4068-aa49-e9aa09dc7e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:14.265607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade5b44-70e6-4068-aa49-e9aa09dc7e4e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:14.272634 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87967211-6402-422a-9743-22bac85137a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:14.273601 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87967211-6402-422a-9743-22bac85137a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:14.274079 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87967211-6402-422a-9743-22bac85137a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:14.274520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87967211-6402-422a-9743-22bac85137a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:14.288149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87967211-6402-422a-9743-22bac85137a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:14.289799 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87967211-6402-422a-9743-22bac85137a2 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:14.302598 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1145/2263] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:14.801423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124733f1-fbce-4ca9-b736-01d81de826c4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:14.806130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-124733f1-fbce-4ca9-b736-01d81de826c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:14.861705 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124733f1-fbce-4ca9-b736-01d81de826c4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:14.893643 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b86ac-f7da-4066-a5e6-860945b6791a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:14.895209 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b86ac-f7da-4066-a5e6-860945b6791a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:14.895879 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b86ac-f7da-4066-a5e6-860945b6791a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:14.896194 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b86ac-f7da-4066-a5e6-860945b6791a admin admin] PATH_INFO: `/v3/projects/3d126fe12a8042319d7639f0bf30dc16` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:14.899499 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b86ac-f7da-4066-a5e6-860945b6791a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d126fe12a8042319d7639f0bf30dc16)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:14.904788 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b86ac-f7da-4066-a5e6-860945b6791a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:15.067228 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ea3b86ac-f7da-4066-a5e6-860945b6791a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d126fe12a8042319d7639f0bf30dc16', 'request_id': 'req-ea3b86ac-f7da-4066-a5e6-860945b6791a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:15.082359 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ea3b86ac-f7da-4066-a5e6-860945b6791a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d126fe12a8042319d7639f0bf30dc16', 'request_id': 'req-ea3b86ac-f7da-4066-a5e6-860945b6791a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:15.096522 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ea3b86ac-f7da-4066-a5e6-860945b6791a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d126fe12a8042319d7639f0bf30dc16', 'request_id': 'req-ea3b86ac-f7da-4066-a5e6-860945b6791a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:15.121450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ea3b86ac-f7da-4066-a5e6-860945b6791a admin admin] The token cache is being invalidate because project 3d126fe12a8042319d7639f0bf30dc16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:15.121450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ea3b86ac-f7da-4066-a5e6-860945b6791a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:15.124744 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ea3b86ac-f7da-4066-a5e6-860945b6791a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:15.141699 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ce15d-a225-4140-a151-dde9a2f1bd30 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.143543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ce15d-a225-4140-a151-dde9a2f1bd30 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.143543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ce15d-a225-4140-a151-dde9a2f1bd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.146561 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1119/2264] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:44:14 2022] DELETE /identity/v3/projects/3d126fe12a8042319d7639f0bf30dc16 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:15.188266 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-080ce15d-a225-4140-a151-dde9a2f1bd30 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:15.191079 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-080ce15d-a225-4140-a151-dde9a2f1bd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:15.296428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1146/2265] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:15.307771 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061fdb6-4166-45a8-ab27-d0875b341d70 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.308067 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061fdb6-4166-45a8-ab27-d0875b341d70 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.308315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061fdb6-4166-45a8-ab27-d0875b341d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.336279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a061fdb6-4166-45a8-ab27-d0875b341d70 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:15.337544 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a061fdb6-4166-45a8-ab27-d0875b341d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:15.360343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1120/2266] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:15.367005 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ce15d-a225-4140-a151-dde9a2f1bd30 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:15.385555 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ce15d-a225-4140-a151-dde9a2f1bd30 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:15.392774 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5dbed-6f5a-491f-8e16-7ee037486abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:15.394326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5dbed-6f5a-491f-8e16-7ee037486abd admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.394785 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5dbed-6f5a-491f-8e16-7ee037486abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.395076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5dbed-6f5a-491f-8e16-7ee037486abd admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.395824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5dbed-6f5a-491f-8e16-7ee037486abd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:15.396143 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5dbed-6f5a-491f-8e16-7ee037486abd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:15.397768 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5dbed-6f5a-491f-8e16-7ee037486abd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:15.416051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1147/2267] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:44:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:15.420625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061fdb6-4166-45a8-ab27-d0875b341d70 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:15.435126 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061fdb6-4166-45a8-ab27-d0875b341d70 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:15.453610 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f2d6c-8595-4129-98b4-fc7e2bf81d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:15.454559 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f2d6c-8595-4129-98b4-fc7e2bf81d29 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.454964 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f2d6c-8595-4129-98b4-fc7e2bf81d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.455465 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f2d6c-8595-4129-98b4-fc7e2bf81d29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.456346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f2d6c-8595-4129-98b4-fc7e2bf81d29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:15.459119 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f2d6c-8595-4129-98b4-fc7e2bf81d29 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:15.498297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:15.515170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1121/2268] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:44:15 2022] POST /identity/v3/projects => generated 372 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:44:15.517001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5dbed-6f5a-491f-8e16-7ee037486abd admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:15.531360 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5dbed-6f5a-491f-8e16-7ee037486abd admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:15.624845 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da9cc4-8592-40ce-8da4-9ea8d6e0792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:15.625552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da9cc4-8592-40ce-8da4-9ea8d6e0792f admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.625899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da9cc4-8592-40ce-8da4-9ea8d6e0792f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.626187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da9cc4-8592-40ce-8da4-9ea8d6e0792f admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.627636 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da9cc4-8592-40ce-8da4-9ea8d6e0792f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:15.630109 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da9cc4-8592-40ce-8da4-9ea8d6e0792f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:15.639886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:15.663070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1148/2269] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:44:15 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:15.666193 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f2d6c-8595-4129-98b4-fc7e2bf81d29 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:15.666790 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da9cc4-8592-40ce-8da4-9ea8d6e0792f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:15.668687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0e3f2d6c-8595-4129-98b4-fc7e2bf81d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:15.685847 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da9cc4-8592-40ce-8da4-9ea8d6e0792f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:15.693107 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44280311-1d1f-4a96-873d-8fcd18343212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:15.693918 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44280311-1d1f-4a96-873d-8fcd18343212 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.694285 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44280311-1d1f-4a96-873d-8fcd18343212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.694717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44280311-1d1f-4a96-873d-8fcd18343212 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.695678 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44280311-1d1f-4a96-873d-8fcd18343212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:15.697741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44280311-1d1f-4a96-873d-8fcd18343212 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:15.715100 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1149/2270] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:15 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:15.721169 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44280311-1d1f-4a96-873d-8fcd18343212 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:15.753295 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44280311-1d1f-4a96-873d-8fcd18343212 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:15.771132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bf0c1-337f-49c8-97a0-6c739de73797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:15.772545 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bf0c1-337f-49c8-97a0-6c739de73797 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.773236 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bf0c1-337f-49c8-97a0-6c739de73797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.773934 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bf0c1-337f-49c8-97a0-6c739de73797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.774952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bf0c1-337f-49c8-97a0-6c739de73797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:15.780294 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bf0c1-337f-49c8-97a0-6c739de73797 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:15.782124 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f2d6c-8595-4129-98b4-fc7e2bf81d29 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:15.787029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b63ff6-c6e1-4709-bb94-b00dd17b001e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:15.787702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b63ff6-c6e1-4709-bb94-b00dd17b001e service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.788139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b63ff6-c6e1-4709-bb94-b00dd17b001e service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.788432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b63ff6-c6e1-4709-bb94-b00dd17b001e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.790389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-45b63ff6-c6e1-4709-bb94-b00dd17b001e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:15.800949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1150/2271] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:15 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:44:15.808598 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bf0c1-337f-49c8-97a0-6c739de73797 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:15.825982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bf0c1-337f-49c8-97a0-6c739de73797 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:15.841855 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038c02d-ba84-4d2c-b9ce-656c7ccba6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:15.843639 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038c02d-ba84-4d2c-b9ce-656c7ccba6a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.844115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038c02d-ba84-4d2c-b9ce-656c7ccba6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.844599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038c02d-ba84-4d2c-b9ce-656c7ccba6a7 admin admin] PATH_INFO: `/v3/projects/e38c3540360847bcac6202fa5476f3b3/users/850b30bfd633448c953bc25f588fc067/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.876495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038c02d-ba84-4d2c-b9ce-656c7ccba6a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e38c3540360847bcac6202fa5476f3b3, user_id=850b30bfd633448c953bc25f588fc067, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:15.888828 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038c02d-ba84-4d2c-b9ce-656c7ccba6a7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:15.906383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b63ff6-c6e1-4709-bb94-b00dd17b001e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:15.920437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1151/2272] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:44:15 2022] PUT /identity/v3/projects/e38c3540360847bcac6202fa5476f3b3/users/850b30bfd633448c953bc25f588fc067/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:15.920677 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b63ff6-c6e1-4709-bb94-b00dd17b001e service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:15.926747 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fa7db-596f-42cf-bfac-e23714cc9d54 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.928286 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fa7db-596f-42cf-bfac-e23714cc9d54 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.928862 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fa7db-596f-42cf-bfac-e23714cc9d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.938963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1122/2273] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:15.990720 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2a3fa7db-596f-42cf-bfac-e23714cc9d54 None None] MFA Rules not processed for user `850b30bfd633448c953bc25f588fc067`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:15.991909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2a3fa7db-596f-42cf-bfac-e23714cc9d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:16.159511 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1152/2274] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:16.222596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b63ff6-c6e1-4709-bb94-b00dd17b001e service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.225753 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-45b63ff6-c6e1-4709-bb94-b00dd17b001e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:16.257233 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b63ff6-c6e1-4709-bb94-b00dd17b001e service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.363674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dcf71-277c-49ff-a131-db83dd0be506 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.364539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dcf71-277c-49ff-a131-db83dd0be506 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.365243 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dcf71-277c-49ff-a131-db83dd0be506 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.365629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dcf71-277c-49ff-a131-db83dd0be506 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.378201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dcf71-277c-49ff-a131-db83dd0be506 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.380715 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dcf71-277c-49ff-a131-db83dd0be506 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.393677 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1123/2275] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:16.433230 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3fa7db-596f-42cf-bfac-e23714cc9d54 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.547081 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3fa7db-596f-42cf-bfac-e23714cc9d54 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.554659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce97821-052a-4047-9f64-2c5ad8687b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.555790 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce97821-052a-4047-9f64-2c5ad8687b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.556193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce97821-052a-4047-9f64-2c5ad8687b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.556603 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce97821-052a-4047-9f64-2c5ad8687b49 admin admin] PATH_INFO: `/v3/users/850b30bfd633448c953bc25f588fc067` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.558152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce97821-052a-4047-9f64-2c5ad8687b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=850b30bfd633448c953bc25f588fc067)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.561537 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce97821-052a-4047-9f64-2c5ad8687b49 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.630181 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:16.653010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8ce97821-052a-4047-9f64-2c5ad8687b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '850b30bfd633448c953bc25f588fc067'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:16.680636 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8ce97821-052a-4047-9f64-2c5ad8687b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '850b30bfd633448c953bc25f588fc067'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:16.682387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8ce97821-052a-4047-9f64-2c5ad8687b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '850b30bfd633448c953bc25f588fc067'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:16.697656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8ce97821-052a-4047-9f64-2c5ad8687b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '850b30bfd633448c953bc25f588fc067'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:16.698640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8ce97821-052a-4047-9f64-2c5ad8687b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '850b30bfd633448c953bc25f588fc067'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:16.721841 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1153/2276] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:44:16 2022] DELETE /identity/v3/users/850b30bfd633448c953bc25f588fc067 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:16.734308 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28f9fa-cd5c-43f0-8167-6ff12ed948aa None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.734806 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28f9fa-cd5c-43f0-8167-6ff12ed948aa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.735217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28f9fa-cd5c-43f0-8167-6ff12ed948aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.776497 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ca28f9fa-cd5c-43f0-8167-6ff12ed948aa None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:16.778382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ca28f9fa-cd5c-43f0-8167-6ff12ed948aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:16.872876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:16.894222 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1124/2277] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:16.904277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce97821-052a-4047-9f64-2c5ad8687b49 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.906284 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8ce97821-052a-4047-9f64-2c5ad8687b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:16.959581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28f9fa-cd5c-43f0-8167-6ff12ed948aa None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.961370 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ca28f9fa-cd5c-43f0-8167-6ff12ed948aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:17.009719 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce97821-052a-4047-9f64-2c5ad8687b49 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:17.016472 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e4b71-619e-4625-9640-066895efd61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:17.017712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e4b71-619e-4625-9640-066895efd61e service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:17.018293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e4b71-619e-4625-9640-066895efd61e service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:17.018817 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e4b71-619e-4625-9640-066895efd61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:17.037946 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e4b71-619e-4625-9640-066895efd61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:17.040949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e4b71-619e-4625-9640-066895efd61e service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:17.059050 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1154/2278] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:44:17.099127 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28f9fa-cd5c-43f0-8167-6ff12ed948aa None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:17.116445 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851205a-d1b9-424d-ba58-052462d18df2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:17.117849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851205a-d1b9-424d-ba58-052462d18df2 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:17.118421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851205a-d1b9-424d-ba58-052462d18df2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:17.118964 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851205a-d1b9-424d-ba58-052462d18df2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:17.121403 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4851205a-d1b9-424d-ba58-052462d18df2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:17.246083 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851205a-d1b9-424d-ba58-052462d18df2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:17.247835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851205a-d1b9-424d-ba58-052462d18df2 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:17.259986 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1125/2279] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:44:17.491964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e4b71-619e-4625-9640-066895efd61e service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:17.494787 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f90e4b71-619e-4625-9640-066895efd61e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:17.520383 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e4b71-619e-4625-9640-066895efd61e service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:17.538992 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f413a82-a26c-4eaa-829d-9dcc6ed814d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:17.542786 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f413a82-a26c-4eaa-829d-9dcc6ed814d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:17.543499 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f413a82-a26c-4eaa-829d-9dcc6ed814d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:17.544349 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f413a82-a26c-4eaa-829d-9dcc6ed814d1 admin admin] PATH_INFO: `/v3/projects/e38c3540360847bcac6202fa5476f3b3` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:17.546845 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f413a82-a26c-4eaa-829d-9dcc6ed814d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e38c3540360847bcac6202fa5476f3b3)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:17.552134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f413a82-a26c-4eaa-829d-9dcc6ed814d1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:17.681620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4f413a82-a26c-4eaa-829d-9dcc6ed814d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e38c3540360847bcac6202fa5476f3b3', 'request_id': 'req-4f413a82-a26c-4eaa-829d-9dcc6ed814d1'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:17.698044 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4f413a82-a26c-4eaa-829d-9dcc6ed814d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e38c3540360847bcac6202fa5476f3b3', 'request_id': 'req-4f413a82-a26c-4eaa-829d-9dcc6ed814d1'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:17.713751 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4f413a82-a26c-4eaa-829d-9dcc6ed814d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e38c3540360847bcac6202fa5476f3b3', 'request_id': 'req-4f413a82-a26c-4eaa-829d-9dcc6ed814d1'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:17.749516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4f413a82-a26c-4eaa-829d-9dcc6ed814d1 admin admin] The token cache is being invalidate because project e38c3540360847bcac6202fa5476f3b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:17.751077 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4f413a82-a26c-4eaa-829d-9dcc6ed814d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:17.752514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4f413a82-a26c-4eaa-829d-9dcc6ed814d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:17.755870 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1155/2280] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:44:17 2022] DELETE /identity/v3/projects/e38c3540360847bcac6202fa5476f3b3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:19.512536 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c18acf-fe04-47b6-a45e-8f6f9db90daa None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:19.513322 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c18acf-fe04-47b6-a45e-8f6f9db90daa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:19.513322 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c18acf-fe04-47b6-a45e-8f6f9db90daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:19.539596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-07c18acf-fe04-47b6-a45e-8f6f9db90daa None None] MFA Rules not processed for user `01d3da9345ed40f396730e41ccdda091`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:19.540877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-07c18acf-fe04-47b6-a45e-8f6f9db90daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:19.625090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1126/2281] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:20.206260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f413a82-a26c-4eaa-829d-9dcc6ed814d1 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:20.210065 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4f413a82-a26c-4eaa-829d-9dcc6ed814d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:20.280305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:20.324342 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f413a82-a26c-4eaa-829d-9dcc6ed814d1 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:20.334515 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a495c76-0880-4a50-a094-1e026c608060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:20.335903 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a495c76-0880-4a50-a094-1e026c608060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:20.336238 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a495c76-0880-4a50-a094-1e026c608060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:20.336532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a495c76-0880-4a50-a094-1e026c608060 admin admin] PATH_INFO: `/v3/users/2a238fdd6d9341e8ba494086f74ab048` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:20.338125 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a495c76-0880-4a50-a094-1e026c608060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a238fdd6d9341e8ba494086f74ab048)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:20.340553 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a495c76-0880-4a50-a094-1e026c608060 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:20.449000 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6a495c76-0880-4a50-a094-1e026c608060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a238fdd6d9341e8ba494086f74ab048'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:20.471986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6a495c76-0880-4a50-a094-1e026c608060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a238fdd6d9341e8ba494086f74ab048'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:20.472874 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6a495c76-0880-4a50-a094-1e026c608060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a238fdd6d9341e8ba494086f74ab048'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:20.495673 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6a495c76-0880-4a50-a094-1e026c608060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a238fdd6d9341e8ba494086f74ab048'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:20.497162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6a495c76-0880-4a50-a094-1e026c608060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a238fdd6d9341e8ba494086f74ab048'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:20.523921 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1156/2282] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:44:20 2022] DELETE /identity/v3/users/2a238fdd6d9341e8ba494086f74ab048 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:20.529477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7e9db-145d-4c4e-95cd-81dff8c96ae5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:20.531460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7e9db-145d-4c4e-95cd-81dff8c96ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:20.532248 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7e9db-145d-4c4e-95cd-81dff8c96ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:20.563523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2ee7e9db-145d-4c4e-95cd-81dff8c96ae5 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:20.565411 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2ee7e9db-145d-4c4e-95cd-81dff8c96ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:20.670977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:20.680853 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1127/2283] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:20.694248 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a495c76-0880-4a50-a094-1e026c608060 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:20.696548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6a495c76-0880-4a50-a094-1e026c608060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:20.772438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a495c76-0880-4a50-a094-1e026c608060 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:20.780541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf59f44-732c-4a00-b93c-2efac00cb41c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:20.781700 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf59f44-732c-4a00-b93c-2efac00cb41c service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:20.782237 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf59f44-732c-4a00-b93c-2efac00cb41c service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:20.783796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf59f44-732c-4a00-b93c-2efac00cb41c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:20.798089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf59f44-732c-4a00-b93c-2efac00cb41c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:20.799745 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf59f44-732c-4a00-b93c-2efac00cb41c service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:20.811494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1157/2284] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:21.135890 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7e9db-145d-4c4e-95cd-81dff8c96ae5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:21.138750 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2ee7e9db-145d-4c4e-95cd-81dff8c96ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:21.157309 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7e9db-145d-4c4e-95cd-81dff8c96ae5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:21.165855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dcfcc-63ae-4385-9033-67540451109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:21.167368 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dcfcc-63ae-4385-9033-67540451109b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:21.167804 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dcfcc-63ae-4385-9033-67540451109b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:21.167958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dcfcc-63ae-4385-9033-67540451109b admin admin] PATH_INFO: `/v3/projects/b913a578b426496d864891f42e089927` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:21.169896 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647dcfcc-63ae-4385-9033-67540451109b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b913a578b426496d864891f42e089927)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:21.174792 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647dcfcc-63ae-4385-9033-67540451109b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:21.251168 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-647dcfcc-63ae-4385-9033-67540451109b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b913a578b426496d864891f42e089927', 'request_id': 'req-647dcfcc-63ae-4385-9033-67540451109b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:21.264781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-647dcfcc-63ae-4385-9033-67540451109b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b913a578b426496d864891f42e089927', 'request_id': 'req-647dcfcc-63ae-4385-9033-67540451109b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:21.272741 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-647dcfcc-63ae-4385-9033-67540451109b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b913a578b426496d864891f42e089927', 'request_id': 'req-647dcfcc-63ae-4385-9033-67540451109b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:21.287856 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-647dcfcc-63ae-4385-9033-67540451109b admin admin] The token cache is being invalidate because project b913a578b426496d864891f42e089927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:21.288148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-647dcfcc-63ae-4385-9033-67540451109b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:21.289071 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-647dcfcc-63ae-4385-9033-67540451109b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:21.291275 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1128/2285] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:44:21 2022] DELETE /identity/v3/projects/b913a578b426496d864891f42e089927 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:21.297262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73458d5a-e534-4d43-929f-1ea0b3b97a1a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:21.297760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73458d5a-e534-4d43-929f-1ea0b3b97a1a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:21.297852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73458d5a-e534-4d43-929f-1ea0b3b97a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:21.317599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-73458d5a-e534-4d43-929f-1ea0b3b97a1a None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:21.318929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-73458d5a-e534-4d43-929f-1ea0b3b97a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:21.400254 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1158/2286] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:21.409816 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3438bb-a0a5-4c24-b75d-d22fb608ee28 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:21.410105 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3438bb-a0a5-4c24-b75d-d22fb608ee28 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:21.410391 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3438bb-a0a5-4c24-b75d-d22fb608ee28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:21.443972 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bd3438bb-a0a5-4c24-b75d-d22fb608ee28 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:21.445528 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bd3438bb-a0a5-4c24-b75d-d22fb608ee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:21.462237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1129/2287] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:21.468757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73458d5a-e534-4d43-929f-1ea0b3b97a1a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:21.477026 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:21.489288 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73458d5a-e534-4d43-929f-1ea0b3b97a1a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:21.499255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db400d88-afe2-479a-9d85-d2f11429ffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:21.502512 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db400d88-afe2-479a-9d85-d2f11429ffa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:21.503341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db400d88-afe2-479a-9d85-d2f11429ffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:21.503925 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db400d88-afe2-479a-9d85-d2f11429ffa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:21.505157 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db400d88-afe2-479a-9d85-d2f11429ffa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:21.505711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db400d88-afe2-479a-9d85-d2f11429ffa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:21.509093 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db400d88-afe2-479a-9d85-d2f11429ffa1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:21.539991 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1159/2288] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:44:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:21.544897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3438bb-a0a5-4c24-b75d-d22fb608ee28 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:21.556524 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3438bb-a0a5-4c24-b75d-d22fb608ee28 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:21.562006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f903c-eb82-45c2-b83c-a1e268959bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:21.562727 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f903c-eb82-45c2-b83c-a1e268959bce admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:21.563016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f903c-eb82-45c2-b83c-a1e268959bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:21.563371 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f903c-eb82-45c2-b83c-a1e268959bce admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:21.564644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f903c-eb82-45c2-b83c-a1e268959bce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:21.575535 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f903c-eb82-45c2-b83c-a1e268959bce admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:21.598001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db400d88-afe2-479a-9d85-d2f11429ffa1 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:21.601662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-db400d88-afe2-479a-9d85-d2f11429ffa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:21.622707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1130/2289] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:44:21 2022] POST /identity/v3/projects => generated 376 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:21.625388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f903c-eb82-45c2-b83c-a1e268959bce admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:21.631073 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db400d88-afe2-479a-9d85-d2f11429ffa1 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:21.716724 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4c064-7a76-40be-bd82-6eb074a6c6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:21.717576 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4c064-7a76-40be-bd82-6eb074a6c6b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:21.717860 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4c064-7a76-40be-bd82-6eb074a6c6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:21.718139 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4c064-7a76-40be-bd82-6eb074a6c6b9 admin admin] PATH_INFO: `/v3/users/84f1cf25da624d97840c252d8a218881` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:21.719674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4c064-7a76-40be-bd82-6eb074a6c6b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f1cf25da624d97840c252d8a218881)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:21.720011 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f903c-eb82-45c2-b83c-a1e268959bce admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:21.721663 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4c064-7a76-40be-bd82-6eb074a6c6b9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:21.726047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b76cf8-f1f1-4309-ba06-89b3dd496045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:21.726870 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b76cf8-f1f1-4309-ba06-89b3dd496045 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:21.730966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b76cf8-f1f1-4309-ba06-89b3dd496045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:21.731108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b76cf8-f1f1-4309-ba06-89b3dd496045 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:21.731833 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b76cf8-f1f1-4309-ba06-89b3dd496045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:21.737455 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b76cf8-f1f1-4309-ba06-89b3dd496045 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:21.778610 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1131/2290] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:44:21 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:44:21.781153 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b76cf8-f1f1-4309-ba06-89b3dd496045 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:21.793895 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-08f4c064-7a76-40be-bd82-6eb074a6c6b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f1cf25da624d97840c252d8a218881'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:21.801495 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b76cf8-f1f1-4309-ba06-89b3dd496045 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:21.810622 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902c0a0-b586-4e13-ba10-8b8da2696286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:21.811514 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902c0a0-b586-4e13-ba10-8b8da2696286 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:21.818666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902c0a0-b586-4e13-ba10-8b8da2696286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:21.818666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902c0a0-b586-4e13-ba10-8b8da2696286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:21.818666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902c0a0-b586-4e13-ba10-8b8da2696286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:21.818666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902c0a0-b586-4e13-ba10-8b8da2696286 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:21.840487 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-08f4c064-7a76-40be-bd82-6eb074a6c6b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f1cf25da624d97840c252d8a218881'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:21.841258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-08f4c064-7a76-40be-bd82-6eb074a6c6b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f1cf25da624d97840c252d8a218881'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:21.843995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1132/2291] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:21 2022] GET /identity/v3/roles => generated 1427 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:44:21.849843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902c0a0-b586-4e13-ba10-8b8da2696286 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:21.852637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2902c0a0-b586-4e13-ba10-8b8da2696286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:21.857237 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-08f4c064-7a76-40be-bd82-6eb074a6c6b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f1cf25da624d97840c252d8a218881'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:21.858464 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-08f4c064-7a76-40be-bd82-6eb074a6c6b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f1cf25da624d97840c252d8a218881'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:21.869169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902c0a0-b586-4e13-ba10-8b8da2696286 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:21.874185 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad1222-4a1a-441f-aded-996100c269ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:21.875235 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad1222-4a1a-441f-aded-996100c269ea admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:21.875235 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad1222-4a1a-441f-aded-996100c269ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:21.876264 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad1222-4a1a-441f-aded-996100c269ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:21.876264 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad1222-4a1a-441f-aded-996100c269ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:21.878331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad1222-4a1a-441f-aded-996100c269ea admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:21.884102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1160/2292] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:44:21 2022] DELETE /identity/v3/users/84f1cf25da624d97840c252d8a218881 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:21.889063 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ce0ea-4c98-4a5b-b941-e46c38495920 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:21.889475 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ce0ea-4c98-4a5b-b941-e46c38495920 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:21.889944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ce0ea-4c98-4a5b-b941-e46c38495920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:21.897394 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1133/2293] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:21 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:44:21.901664 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad1222-4a1a-441f-aded-996100c269ea admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:21.915909 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad1222-4a1a-441f-aded-996100c269ea admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:21.918240 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-200ce0ea-4c98-4a5b-b941-e46c38495920 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:21.919979 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-200ce0ea-4c98-4a5b-b941-e46c38495920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:21.942662 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:22.016582 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1161/2294] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:22.029102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ce0ea-4c98-4a5b-b941-e46c38495920 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:22.030529 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-200ce0ea-4c98-4a5b-b941-e46c38495920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:22.033657 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07087eff-46a9-4b51-a8f5-d98ef3d7b908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:22.036219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07087eff-46a9-4b51-a8f5-d98ef3d7b908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:22.037722 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07087eff-46a9-4b51-a8f5-d98ef3d7b908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:22.038210 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07087eff-46a9-4b51-a8f5-d98ef3d7b908 admin admin] PATH_INFO: `/v3/projects/f1feb64c908840da849faa5ec9dee973/users/6adf392eccd0443e814f52fc0be827cc/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:22.043627 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:22.059915 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07087eff-46a9-4b51-a8f5-d98ef3d7b908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1feb64c908840da849faa5ec9dee973, user_id=6adf392eccd0443e814f52fc0be827cc, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:22.062980 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07087eff-46a9-4b51-a8f5-d98ef3d7b908 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:22.080261 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1134/2295] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:44:21 2022] PUT /identity/v3/projects/f1feb64c908840da849faa5ec9dee973/users/6adf392eccd0443e814f52fc0be827cc/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:22.096189 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638edf5-1562-434d-adac-730252bf39bd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:22.096606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638edf5-1562-434d-adac-730252bf39bd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:22.097061 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638edf5-1562-434d-adac-730252bf39bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:22.135852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ce0ea-4c98-4a5b-b941-e46c38495920 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:22.139837 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7638edf5-1562-434d-adac-730252bf39bd None None] MFA Rules not processed for user `6adf392eccd0443e814f52fc0be827cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:22.142361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7638edf5-1562-434d-adac-730252bf39bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:22.228340 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77fe1b-f8b6-4125-99c6-afb4aa4d9505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:22.229480 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77fe1b-f8b6-4125-99c6-afb4aa4d9505 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:22.229996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77fe1b-f8b6-4125-99c6-afb4aa4d9505 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:22.230828 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77fe1b-f8b6-4125-99c6-afb4aa4d9505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:22.254396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1135/2296] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:22.270848 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638edf5-1562-434d-adac-730252bf39bd None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:22.273692 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7638edf5-1562-434d-adac-730252bf39bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:22.340130 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77fe1b-f8b6-4125-99c6-afb4aa4d9505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:22.342589 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77fe1b-f8b6-4125-99c6-afb4aa4d9505 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:22.355156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1162/2297] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:44:22.371811 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638edf5-1562-434d-adac-730252bf39bd None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:22.377356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30047736-240a-4f0a-b77c-1c4fbdf1a689 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:22.377571 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30047736-240a-4f0a-b77c-1c4fbdf1a689 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:22.377996 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30047736-240a-4f0a-b77c-1c4fbdf1a689 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:22.378386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30047736-240a-4f0a-b77c-1c4fbdf1a689 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:22.394366 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30047736-240a-4f0a-b77c-1c4fbdf1a689 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:22.396267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30047736-240a-4f0a-b77c-1c4fbdf1a689 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:22.408181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1136/2298] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:22.769995 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77fe1b-f8b6-4125-99c6-afb4aa4d9505 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:22.771786 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6f77fe1b-f8b6-4125-99c6-afb4aa4d9505 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:22.796012 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77fe1b-f8b6-4125-99c6-afb4aa4d9505 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:22.804116 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5113d4-7c93-42c8-b955-dde2c52c558c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:22.805534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5113d4-7c93-42c8-b955-dde2c52c558c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:22.805924 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5113d4-7c93-42c8-b955-dde2c52c558c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:22.806398 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5113d4-7c93-42c8-b955-dde2c52c558c admin admin] PATH_INFO: `/v3/projects/e26e38cc2753497eae647ebee3e8b333` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:22.808626 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5113d4-7c93-42c8-b955-dde2c52c558c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26e38cc2753497eae647ebee3e8b333)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:22.812336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5113d4-7c93-42c8-b955-dde2c52c558c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:22.894836 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3a5113d4-7c93-42c8-b955-dde2c52c558c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26e38cc2753497eae647ebee3e8b333', 'request_id': 'req-3a5113d4-7c93-42c8-b955-dde2c52c558c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:22.903670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3a5113d4-7c93-42c8-b955-dde2c52c558c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26e38cc2753497eae647ebee3e8b333', 'request_id': 'req-3a5113d4-7c93-42c8-b955-dde2c52c558c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:22.928128 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3a5113d4-7c93-42c8-b955-dde2c52c558c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26e38cc2753497eae647ebee3e8b333', 'request_id': 'req-3a5113d4-7c93-42c8-b955-dde2c52c558c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:22.944478 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:22.950740 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3a5113d4-7c93-42c8-b955-dde2c52c558c admin admin] The token cache is being invalidate because project e26e38cc2753497eae647ebee3e8b333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:22.951517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3a5113d4-7c93-42c8-b955-dde2c52c558c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:22.952526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3a5113d4-7c93-42c8-b955-dde2c52c558c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:22.958671 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1163/2299] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:44:22 2022] DELETE /identity/v3/projects/e26e38cc2753497eae647ebee3e8b333 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:22.961990 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30047736-240a-4f0a-b77c-1c4fbdf1a689 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:22.975603 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30047736-240a-4f0a-b77c-1c4fbdf1a689 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:23.022074 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:23.056001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76644f07-2d26-4bf2-841c-39fb25b8bae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:23.057040 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76644f07-2d26-4bf2-841c-39fb25b8bae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:23.057339 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76644f07-2d26-4bf2-841c-39fb25b8bae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:23.057632 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76644f07-2d26-4bf2-841c-39fb25b8bae7 admin admin] PATH_INFO: `/v3/users/ef5ef358fc32451584ba1bad717294ed` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:23.059233 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76644f07-2d26-4bf2-841c-39fb25b8bae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef5ef358fc32451584ba1bad717294ed)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:23.061992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76644f07-2d26-4bf2-841c-39fb25b8bae7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:23.134700 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-76644f07-2d26-4bf2-841c-39fb25b8bae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef5ef358fc32451584ba1bad717294ed'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:23.135721 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-76644f07-2d26-4bf2-841c-39fb25b8bae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef5ef358fc32451584ba1bad717294ed'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:23.145922 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-76644f07-2d26-4bf2-841c-39fb25b8bae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef5ef358fc32451584ba1bad717294ed'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:23.146688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-76644f07-2d26-4bf2-841c-39fb25b8bae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef5ef358fc32451584ba1bad717294ed'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:23.155835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-76644f07-2d26-4bf2-841c-39fb25b8bae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef5ef358fc32451584ba1bad717294ed'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:23.185366 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1137/2300] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:44:22 2022] DELETE /identity/v3/users/ef5ef358fc32451584ba1bad717294ed => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:23.542773 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5113d4-7c93-42c8-b955-dde2c52c558c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:23.544516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3a5113d4-7c93-42c8-b955-dde2c52c558c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:23.566033 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5113d4-7c93-42c8-b955-dde2c52c558c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:23.650774 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e617ee-75b5-4240-ad50-f2f21dcb3b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:23.652157 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e617ee-75b5-4240-ad50-f2f21dcb3b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:23.652515 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e617ee-75b5-4240-ad50-f2f21dcb3b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:23.652950 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e617ee-75b5-4240-ad50-f2f21dcb3b96 admin admin] PATH_INFO: `/v3/projects/456256aa131e489ba180b5d7c27561ef` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:23.654514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e617ee-75b5-4240-ad50-f2f21dcb3b96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=456256aa131e489ba180b5d7c27561ef)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:23.656659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e617ee-75b5-4240-ad50-f2f21dcb3b96 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:23.721680 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-90e617ee-75b5-4240-ad50-f2f21dcb3b96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '456256aa131e489ba180b5d7c27561ef', 'request_id': 'req-90e617ee-75b5-4240-ad50-f2f21dcb3b96'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:23.728402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-90e617ee-75b5-4240-ad50-f2f21dcb3b96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '456256aa131e489ba180b5d7c27561ef', 'request_id': 'req-90e617ee-75b5-4240-ad50-f2f21dcb3b96'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:23.734854 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-90e617ee-75b5-4240-ad50-f2f21dcb3b96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '456256aa131e489ba180b5d7c27561ef', 'request_id': 'req-90e617ee-75b5-4240-ad50-f2f21dcb3b96'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:23.754353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-90e617ee-75b5-4240-ad50-f2f21dcb3b96 admin admin] The token cache is being invalidate because project 456256aa131e489ba180b5d7c27561ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:23.754694 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-90e617ee-75b5-4240-ad50-f2f21dcb3b96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:23.755445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-90e617ee-75b5-4240-ad50-f2f21dcb3b96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:23.757621 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1164/2301] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:44:23 2022] DELETE /identity/v3/projects/456256aa131e489ba180b5d7c27561ef => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:23.761971 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76644f07-2d26-4bf2-841c-39fb25b8bae7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:23.763766 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-76644f07-2d26-4bf2-841c-39fb25b8bae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:23.783798 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76644f07-2d26-4bf2-841c-39fb25b8bae7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:23.862600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50943c8-0ef5-480b-b0e5-94e74ed927e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:23.863909 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50943c8-0ef5-480b-b0e5-94e74ed927e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:23.864443 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50943c8-0ef5-480b-b0e5-94e74ed927e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:23.864866 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50943c8-0ef5-480b-b0e5-94e74ed927e7 admin admin] PATH_INFO: `/v3/users/fd53b8c8b89f423199274f0856f2e910` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:23.866929 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50943c8-0ef5-480b-b0e5-94e74ed927e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd53b8c8b89f423199274f0856f2e910)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:23.870551 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50943c8-0ef5-480b-b0e5-94e74ed927e7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:23.948688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a50943c8-0ef5-480b-b0e5-94e74ed927e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd53b8c8b89f423199274f0856f2e910'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:23.949736 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a50943c8-0ef5-480b-b0e5-94e74ed927e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd53b8c8b89f423199274f0856f2e910'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:23.960176 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:23.967302 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a50943c8-0ef5-480b-b0e5-94e74ed927e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd53b8c8b89f423199274f0856f2e910'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:23.969995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a50943c8-0ef5-480b-b0e5-94e74ed927e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd53b8c8b89f423199274f0856f2e910'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:23.981390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a50943c8-0ef5-480b-b0e5-94e74ed927e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd53b8c8b89f423199274f0856f2e910'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:24.013668 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1138/2302] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:44:23 2022] DELETE /identity/v3/users/fd53b8c8b89f423199274f0856f2e910 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:24.023239 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40de7a2-824d-48d1-a543-3107ca15747a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:24.023596 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40de7a2-824d-48d1-a543-3107ca15747a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:24.023832 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40de7a2-824d-48d1-a543-3107ca15747a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:24.045273 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d40de7a2-824d-48d1-a543-3107ca15747a None None] MFA Rules not processed for user `6adf392eccd0443e814f52fc0be827cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:24.046637 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d40de7a2-824d-48d1-a543-3107ca15747a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:24.131806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1165/2303] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:24.480959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50943c8-0ef5-480b-b0e5-94e74ed927e7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:24.483161 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a50943c8-0ef5-480b-b0e5-94e74ed927e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:24.607360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50943c8-0ef5-480b-b0e5-94e74ed927e7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:24.630903 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770edde-f1e0-483d-9b8f-324eb72c8299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:24.633954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770edde-f1e0-483d-9b8f-324eb72c8299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:24.634746 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770edde-f1e0-483d-9b8f-324eb72c8299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:24.635559 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770edde-f1e0-483d-9b8f-324eb72c8299 admin admin] PATH_INFO: `/v3/projects/a10c5ad5e2a24734b0acdfae40413f5b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:24.639013 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770edde-f1e0-483d-9b8f-324eb72c8299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a10c5ad5e2a24734b0acdfae40413f5b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:24.643062 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770edde-f1e0-483d-9b8f-324eb72c8299 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:24.730079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f770edde-f1e0-483d-9b8f-324eb72c8299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a10c5ad5e2a24734b0acdfae40413f5b', 'request_id': 'req-f770edde-f1e0-483d-9b8f-324eb72c8299'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:24.747171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f770edde-f1e0-483d-9b8f-324eb72c8299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a10c5ad5e2a24734b0acdfae40413f5b', 'request_id': 'req-f770edde-f1e0-483d-9b8f-324eb72c8299'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:24.762168 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f770edde-f1e0-483d-9b8f-324eb72c8299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a10c5ad5e2a24734b0acdfae40413f5b', 'request_id': 'req-f770edde-f1e0-483d-9b8f-324eb72c8299'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:24.784626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f770edde-f1e0-483d-9b8f-324eb72c8299 admin admin] The token cache is being invalidate because project a10c5ad5e2a24734b0acdfae40413f5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:24.785063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f770edde-f1e0-483d-9b8f-324eb72c8299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:24.787114 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f770edde-f1e0-483d-9b8f-324eb72c8299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:24.797024 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1139/2304] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:44:24 2022] DELETE /identity/v3/projects/a10c5ad5e2a24734b0acdfae40413f5b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:24.802129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f26ad-6ddd-4e69-9bd3-6be361d0180d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:24.802129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f26ad-6ddd-4e69-9bd3-6be361d0180d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:24.803062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f26ad-6ddd-4e69-9bd3-6be361d0180d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:24.847007 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-205f26ad-6ddd-4e69-9bd3-6be361d0180d None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:24.849445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-205f26ad-6ddd-4e69-9bd3-6be361d0180d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:24.886644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:24.966660 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1166/2305] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:24.978316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104f3e4-1c3e-4c55-a808-6ff6a0379e57 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:24.979524 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104f3e4-1c3e-4c55-a808-6ff6a0379e57 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:24.980075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104f3e4-1c3e-4c55-a808-6ff6a0379e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:25.006565 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b104f3e4-1c3e-4c55-a808-6ff6a0379e57 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:25.007857 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b104f3e4-1c3e-4c55-a808-6ff6a0379e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:25.019098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1140/2306] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:25.022389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f26ad-6ddd-4e69-9bd3-6be361d0180d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:25.038215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f26ad-6ddd-4e69-9bd3-6be361d0180d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:25.052842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e93b4e-dd43-4e81-bc17-4bb0416bd1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:25.053533 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e93b4e-dd43-4e81-bc17-4bb0416bd1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:25.054172 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e93b4e-dd43-4e81-bc17-4bb0416bd1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:25.054907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e93b4e-dd43-4e81-bc17-4bb0416bd1f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:25.055917 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e93b4e-dd43-4e81-bc17-4bb0416bd1f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:25.056338 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e93b4e-dd43-4e81-bc17-4bb0416bd1f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:25.058521 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e93b4e-dd43-4e81-bc17-4bb0416bd1f5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:25.074899 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1167/2307] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:44:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:25.081241 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104f3e4-1c3e-4c55-a808-6ff6a0379e57 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:25.096050 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104f3e4-1c3e-4c55-a808-6ff6a0379e57 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:25.102086 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e01be-2030-4eb6-a406-79e5b3564862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:25.103180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e01be-2030-4eb6-a406-79e5b3564862 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:25.103626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e01be-2030-4eb6-a406-79e5b3564862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:25.104064 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e01be-2030-4eb6-a406-79e5b3564862 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:25.105174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e01be-2030-4eb6-a406-79e5b3564862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:25.108526 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e01be-2030-4eb6-a406-79e5b3564862 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:25.156912 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1141/2308] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:44:25 2022] POST /identity/v3/projects => generated 372 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:44:25.161398 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e93b4e-dd43-4e81-bc17-4bb0416bd1f5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:25.172790 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e93b4e-dd43-4e81-bc17-4bb0416bd1f5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:25.280190 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0e656-f284-40c7-8e3b-812707883bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:25.281426 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0e656-f284-40c7-8e3b-812707883bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:25.282027 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0e656-f284-40c7-8e3b-812707883bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:25.283664 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0e656-f284-40c7-8e3b-812707883bd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:25.285097 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0e656-f284-40c7-8e3b-812707883bd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:25.289934 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0e656-f284-40c7-8e3b-812707883bd4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:25.327785 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1168/2309] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:44:25 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:25.333203 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e01be-2030-4eb6-a406-79e5b3564862 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:25.354845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e01be-2030-4eb6-a406-79e5b3564862 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:25.360823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954c67f-23ea-499b-abbc-5c53ca89ce3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:25.361855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954c67f-23ea-499b-abbc-5c53ca89ce3b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:25.362256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954c67f-23ea-499b-abbc-5c53ca89ce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:25.362811 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954c67f-23ea-499b-abbc-5c53ca89ce3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:25.363700 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954c67f-23ea-499b-abbc-5c53ca89ce3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:25.365502 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954c67f-23ea-499b-abbc-5c53ca89ce3b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:25.380865 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1142/2310] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:25 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:25.386181 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0e656-f284-40c7-8e3b-812707883bd4 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:25.399217 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0e656-f284-40c7-8e3b-812707883bd4 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:25.411021 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926980d-c287-41ce-ab12-c40f6cec08fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:25.411909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926980d-c287-41ce-ab12-c40f6cec08fc admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:25.412565 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926980d-c287-41ce-ab12-c40f6cec08fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:25.412930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926980d-c287-41ce-ab12-c40f6cec08fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:25.413955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926980d-c287-41ce-ab12-c40f6cec08fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:25.415752 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926980d-c287-41ce-ab12-c40f6cec08fc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:25.439264 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1169/2311] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:25 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:44:25.441201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954c67f-23ea-499b-abbc-5c53ca89ce3b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:25.457289 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954c67f-23ea-499b-abbc-5c53ca89ce3b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:25.477183 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73863916-08b1-4a9c-983c-c20af2945035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:25.478981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73863916-08b1-4a9c-983c-c20af2945035 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:25.479715 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73863916-08b1-4a9c-983c-c20af2945035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:25.480400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73863916-08b1-4a9c-983c-c20af2945035 admin admin] PATH_INFO: `/v3/projects/a882a7528f4646e59e816954167de6d2/users/bdd6bcaef051419b93f1623d3eccac84/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:25.537265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73863916-08b1-4a9c-983c-c20af2945035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a882a7528f4646e59e816954167de6d2, user_id=bdd6bcaef051419b93f1623d3eccac84, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:25.545762 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73863916-08b1-4a9c-983c-c20af2945035 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:25.549518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:25.569829 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1143/2312] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:44:25 2022] PUT /identity/v3/projects/a882a7528f4646e59e816954167de6d2/users/bdd6bcaef051419b93f1623d3eccac84/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:25.575009 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ebfe7-e2c8-4ba0-89de-6a2ac22967fe None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:25.575316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ebfe7-e2c8-4ba0-89de-6a2ac22967fe None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:25.575599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ebfe7-e2c8-4ba0-89de-6a2ac22967fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:25.596576 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b40ebfe7-e2c8-4ba0-89de-6a2ac22967fe None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:25.597778 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b40ebfe7-e2c8-4ba0-89de-6a2ac22967fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:25.742754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1170/2313] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:25.765681 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73863916-08b1-4a9c-983c-c20af2945035 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:25.769093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-73863916-08b1-4a9c-983c-c20af2945035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:25.898974 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73863916-08b1-4a9c-983c-c20af2945035 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:25.904576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675c1e2-598c-4af0-8822-cc2c5b10e96e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:25.906275 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675c1e2-598c-4af0-8822-cc2c5b10e96e service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:25.906487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675c1e2-598c-4af0-8822-cc2c5b10e96e service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:25.906926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675c1e2-598c-4af0-8822-cc2c5b10e96e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:25.928334 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675c1e2-598c-4af0-8822-cc2c5b10e96e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:25.930095 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675c1e2-598c-4af0-8822-cc2c5b10e96e service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:25.949181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1144/2314] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:44:35.707568 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:35.944518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=28 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:36.089830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ebfe7-e2c8-4ba0-89de-6a2ac22967fe None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:36.093350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b40ebfe7-e2c8-4ba0-89de-6a2ac22967fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:36.112943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ebfe7-e2c8-4ba0-89de-6a2ac22967fe None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:36.127768 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c6947-a1c1-473b-a0d0-432224c39c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:36.129934 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c6947-a1c1-473b-a0d0-432224c39c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:36.130293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c6947-a1c1-473b-a0d0-432224c39c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:36.130716 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c6947-a1c1-473b-a0d0-432224c39c25 admin admin] PATH_INFO: `/v3/users/77d30a8a09c44b40a2e32065e5fcde64` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:36.138767 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c6947-a1c1-473b-a0d0-432224c39c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d30a8a09c44b40a2e32065e5fcde64)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:36.141106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c6947-a1c1-473b-a0d0-432224c39c25 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:36.221013 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2f6c6947-a1c1-473b-a0d0-432224c39c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d30a8a09c44b40a2e32065e5fcde64'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:36.260013 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2f6c6947-a1c1-473b-a0d0-432224c39c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d30a8a09c44b40a2e32065e5fcde64'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:36.261107 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2f6c6947-a1c1-473b-a0d0-432224c39c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d30a8a09c44b40a2e32065e5fcde64'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:36.270972 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2f6c6947-a1c1-473b-a0d0-432224c39c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d30a8a09c44b40a2e32065e5fcde64'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:36.271691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2f6c6947-a1c1-473b-a0d0-432224c39c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d30a8a09c44b40a2e32065e5fcde64'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:36.294688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1171/2315] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:44:36 2022] DELETE /identity/v3/users/77d30a8a09c44b40a2e32065e5fcde64 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:36.301369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6f51f-775f-4473-b00c-e7f317d8e873 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:36.301655 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6f51f-775f-4473-b00c-e7f317d8e873 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:36.301942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6f51f-775f-4473-b00c-e7f317d8e873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:36.321194 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-84b6f51f-775f-4473-b00c-e7f317d8e873 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:36.323601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-84b6f51f-775f-4473-b00c-e7f317d8e873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:36.433880 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1145/2316] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:36.450965 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c6947-a1c1-473b-a0d0-432224c39c25 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:36.452588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2f6c6947-a1c1-473b-a0d0-432224c39c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:36.537008 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c6947-a1c1-473b-a0d0-432224c39c25 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:36.542354 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6315ce-cd4c-44b8-b051-2427ccf9792e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:36.543063 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6315ce-cd4c-44b8-b051-2427ccf9792e service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:36.543762 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6315ce-cd4c-44b8-b051-2427ccf9792e service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:36.543762 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6315ce-cd4c-44b8-b051-2427ccf9792e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:36.564132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6315ce-cd4c-44b8-b051-2427ccf9792e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:36.566287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6315ce-cd4c-44b8-b051-2427ccf9792e service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:36.596962 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1172/2317] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:38.161018 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6f51f-775f-4473-b00c-e7f317d8e873 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:38.163139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-84b6f51f-775f-4473-b00c-e7f317d8e873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:38.176074 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6f51f-775f-4473-b00c-e7f317d8e873 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:38.181610 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95c513-f20d-4811-8d49-623d9074c68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:38.182534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95c513-f20d-4811-8d49-623d9074c68b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:38.183027 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95c513-f20d-4811-8d49-623d9074c68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:38.183456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95c513-f20d-4811-8d49-623d9074c68b admin admin] PATH_INFO: `/v3/projects/2156757ac65f40f995b01b9ad6b943f5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:38.185001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95c513-f20d-4811-8d49-623d9074c68b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2156757ac65f40f995b01b9ad6b943f5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:38.187414 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95c513-f20d-4811-8d49-623d9074c68b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:38.264622 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cb95c513-f20d-4811-8d49-623d9074c68b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2156757ac65f40f995b01b9ad6b943f5', 'request_id': 'req-cb95c513-f20d-4811-8d49-623d9074c68b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:38.277132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cb95c513-f20d-4811-8d49-623d9074c68b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2156757ac65f40f995b01b9ad6b943f5', 'request_id': 'req-cb95c513-f20d-4811-8d49-623d9074c68b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:38.289564 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cb95c513-f20d-4811-8d49-623d9074c68b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2156757ac65f40f995b01b9ad6b943f5', 'request_id': 'req-cb95c513-f20d-4811-8d49-623d9074c68b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:38.305412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cb95c513-f20d-4811-8d49-623d9074c68b admin admin] The token cache is being invalidate because project 2156757ac65f40f995b01b9ad6b943f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:38.305912 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cb95c513-f20d-4811-8d49-623d9074c68b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:38.306750 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cb95c513-f20d-4811-8d49-623d9074c68b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:38.308710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1146/2318] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:44:38 2022] DELETE /identity/v3/projects/2156757ac65f40f995b01b9ad6b943f5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:38.531364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6315ce-cd4c-44b8-b051-2427ccf9792e service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:38.533813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0c6315ce-cd4c-44b8-b051-2427ccf9792e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:38.554332 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6315ce-cd4c-44b8-b051-2427ccf9792e service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:38.596483 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbc4db-48d0-44e5-bf69-cd456c5bbbbf None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:38.597166 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbc4db-48d0-44e5-bf69-cd456c5bbbbf None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:38.597635 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbc4db-48d0-44e5-bf69-cd456c5bbbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:38.664755 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-04cbc4db-48d0-44e5-bf69-cd456c5bbbbf None None] MFA Rules not processed for user `bdd6bcaef051419b93f1623d3eccac84`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:38.667677 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-04cbc4db-48d0-44e5-bf69-cd456c5bbbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:38.695364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a18d51-8d2d-459d-9e90-9b079cc17a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:38.697161 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a18d51-8d2d-459d-9e90-9b079cc17a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:38.697721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a18d51-8d2d-459d-9e90-9b079cc17a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:38.698204 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a18d51-8d2d-459d-9e90-9b079cc17a7c admin admin] PATH_INFO: `/v3/users/6f397bf708d64e16befce9daf1de323b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:38.701084 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a18d51-8d2d-459d-9e90-9b079cc17a7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f397bf708d64e16befce9daf1de323b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:38.704914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a18d51-8d2d-459d-9e90-9b079cc17a7c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:38.737740 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:38.802077 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-75a18d51-8d2d-459d-9e90-9b079cc17a7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f397bf708d64e16befce9daf1de323b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:38.808682 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1147/2319] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:38.810202 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbc4db-48d0-44e5-bf69-cd456c5bbbbf None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:38.811824 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-04cbc4db-48d0-44e5-bf69-cd456c5bbbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:38.817745 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-75a18d51-8d2d-459d-9e90-9b079cc17a7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f397bf708d64e16befce9daf1de323b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:38.818516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-75a18d51-8d2d-459d-9e90-9b079cc17a7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f397bf708d64e16befce9daf1de323b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:38.829406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-75a18d51-8d2d-459d-9e90-9b079cc17a7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f397bf708d64e16befce9daf1de323b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:38.830851 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-75a18d51-8d2d-459d-9e90-9b079cc17a7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f397bf708d64e16befce9daf1de323b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:38.835687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbc4db-48d0-44e5-bf69-cd456c5bbbbf None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:38.841895 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362e62d-1458-41a6-b312-6e68ee2e3d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:38.842877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362e62d-1458-41a6-b312-6e68ee2e3d8c admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:38.843574 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362e62d-1458-41a6-b312-6e68ee2e3d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:38.843981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362e62d-1458-41a6-b312-6e68ee2e3d8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:38.845130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362e62d-1458-41a6-b312-6e68ee2e3d8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:38.848708 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362e62d-1458-41a6-b312-6e68ee2e3d8c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:38.852012 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1173/2320] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:44:38 2022] DELETE /identity/v3/users/6f397bf708d64e16befce9daf1de323b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:38.859291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21529c60-b56b-45ef-be19-925dff282454 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:38.859949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21529c60-b56b-45ef-be19-925dff282454 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:38.860093 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21529c60-b56b-45ef-be19-925dff282454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:38.878100 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:38.897643 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-21529c60-b56b-45ef-be19-925dff282454 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:38.899237 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-21529c60-b56b-45ef-be19-925dff282454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:38.913494 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1148/2321] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:44:38 2022] POST /identity/v3/projects => generated 374 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:38.915421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362e62d-1458-41a6-b312-6e68ee2e3d8c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:38.917972 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5362e62d-1458-41a6-b312-6e68ee2e3d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:39.039211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1174/2322] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:39.052277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21529c60-b56b-45ef-be19-925dff282454 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:39.054295 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362e62d-1458-41a6-b312-6e68ee2e3d8c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:39.054460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-21529c60-b56b-45ef-be19-925dff282454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:39.059893 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e30d9b-e1a5-49a1-9d42-73870c83a875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:39.060620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e30d9b-e1a5-49a1-9d42-73870c83a875 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:39.060946 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e30d9b-e1a5-49a1-9d42-73870c83a875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:39.061220 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e30d9b-e1a5-49a1-9d42-73870c83a875 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:39.062215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e30d9b-e1a5-49a1-9d42-73870c83a875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:39.065089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e30d9b-e1a5-49a1-9d42-73870c83a875 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:39.096115 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1149/2323] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:44:38 2022] POST /identity/v3/users => generated 294 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:39.097727 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e30d9b-e1a5-49a1-9d42-73870c83a875 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:39.110181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e30d9b-e1a5-49a1-9d42-73870c83a875 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:39.117278 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea6bc5-619e-4164-bc91-d6ef2b016dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:39.117970 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea6bc5-619e-4164-bc91-d6ef2b016dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:39.118253 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea6bc5-619e-4164-bc91-d6ef2b016dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:39.119667 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea6bc5-619e-4164-bc91-d6ef2b016dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:39.120420 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea6bc5-619e-4164-bc91-d6ef2b016dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:39.122176 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea6bc5-619e-4164-bc91-d6ef2b016dd1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:39.134903 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1150/2324] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:39 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:39.139014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea6bc5-619e-4164-bc91-d6ef2b016dd1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:39.144453 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21529c60-b56b-45ef-be19-925dff282454 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:39.149667 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea6bc5-619e-4164-bc91-d6ef2b016dd1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:39.156787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc799c-6292-42d1-bc71-18578da0aba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:39.157998 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc799c-6292-42d1-bc71-18578da0aba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:39.157998 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc799c-6292-42d1-bc71-18578da0aba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:39.158411 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc799c-6292-42d1-bc71-18578da0aba8 admin admin] PATH_INFO: `/v3/projects/8e0809c853864790820ebf5ddbb2fb6b/users/41ccca62014f4c978dd4ab5ca4e1d33a/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:39.177540 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc799c-6292-42d1-bc71-18578da0aba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0809c853864790820ebf5ddbb2fb6b, user_id=41ccca62014f4c978dd4ab5ca4e1d33a, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:39.180926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc799c-6292-42d1-bc71-18578da0aba8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:39.206390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1151/2325] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:44:39 2022] PUT /identity/v3/projects/8e0809c853864790820ebf5ddbb2fb6b/users/41ccca62014f4c978dd4ab5ca4e1d33a/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:39.212283 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc799c-6292-42d1-bc71-18578da0aba8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:39.229038 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252b33b-e736-4887-a463-c78e5fbd0625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:39.231559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252b33b-e736-4887-a463-c78e5fbd0625 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:39.231559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252b33b-e736-4887-a463-c78e5fbd0625 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:39.231559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252b33b-e736-4887-a463-c78e5fbd0625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:39.243800 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252b33b-e736-4887-a463-c78e5fbd0625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:39.245442 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252b33b-e736-4887-a463-c78e5fbd0625 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:39.252757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:39.282852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1175/2326] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:44:39.341593 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc799c-6292-42d1-bc71-18578da0aba8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:39.351668 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa668a-abf6-4e71-bfcb-61f9d78ebb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:39.352947 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa668a-abf6-4e71-bfcb-61f9d78ebb2a admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:39.354169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa668a-abf6-4e71-bfcb-61f9d78ebb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:39.354723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa668a-abf6-4e71-bfcb-61f9d78ebb2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:39.358647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa668a-abf6-4e71-bfcb-61f9d78ebb2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:39.358647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa668a-abf6-4e71-bfcb-61f9d78ebb2a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:39.384927 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1152/2327] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:39 2022] GET /identity/v3/roles => generated 1427 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:44:39.389966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252b33b-e736-4887-a463-c78e5fbd0625 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:39.405465 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252b33b-e736-4887-a463-c78e5fbd0625 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:39.416425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755e0f0-feaa-4edf-89f0-8729dd858ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:39.417605 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755e0f0-feaa-4edf-89f0-8729dd858ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:39.418292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755e0f0-feaa-4edf-89f0-8729dd858ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:39.418836 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755e0f0-feaa-4edf-89f0-8729dd858ab1 admin admin] PATH_INFO: `/v3/projects/8e0809c853864790820ebf5ddbb2fb6b/users/41ccca62014f4c978dd4ab5ca4e1d33a/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:39.422333 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755e0f0-feaa-4edf-89f0-8729dd858ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0809c853864790820ebf5ddbb2fb6b, user_id=41ccca62014f4c978dd4ab5ca4e1d33a, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:39.425165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755e0f0-feaa-4edf-89f0-8729dd858ab1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:39.441466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1176/2328] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:44:39 2022] PUT /identity/v3/projects/8e0809c853864790820ebf5ddbb2fb6b/users/41ccca62014f4c978dd4ab5ca4e1d33a/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:40.114963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa668a-abf6-4e71-bfcb-61f9d78ebb2a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:40.121425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a5aa668a-abf6-4e71-bfcb-61f9d78ebb2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:40.151773 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa668a-abf6-4e71-bfcb-61f9d78ebb2a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:40.261814 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:40.298998 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61307d26-48a1-45b9-aa8f-2c49ee88bc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:40.299897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61307d26-48a1-45b9-aa8f-2c49ee88bc54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:40.300258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61307d26-48a1-45b9-aa8f-2c49ee88bc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:40.300624 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61307d26-48a1-45b9-aa8f-2c49ee88bc54 admin admin] PATH_INFO: `/v3/projects/936a59bc658642299dcf147c2edb8a9d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:40.302387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61307d26-48a1-45b9-aa8f-2c49ee88bc54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=936a59bc658642299dcf147c2edb8a9d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:40.307776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61307d26-48a1-45b9-aa8f-2c49ee88bc54 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:40.493775 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-61307d26-48a1-45b9-aa8f-2c49ee88bc54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936a59bc658642299dcf147c2edb8a9d', 'request_id': 'req-61307d26-48a1-45b9-aa8f-2c49ee88bc54'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:40.528933 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-61307d26-48a1-45b9-aa8f-2c49ee88bc54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936a59bc658642299dcf147c2edb8a9d', 'request_id': 'req-61307d26-48a1-45b9-aa8f-2c49ee88bc54'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:40.541888 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-61307d26-48a1-45b9-aa8f-2c49ee88bc54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936a59bc658642299dcf147c2edb8a9d', 'request_id': 'req-61307d26-48a1-45b9-aa8f-2c49ee88bc54'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:40.567145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-61307d26-48a1-45b9-aa8f-2c49ee88bc54 admin admin] The token cache is being invalidate because project 936a59bc658642299dcf147c2edb8a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:40.567501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-61307d26-48a1-45b9-aa8f-2c49ee88bc54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:40.568233 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-61307d26-48a1-45b9-aa8f-2c49ee88bc54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:40.570660 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1153/2329] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:44:40 2022] DELETE /identity/v3/projects/936a59bc658642299dcf147c2edb8a9d => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:40.576482 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6a4a7-c526-468a-9140-e1f23ce13e68 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:40.578419 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6a4a7-c526-468a-9140-e1f23ce13e68 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:40.578908 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6a4a7-c526-468a-9140-e1f23ce13e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:40.624796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b8d6a4a7-c526-468a-9140-e1f23ce13e68 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:40.626760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b8d6a4a7-c526-468a-9140-e1f23ce13e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:40.714201 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1177/2330] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:40.727130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f14b0-8c3f-4316-8ab8-0259d387e7d8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:40.727970 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f14b0-8c3f-4316-8ab8-0259d387e7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:40.728531 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f14b0-8c3f-4316-8ab8-0259d387e7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:40.780026 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6e3f14b0-8c3f-4316-8ab8-0259d387e7d8 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:40.783079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6e3f14b0-8c3f-4316-8ab8-0259d387e7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:40.800933 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1154/2331] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:40.805247 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6a4a7-c526-468a-9140-e1f23ce13e68 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:40.822710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6a4a7-c526-468a-9140-e1f23ce13e68 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:40.830873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaf774-a374-498a-a43d-42e1366dab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:40.831574 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaf774-a374-498a-a43d-42e1366dab4e admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:40.831864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaf774-a374-498a-a43d-42e1366dab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:40.832147 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaf774-a374-498a-a43d-42e1366dab4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:40.833461 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eaf774-a374-498a-a43d-42e1366dab4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:40.833984 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eaf774-a374-498a-a43d-42e1366dab4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:40.837118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eaf774-a374-498a-a43d-42e1366dab4e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:40.866863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1178/2332] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:44:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:40.873020 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f14b0-8c3f-4316-8ab8-0259d387e7d8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:40.888319 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f14b0-8c3f-4316-8ab8-0259d387e7d8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:40.919195 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba29b0-adfc-4770-8423-be404586f10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:40.920402 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba29b0-adfc-4770-8423-be404586f10e admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:40.921146 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba29b0-adfc-4770-8423-be404586f10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:40.922305 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba29b0-adfc-4770-8423-be404586f10e admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:40.926303 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba29b0-adfc-4770-8423-be404586f10e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:40.932158 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba29b0-adfc-4770-8423-be404586f10e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:41.018895 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1155/2333] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:44:40 2022] POST /identity/v3/projects => generated 376 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:41.023699 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaf774-a374-498a-a43d-42e1366dab4e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:41.046702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaf774-a374-498a-a43d-42e1366dab4e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:41.180249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0236f-6756-466e-97f7-f21857c842d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:41.181217 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0236f-6756-466e-97f7-f21857c842d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:41.181672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0236f-6756-466e-97f7-f21857c842d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:41.182126 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0236f-6756-466e-97f7-f21857c842d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:41.183705 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0236f-6756-466e-97f7-f21857c842d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:41.186222 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0236f-6756-466e-97f7-f21857c842d6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:41.232447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1179/2334] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:44:41 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:41.239836 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba29b0-adfc-4770-8423-be404586f10e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:41.254018 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba29b0-adfc-4770-8423-be404586f10e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:41.260612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704309c-fd2a-4975-86a8-c6def5425a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:41.261652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704309c-fd2a-4975-86a8-c6def5425a92 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:41.262164 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704309c-fd2a-4975-86a8-c6def5425a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:41.263380 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704309c-fd2a-4975-86a8-c6def5425a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:41.264460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704309c-fd2a-4975-86a8-c6def5425a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:41.267709 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704309c-fd2a-4975-86a8-c6def5425a92 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:41.286686 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0236f-6756-466e-97f7-f21857c842d6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:41.287441 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1156/2335] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:41 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:41.298930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0236f-6756-466e-97f7-f21857c842d6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:41.305180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d57a4-adb9-48b1-82c0-9e95449faf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:41.306238 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d57a4-adb9-48b1-82c0-9e95449faf21 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:41.306754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d57a4-adb9-48b1-82c0-9e95449faf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:41.307225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d57a4-adb9-48b1-82c0-9e95449faf21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:41.308264 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d57a4-adb9-48b1-82c0-9e95449faf21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:41.311351 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d57a4-adb9-48b1-82c0-9e95449faf21 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:41.330795 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704309c-fd2a-4975-86a8-c6def5425a92 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:41.336990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1180/2336] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:41 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:41.349218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704309c-fd2a-4975-86a8-c6def5425a92 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:41.365082 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8cb8e-bc4e-4766-b7fc-2e478e4d4c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:41.366392 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8cb8e-bc4e-4766-b7fc-2e478e4d4c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:41.379001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8cb8e-bc4e-4766-b7fc-2e478e4d4c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:41.379945 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8cb8e-bc4e-4766-b7fc-2e478e4d4c89 admin admin] PATH_INFO: `/v3/projects/3d7e89a29dec4899880b64e677c1aa78/users/bac9d31eec4849c98b0cf53447e3a03b/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:41.410302 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8cb8e-bc4e-4766-b7fc-2e478e4d4c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7e89a29dec4899880b64e677c1aa78, user_id=bac9d31eec4849c98b0cf53447e3a03b, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:41.413386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8cb8e-bc4e-4766-b7fc-2e478e4d4c89 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:41.438367 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1157/2337] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:44:41 2022] PUT /identity/v3/projects/3d7e89a29dec4899880b64e677c1aa78/users/bac9d31eec4849c98b0cf53447e3a03b/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:41.451200 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a58b21-7c1b-4442-8e28-9ec36e50cc9a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:41.452069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a58b21-7c1b-4442-8e28-9ec36e50cc9a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:41.452069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a58b21-7c1b-4442-8e28-9ec36e50cc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:41.497393 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-00a58b21-7c1b-4442-8e28-9ec36e50cc9a None None] MFA Rules not processed for user `bac9d31eec4849c98b0cf53447e3a03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:41.498688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-00a58b21-7c1b-4442-8e28-9ec36e50cc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:41.575723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:41.629524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1181/2338] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:41.643222 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8cb8e-bc4e-4766-b7fc-2e478e4d4c89 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:41.645640 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-89e8cb8e-bc4e-4766-b7fc-2e478e4d4c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:41.757287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8cb8e-bc4e-4766-b7fc-2e478e4d4c89 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:41.781823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89053dd1-649e-4dd6-97d4-8e7f85c445a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:41.782991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89053dd1-649e-4dd6-97d4-8e7f85c445a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:41.782991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89053dd1-649e-4dd6-97d4-8e7f85c445a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:41.782991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89053dd1-649e-4dd6-97d4-8e7f85c445a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:41.833850 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89053dd1-649e-4dd6-97d4-8e7f85c445a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:41.839751 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89053dd1-649e-4dd6-97d4-8e7f85c445a2 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:41.862607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1158/2339] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:46.060869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a58b21-7c1b-4442-8e28-9ec36e50cc9a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:46.194619 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a58b21-7c1b-4442-8e28-9ec36e50cc9a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:46.199958 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e96d9-ea90-43df-9e3b-6008ebe106ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:46.201173 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e96d9-ea90-43df-9e3b-6008ebe106ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:46.202506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e96d9-ea90-43df-9e3b-6008ebe106ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:46.203209 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e96d9-ea90-43df-9e3b-6008ebe106ae admin admin] PATH_INFO: `/v3/users/bac9d31eec4849c98b0cf53447e3a03b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:46.205624 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e96d9-ea90-43df-9e3b-6008ebe106ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=bac9d31eec4849c98b0cf53447e3a03b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:46.207875 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e96d9-ea90-43df-9e3b-6008ebe106ae admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:46.279563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3e8e96d9-ea90-43df-9e3b-6008ebe106ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bac9d31eec4849c98b0cf53447e3a03b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:46.299595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3e8e96d9-ea90-43df-9e3b-6008ebe106ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bac9d31eec4849c98b0cf53447e3a03b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:46.300516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3e8e96d9-ea90-43df-9e3b-6008ebe106ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bac9d31eec4849c98b0cf53447e3a03b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:46.311723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3e8e96d9-ea90-43df-9e3b-6008ebe106ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bac9d31eec4849c98b0cf53447e3a03b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:46.312875 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3e8e96d9-ea90-43df-9e3b-6008ebe106ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bac9d31eec4849c98b0cf53447e3a03b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:46.335333 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1182/2340] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:44:46 2022] DELETE /identity/v3/users/bac9d31eec4849c98b0cf53447e3a03b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:46.342292 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d69e2-812d-445d-b2c3-6d1b2b6dfbf0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:46.343947 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d69e2-812d-445d-b2c3-6d1b2b6dfbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:46.344645 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d69e2-812d-445d-b2c3-6d1b2b6dfbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:46.379932 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e48d69e2-812d-445d-b2c3-6d1b2b6dfbf0 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:46.382805 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e48d69e2-812d-445d-b2c3-6d1b2b6dfbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:46.394222 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:46.552365 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1159/2341] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:46.572564 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e96d9-ea90-43df-9e3b-6008ebe106ae admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:46.574477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3e8e96d9-ea90-43df-9e3b-6008ebe106ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:46.730940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e96d9-ea90-43df-9e3b-6008ebe106ae admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:46.739986 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e019a8-a4cc-4992-8af0-3ad2bd011784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:46.740776 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e019a8-a4cc-4992-8af0-3ad2bd011784 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:46.741219 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e019a8-a4cc-4992-8af0-3ad2bd011784 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:46.741643 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e019a8-a4cc-4992-8af0-3ad2bd011784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:46.761909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e019a8-a4cc-4992-8af0-3ad2bd011784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:46.764017 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e019a8-a4cc-4992-8af0-3ad2bd011784 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:46.770371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:46.781853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1183/2342] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:47.653768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d69e2-812d-445d-b2c3-6d1b2b6dfbf0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:47.656083 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e48d69e2-812d-445d-b2c3-6d1b2b6dfbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:47.685961 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d69e2-812d-445d-b2c3-6d1b2b6dfbf0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:47.692390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d527b1-ed6b-4504-98b7-bb5703ecc011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:47.693203 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d527b1-ed6b-4504-98b7-bb5703ecc011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:47.693467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d527b1-ed6b-4504-98b7-bb5703ecc011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:47.693821 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d527b1-ed6b-4504-98b7-bb5703ecc011 admin admin] PATH_INFO: `/v3/projects/3d7e89a29dec4899880b64e677c1aa78` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:47.695189 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d527b1-ed6b-4504-98b7-bb5703ecc011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7e89a29dec4899880b64e677c1aa78)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:47.704890 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d527b1-ed6b-4504-98b7-bb5703ecc011 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:47.874146 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-50d527b1-ed6b-4504-98b7-bb5703ecc011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7e89a29dec4899880b64e677c1aa78', 'request_id': 'req-50d527b1-ed6b-4504-98b7-bb5703ecc011'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:47.889847 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-50d527b1-ed6b-4504-98b7-bb5703ecc011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7e89a29dec4899880b64e677c1aa78', 'request_id': 'req-50d527b1-ed6b-4504-98b7-bb5703ecc011'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:47.907361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-50d527b1-ed6b-4504-98b7-bb5703ecc011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7e89a29dec4899880b64e677c1aa78', 'request_id': 'req-50d527b1-ed6b-4504-98b7-bb5703ecc011'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:47.938603 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-50d527b1-ed6b-4504-98b7-bb5703ecc011 admin admin] The token cache is being invalidate because project 3d7e89a29dec4899880b64e677c1aa78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:47.939089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-50d527b1-ed6b-4504-98b7-bb5703ecc011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:47.939906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-50d527b1-ed6b-4504-98b7-bb5703ecc011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:47.943054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1160/2343] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:44:47 2022] DELETE /identity/v3/projects/3d7e89a29dec4899880b64e677c1aa78 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:47.950381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a44d44-f79b-44c1-b1ab-9036346a6ba2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:47.952591 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a44d44-f79b-44c1-b1ab-9036346a6ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:47.953621 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a44d44-f79b-44c1-b1ab-9036346a6ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:48.025559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-70a44d44-f79b-44c1-b1ab-9036346a6ba2 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:48.028608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-70a44d44-f79b-44c1-b1ab-9036346a6ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:48.262039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1184/2344] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:48.272212 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3079f-9992-4dab-a4f8-945e3c0d2b3d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:48.272501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3079f-9992-4dab-a4f8-945e3c0d2b3d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:48.272783 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3079f-9992-4dab-a4f8-945e3c0d2b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:48.305971 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-edf3079f-9992-4dab-a4f8-945e3c0d2b3d None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:48.307893 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-edf3079f-9992-4dab-a4f8-945e3c0d2b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:48.324646 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1161/2345] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:48.327561 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a44d44-f79b-44c1-b1ab-9036346a6ba2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:48.389360 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a44d44-f79b-44c1-b1ab-9036346a6ba2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:48.397976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49eaf9-3872-4d8b-88f1-97920a17319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:48.399436 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49eaf9-3872-4d8b-88f1-97920a17319f admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:48.399954 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49eaf9-3872-4d8b-88f1-97920a17319f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:48.400479 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49eaf9-3872-4d8b-88f1-97920a17319f admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:48.402174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49eaf9-3872-4d8b-88f1-97920a17319f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:48.402854 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49eaf9-3872-4d8b-88f1-97920a17319f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:48.406750 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49eaf9-3872-4d8b-88f1-97920a17319f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:48.438524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1185/2346] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:44:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:48.440113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3079f-9992-4dab-a4f8-945e3c0d2b3d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:48.469838 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3079f-9992-4dab-a4f8-945e3c0d2b3d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:48.476681 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c52de5-3a78-4ccb-b783-0e97d1964e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:48.477389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c52de5-3a78-4ccb-b783-0e97d1964e3a admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:48.477890 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c52de5-3a78-4ccb-b783-0e97d1964e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:48.478859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c52de5-3a78-4ccb-b783-0e97d1964e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:48.479627 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c52de5-3a78-4ccb-b783-0e97d1964e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:48.481693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c52de5-3a78-4ccb-b783-0e97d1964e3a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:48.550174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1162/2347] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:44:48 2022] POST /identity/v3/projects => generated 386 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:48.554675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49eaf9-3872-4d8b-88f1-97920a17319f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:48.568884 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49eaf9-3872-4d8b-88f1-97920a17319f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:48.710766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa13a14-7f84-489d-985b-58ec2b20361c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:48.722480 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa13a14-7f84-489d-985b-58ec2b20361c admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:48.723289 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa13a14-7f84-489d-985b-58ec2b20361c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:48.723946 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa13a14-7f84-489d-985b-58ec2b20361c admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:48.725159 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa13a14-7f84-489d-985b-58ec2b20361c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:48.728449 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa13a14-7f84-489d-985b-58ec2b20361c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:48.769867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1186/2348] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:44:48 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:48.776299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c52de5-3a78-4ccb-b783-0e97d1964e3a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:48.801303 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c52de5-3a78-4ccb-b783-0e97d1964e3a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:48.812329 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab841b-7e08-4e93-9387-96e1fe615495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:48.813644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab841b-7e08-4e93-9387-96e1fe615495 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:48.814315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab841b-7e08-4e93-9387-96e1fe615495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:48.814903 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab841b-7e08-4e93-9387-96e1fe615495 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:48.817487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab841b-7e08-4e93-9387-96e1fe615495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:48.819846 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab841b-7e08-4e93-9387-96e1fe615495 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:48.850125 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa13a14-7f84-489d-985b-58ec2b20361c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:48.861156 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1163/2349] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:48 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:48.874952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa13a14-7f84-489d-985b-58ec2b20361c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:48.883770 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd34cde-f8f8-4e9e-861e-7ded4b05bec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:48.884697 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd34cde-f8f8-4e9e-861e-7ded4b05bec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:48.885586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd34cde-f8f8-4e9e-861e-7ded4b05bec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:48.885586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd34cde-f8f8-4e9e-861e-7ded4b05bec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:48.887306 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd34cde-f8f8-4e9e-861e-7ded4b05bec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:48.894500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd34cde-f8f8-4e9e-861e-7ded4b05bec0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:48.914702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1187/2350] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:44:48 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:48.920726 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab841b-7e08-4e93-9387-96e1fe615495 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:48.951177 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab841b-7e08-4e93-9387-96e1fe615495 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:48.977868 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ba6d3-c8c7-4323-a176-2980c80507dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:48.981886 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ba6d3-c8c7-4323-a176-2980c80507dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:48.983062 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ba6d3-c8c7-4323-a176-2980c80507dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:48.983490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ba6d3-c8c7-4323-a176-2980c80507dc admin admin] PATH_INFO: `/v3/projects/4148d58fe39e4e07b7bc5fcbfebe146d/users/a5413c5a7c704500a628940d04ca40a8/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:49.010192 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ba6d3-c8c7-4323-a176-2980c80507dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4148d58fe39e4e07b7bc5fcbfebe146d, user_id=a5413c5a7c704500a628940d04ca40a8, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:49.013133 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ba6d3-c8c7-4323-a176-2980c80507dc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:49.044455 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1164/2351] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:44:48 2022] PUT /identity/v3/projects/4148d58fe39e4e07b7bc5fcbfebe146d/users/a5413c5a7c704500a628940d04ca40a8/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:49.051873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfab0ca-9cf3-4ebd-88a9-3732ed57c137 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:49.053050 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfab0ca-9cf3-4ebd-88a9-3732ed57c137 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:49.053649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfab0ca-9cf3-4ebd-88a9-3732ed57c137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:49.114306 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0bfab0ca-9cf3-4ebd-88a9-3732ed57c137 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:49.116767 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0bfab0ca-9cf3-4ebd-88a9-3732ed57c137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:49.328026 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1188/2352] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:49.347286 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ba6d3-c8c7-4323-a176-2980c80507dc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:49.350050 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d79ba6d3-c8c7-4323-a176-2980c80507dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:49.486218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:49.539969 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ba6d3-c8c7-4323-a176-2980c80507dc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:49.544750 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8a927-c51d-4ceb-b946-d73f97a98675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:49.546437 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8a927-c51d-4ceb-b946-d73f97a98675 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:49.547047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8a927-c51d-4ceb-b946-d73f97a98675 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:49.547546 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8a927-c51d-4ceb-b946-d73f97a98675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:49.580671 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8a927-c51d-4ceb-b946-d73f97a98675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:49.583693 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8a927-c51d-4ceb-b946-d73f97a98675 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:49.621518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1165/2353] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:50.292821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc863a-e82a-4a01-b98d-2ebe1f1f7d3f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:50.293684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc863a-e82a-4a01-b98d-2ebe1f1f7d3f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:50.293857 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc863a-e82a-4a01-b98d-2ebe1f1f7d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:50.304494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:50.369106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0fdc863a-e82a-4a01-b98d-2ebe1f1f7d3f None None] MFA Rules not processed for user `ebf3257328b94092b544cb0dadb789c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:50.370674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0fdc863a-e82a-4a01-b98d-2ebe1f1f7d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:50.502087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1189/2354] 10.222.0.110 () {58 vars in 1014 bytes} [Thu May 26 16:44:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:50.667633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8a927-c51d-4ceb-b946-d73f97a98675 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:50.670352 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-23b8a927-c51d-4ceb-b946-d73f97a98675 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:50.753908 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5401912-bb9b-4970-88f1-8b35e409452f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:50.754362 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5401912-bb9b-4970-88f1-8b35e409452f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:50.755278 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5401912-bb9b-4970-88f1-8b35e409452f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:50.856413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a5401912-bb9b-4970-88f1-8b35e409452f None None] MFA Rules not processed for user `41ccca62014f4c978dd4ab5ca4e1d33a`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:50.861100 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8a927-c51d-4ceb-b946-d73f97a98675 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:50.861811 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a5401912-bb9b-4970-88f1-8b35e409452f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:50.868444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558210d-0ddb-457c-9a9c-03d2f2b32b13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4502c57e324c31a8bce12770a92371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:50.868809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558210d-0ddb-457c-9a9c-03d2f2b32b13 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:50.869294 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558210d-0ddb-457c-9a9c-03d2f2b32b13 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:50.869631 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558210d-0ddb-457c-9a9c-03d2f2b32b13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:50.881008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558210d-0ddb-457c-9a9c-03d2f2b32b13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:50.882887 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558210d-0ddb-457c-9a9c-03d2f2b32b13 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:50.908108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1166/2355] 10.222.0.110 () {60 vars in 1389 bytes} [Thu May 26 16:44:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:44:51.121897 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1190/2356] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:51.133433 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558210d-0ddb-457c-9a9c-03d2f2b32b13 service swift] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:51.135159 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e558210d-0ddb-457c-9a9c-03d2f2b32b13 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:51.458087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558210d-0ddb-457c-9a9c-03d2f2b32b13 service swift] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:51.481781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb564f0-778d-475d-aaa3-9db2fd1c675b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:51.482868 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb564f0-778d-475d-aaa3-9db2fd1c675b service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:51.483359 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb564f0-778d-475d-aaa3-9db2fd1c675b service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:51.483831 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb564f0-778d-475d-aaa3-9db2fd1c675b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:51.486144 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1bb564f0-778d-475d-aaa3-9db2fd1c675b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:51.586838 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:51.635229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb564f0-778d-475d-aaa3-9db2fd1c675b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:51.640026 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb564f0-778d-475d-aaa3-9db2fd1c675b service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:51.706612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1167/2357] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:44:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:44:54.927749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45b6e7-abc2-4f40-be2c-f69dba09628e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:54.928658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45b6e7-abc2-4f40-be2c-f69dba09628e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:54.928658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45b6e7-abc2-4f40-be2c-f69dba09628e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:54.968866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7e45b6e7-abc2-4f40-be2c-f69dba09628e None None] MFA Rules not processed for user `bdd6bcaef051419b93f1623d3eccac84`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:54.972239 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7e45b6e7-abc2-4f40-be2c-f69dba09628e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:54.998658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1191/2358] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:44:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:01.671817 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=9 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:02.733436 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d485e6b-17b6-441a-98d7-9963f7868e5c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:02.734421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d485e6b-17b6-441a-98d7-9963f7868e5c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:02.734780 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d485e6b-17b6-441a-98d7-9963f7868e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:02.789009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9d485e6b-17b6-441a-98d7-9963f7868e5c None None] MFA Rules not processed for user `a5413c5a7c704500a628940d04ca40a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:02.793236 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9d485e6b-17b6-441a-98d7-9963f7868e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:02.969144 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1168/2359] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:45:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:02.982441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45b6e7-abc2-4f40-be2c-f69dba09628e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:03.000941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45b6e7-abc2-4f40-be2c-f69dba09628e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:03.011615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d279c04-c78b-468c-9bf7-1d9d1182d53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:03.017769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d279c04-c78b-468c-9bf7-1d9d1182d53e admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:03.029493 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d279c04-c78b-468c-9bf7-1d9d1182d53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:03.030348 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d279c04-c78b-468c-9bf7-1d9d1182d53e admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:03.031829 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d279c04-c78b-468c-9bf7-1d9d1182d53e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:03.041462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d279c04-c78b-468c-9bf7-1d9d1182d53e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:03.111231 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d485e6b-17b6-441a-98d7-9963f7868e5c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:03.111583 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1192/2360] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:45:02 2022] POST /identity/v3/projects => generated 386 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:45:03.136681 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d485e6b-17b6-441a-98d7-9963f7868e5c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:03.249904 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66742e-7608-498f-85df-8251332437bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:03.251121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66742e-7608-498f-85df-8251332437bb admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:03.251625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66742e-7608-498f-85df-8251332437bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:03.252103 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66742e-7608-498f-85df-8251332437bb admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:03.252992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66742e-7608-498f-85df-8251332437bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:03.255868 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66742e-7608-498f-85df-8251332437bb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:03.307124 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1169/2361] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:45:03 2022] POST /identity/v3/users => generated 300 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:45:03.320280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d279c04-c78b-468c-9bf7-1d9d1182d53e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:03.355050 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d279c04-c78b-468c-9bf7-1d9d1182d53e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:03.372453 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb08199-e68c-4425-80c4-eafd65b9db2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:03.373416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb08199-e68c-4425-80c4-eafd65b9db2b admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:03.375904 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb08199-e68c-4425-80c4-eafd65b9db2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:03.376420 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb08199-e68c-4425-80c4-eafd65b9db2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:03.379437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb08199-e68c-4425-80c4-eafd65b9db2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:03.383967 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb08199-e68c-4425-80c4-eafd65b9db2b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:03.420019 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1193/2362] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:45:03 2022] GET /identity/v3/roles => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:45:03.423949 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66742e-7608-498f-85df-8251332437bb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:03.443318 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66742e-7608-498f-85df-8251332437bb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:03.453878 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418a382-7673-4069-86b2-bb03be7d9ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:03.455302 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418a382-7673-4069-86b2-bb03be7d9ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:03.455834 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418a382-7673-4069-86b2-bb03be7d9ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:03.456351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418a382-7673-4069-86b2-bb03be7d9ccb admin admin] PATH_INFO: `/v3/projects/967495223327427fa677a316e1ba8ee0/users/abe192ac55ca4ed194eb7f5a0ea98883/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:03.477847 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418a382-7673-4069-86b2-bb03be7d9ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=967495223327427fa677a316e1ba8ee0, user_id=abe192ac55ca4ed194eb7f5a0ea98883, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:03.481945 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418a382-7673-4069-86b2-bb03be7d9ccb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:03.525247 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1170/2363] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:45:03 2022] PUT /identity/v3/projects/967495223327427fa677a316e1ba8ee0/users/abe192ac55ca4ed194eb7f5a0ea98883/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:45:03.531641 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb08199-e68c-4425-80c4-eafd65b9db2b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:03.556807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb08199-e68c-4425-80c4-eafd65b9db2b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:03.657984 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:03.724426 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3d8b6-572f-451f-bbb2-9867e11799c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:03.725747 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3d8b6-572f-451f-bbb2-9867e11799c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:03.726310 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3d8b6-572f-451f-bbb2-9867e11799c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:03.727084 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3d8b6-572f-451f-bbb2-9867e11799c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:03.728330 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3d8b6-572f-451f-bbb2-9867e11799c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:03.730441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3d8b6-572f-451f-bbb2-9867e11799c6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:03.748941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1194/2364] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:45:03 2022] GET /identity/v3/roles => generated 1427 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:45:03.750842 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418a382-7673-4069-86b2-bb03be7d9ccb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:03.764587 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418a382-7673-4069-86b2-bb03be7d9ccb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:03.771754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa11cf-3c43-46aa-981c-847147e59e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:03.772966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa11cf-3c43-46aa-981c-847147e59e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:03.773521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa11cf-3c43-46aa-981c-847147e59e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:03.773833 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa11cf-3c43-46aa-981c-847147e59e04 admin admin] PATH_INFO: `/v3/projects/967495223327427fa677a316e1ba8ee0/users/abe192ac55ca4ed194eb7f5a0ea98883/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:03.784984 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa11cf-3c43-46aa-981c-847147e59e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=967495223327427fa677a316e1ba8ee0, user_id=abe192ac55ca4ed194eb7f5a0ea98883, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:03.799866 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa11cf-3c43-46aa-981c-847147e59e04 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:03.816512 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1171/2365] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:45:03 2022] PUT /identity/v3/projects/967495223327427fa677a316e1ba8ee0/users/abe192ac55ca4ed194eb7f5a0ea98883/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:45:11.612718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5d61b-1829-4cb5-85d6-aec20c31a0bf None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:11.612718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5d61b-1829-4cb5-85d6-aec20c31a0bf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:11.612718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5d61b-1829-4cb5-85d6-aec20c31a0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:11.739734 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a1c5d61b-1829-4cb5-85d6-aec20c31a0bf None None] MFA Rules not processed for user `ebf3257328b94092b544cb0dadb789c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:11.742857 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a1c5d61b-1829-4cb5-85d6-aec20c31a0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:12.036132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1195/2366] 10.222.0.110 () {58 vars in 1014 bytes} [Thu May 26 16:45:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:12.059944 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa11cf-3c43-46aa-981c-847147e59e04 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:12.204792 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:12.369763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa11cf-3c43-46aa-981c-847147e59e04 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:12.395989 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ded122-9ec4-4240-8ea1-e0eea367b1e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4502c57e324c31a8bce12770a92371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:12.396955 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ded122-9ec4-4240-8ea1-e0eea367b1e9 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:12.397347 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ded122-9ec4-4240-8ea1-e0eea367b1e9 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:12.397508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ded122-9ec4-4240-8ea1-e0eea367b1e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:12.428135 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ded122-9ec4-4240-8ea1-e0eea367b1e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:12.429784 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ded122-9ec4-4240-8ea1-e0eea367b1e9 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:12.470648 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1172/2367] 10.222.0.110 () {60 vars in 1389 bytes} [Thu May 26 16:45:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:45:14.113196 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe1647-c923-4650-ac8f-b04a3ed28412 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:14.114428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe1647-c923-4650-ac8f-b04a3ed28412 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:14.115138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe1647-c923-4650-ac8f-b04a3ed28412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:14.152919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-cfbe1647-c923-4650-ac8f-b04a3ed28412 None None] MFA Rules not processed for user `ebf3257328b94092b544cb0dadb789c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:14.155474 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cfbe1647-c923-4650-ac8f-b04a3ed28412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:14.171309 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1196/2368] 10.222.0.110 () {58 vars in 972 bytes} [Thu May 26 16:45:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:14.205748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ded122-9ec4-4240-8ea1-e0eea367b1e9 service swift] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:14.221843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ded122-9ec4-4240-8ea1-e0eea367b1e9 service swift] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:14.238436 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7adf91-9db7-41f1-af8b-407017555ba8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4502c57e324c31a8bce12770a92371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:14.239393 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7adf91-9db7-41f1-af8b-407017555ba8 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:14.239885 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7adf91-9db7-41f1-af8b-407017555ba8 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:14.240334 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7adf91-9db7-41f1-af8b-407017555ba8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:14.257130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7adf91-9db7-41f1-af8b-407017555ba8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:14.259036 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7adf91-9db7-41f1-af8b-407017555ba8 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:14.271154 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1173/2369] 10.222.0.110 () {60 vars in 1389 bytes} [Thu May 26 16:45:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:45:14.353147 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763cacf-3849-44c9-a64e-2e7d5d65a457 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:14.353651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763cacf-3849-44c9-a64e-2e7d5d65a457 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:14.354263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763cacf-3849-44c9-a64e-2e7d5d65a457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:14.427659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2763cacf-3849-44c9-a64e-2e7d5d65a457 None None] MFA Rules not processed for user `abe192ac55ca4ed194eb7f5a0ea98883`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:14.440031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2763cacf-3849-44c9-a64e-2e7d5d65a457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:14.623805 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1197/2370] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:45:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:45:14.689743 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7adf91-9db7-41f1-af8b-407017555ba8 service swift] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:14.692832 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1c7adf91-9db7-41f1-af8b-407017555ba8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:14.851042 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7adf91-9db7-41f1-af8b-407017555ba8 service swift] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:14.858516 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160705a-870d-4a18-84f3-1927c5d4a561 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '363d16eebb3f40a1be71506961cc3c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:14.859661 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160705a-870d-4a18-84f3-1927c5d4a561 service glance] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:14.860192 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160705a-870d-4a18-84f3-1927c5d4a561 service glance] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:14.860677 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160705a-870d-4a18-84f3-1927c5d4a561 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:14.968771 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160705a-870d-4a18-84f3-1927c5d4a561 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:14.971319 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160705a-870d-4a18-84f3-1927c5d4a561 service glance] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:14.987919 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1174/2371] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:45:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:15.134477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00ec90-5140-4c41-bf61-ecad2152b28b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:15.135699 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00ec90-5140-4c41-bf61-ecad2152b28b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:15.135990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00ec90-5140-4c41-bf61-ecad2152b28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:15.166647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fa00ec90-5140-4c41-bf61-ecad2152b28b None None] MFA Rules not processed for user `ebf3257328b94092b544cb0dadb789c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:15.168135 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fa00ec90-5140-4c41-bf61-ecad2152b28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:15.175504 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36c0c5-fb7a-45e5-b757-4274b1b93311 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:15.176262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36c0c5-fb7a-45e5-b757-4274b1b93311 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:15.176924 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36c0c5-fb7a-45e5-b757-4274b1b93311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:15.177477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1198/2372] 10.222.0.110 () {58 vars in 1014 bytes} [Thu May 26 16:45:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:15.206084 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00ec90-5140-4c41-bf61-ecad2152b28b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:15.213235 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-be36c0c5-fb7a-45e5-b757-4274b1b93311 None None] MFA Rules not processed for user `ebf3257328b94092b544cb0dadb789c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:15.215934 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-be36c0c5-fb7a-45e5-b757-4274b1b93311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:15.230050 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00ec90-5140-4c41-bf61-ecad2152b28b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:15.233066 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1175/2373] 10.222.0.110 () {58 vars in 1014 bytes} [Thu May 26 16:45:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:15.251496 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b679e2-48b0-45c8-9de9-61ea74e74ada service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4502c57e324c31a8bce12770a92371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:15.252846 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b679e2-48b0-45c8-9de9-61ea74e74ada service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:15.253482 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b679e2-48b0-45c8-9de9-61ea74e74ada service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:15.254199 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b679e2-48b0-45c8-9de9-61ea74e74ada service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:15.259274 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36c0c5-fb7a-45e5-b757-4274b1b93311 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:15.279610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b679e2-48b0-45c8-9de9-61ea74e74ada service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:15.281542 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b679e2-48b0-45c8-9de9-61ea74e74ada service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:15.291745 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1199/2374] 10.222.0.110 () {60 vars in 1389 bytes} [Thu May 26 16:45:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:45:15.298033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36c0c5-fb7a-45e5-b757-4274b1b93311 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:15.315537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a5904-3745-40d7-9ea9-03167c66ab1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4502c57e324c31a8bce12770a92371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:15.316350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a5904-3745-40d7-9ea9-03167c66ab1d service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:15.316926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a5904-3745-40d7-9ea9-03167c66ab1d service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:15.317552 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a5904-3745-40d7-9ea9-03167c66ab1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:15.334961 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a5904-3745-40d7-9ea9-03167c66ab1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:15.336749 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a5904-3745-40d7-9ea9-03167c66ab1d service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:15.347101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1176/2375] 10.222.0.110 () {60 vars in 1389 bytes} [Thu May 26 16:45:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:45:16.031526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b8e36-2bde-4af8-9ff5-9e7180733928 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:16.032069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b8e36-2bde-4af8-9ff5-9e7180733928 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:16.032572 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b8e36-2bde-4af8-9ff5-9e7180733928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:16.051694 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:16.066485 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-af6b8e36-2bde-4af8-9ff5-9e7180733928 None None] MFA Rules not processed for user `ebf3257328b94092b544cb0dadb789c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:16.068405 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-af6b8e36-2bde-4af8-9ff5-9e7180733928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:16.103853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1200/2376] 10.222.0.110 () {58 vars in 972 bytes} [Thu May 26 16:45:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:16.122905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a5904-3745-40d7-9ea9-03167c66ab1d service swift] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:16.144839 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a5904-3745-40d7-9ea9-03167c66ab1d service swift] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:16.150586 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7221e4e-7c93-4061-96a1-8b666b5ba710 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4502c57e324c31a8bce12770a92371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:16.151439 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7221e4e-7c93-4061-96a1-8b666b5ba710 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:16.151778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7221e4e-7c93-4061-96a1-8b666b5ba710 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:16.152064 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7221e4e-7c93-4061-96a1-8b666b5ba710 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:16.164420 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7221e4e-7c93-4061-96a1-8b666b5ba710 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:16.167983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7221e4e-7c93-4061-96a1-8b666b5ba710 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:16.184318 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1177/2377] 10.222.0.110 () {60 vars in 1389 bytes} [Thu May 26 16:45:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 16:45:19.988273 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b8e36-2bde-4af8-9ff5-9e7180733928 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:19.989837 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-af6b8e36-2bde-4af8-9ff5-9e7180733928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:20.302423 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b8e36-2bde-4af8-9ff5-9e7180733928 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:20.320498 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dc5c2-053e-4605-aa5d-97f1224774e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:20.321848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dc5c2-053e-4605-aa5d-97f1224774e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:20.322228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dc5c2-053e-4605-aa5d-97f1224774e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:20.322745 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dc5c2-053e-4605-aa5d-97f1224774e5 admin admin] PATH_INFO: `/v3/users/6adf392eccd0443e814f52fc0be827cc` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:20.324919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926dc5c2-053e-4605-aa5d-97f1224774e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6adf392eccd0443e814f52fc0be827cc)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:20.327718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926dc5c2-053e-4605-aa5d-97f1224774e5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:20.430354 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-926dc5c2-053e-4605-aa5d-97f1224774e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6adf392eccd0443e814f52fc0be827cc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:20.495718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-926dc5c2-053e-4605-aa5d-97f1224774e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6adf392eccd0443e814f52fc0be827cc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:20.497547 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-926dc5c2-053e-4605-aa5d-97f1224774e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6adf392eccd0443e814f52fc0be827cc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:20.518661 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-926dc5c2-053e-4605-aa5d-97f1224774e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6adf392eccd0443e814f52fc0be827cc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:20.520366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-926dc5c2-053e-4605-aa5d-97f1224774e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6adf392eccd0443e814f52fc0be827cc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:20.568653 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1201/2378] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:45:19 2022] DELETE /identity/v3/users/6adf392eccd0443e814f52fc0be827cc => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:45:20.570383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732dfc7-1ce7-4f7e-9094-7dcf1ec3278a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:20.570912 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732dfc7-1ce7-4f7e-9094-7dcf1ec3278a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:20.571254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732dfc7-1ce7-4f7e-9094-7dcf1ec3278a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:20.606820 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e732dfc7-1ce7-4f7e-9094-7dcf1ec3278a None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:20.608595 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e732dfc7-1ce7-4f7e-9094-7dcf1ec3278a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:20.614648 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:20.713260 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1178/2379] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:20.723350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dc5c2-053e-4605-aa5d-97f1224774e5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:20.725617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-926dc5c2-053e-4605-aa5d-97f1224774e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:20.817848 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dc5c2-053e-4605-aa5d-97f1224774e5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:20.827912 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a660dc0-5df5-43c9-b746-b523a0a22efc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:20.828765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a660dc0-5df5-43c9-b746-b523a0a22efc service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:20.829184 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a660dc0-5df5-43c9-b746-b523a0a22efc service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:20.829623 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a660dc0-5df5-43c9-b746-b523a0a22efc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:20.842807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a660dc0-5df5-43c9-b746-b523a0a22efc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:20.846868 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a660dc0-5df5-43c9-b746-b523a0a22efc service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:20.879118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1202/2380] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:45:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:21.223180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732dfc7-1ce7-4f7e-9094-7dcf1ec3278a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:21.225406 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e732dfc7-1ce7-4f7e-9094-7dcf1ec3278a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:21.256537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732dfc7-1ce7-4f7e-9094-7dcf1ec3278a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:21.306314 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ffe4d-37c1-498f-a903-458b8e6dc2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:21.325312 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ffe4d-37c1-498f-a903-458b8e6dc2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:21.325605 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ffe4d-37c1-498f-a903-458b8e6dc2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:21.325887 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ffe4d-37c1-498f-a903-458b8e6dc2f7 admin admin] PATH_INFO: `/v3/projects/f1feb64c908840da849faa5ec9dee973` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:21.334431 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ffe4d-37c1-498f-a903-458b8e6dc2f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1feb64c908840da849faa5ec9dee973)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:21.338165 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ffe4d-37c1-498f-a903-458b8e6dc2f7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:21.515704 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f80ffe4d-37c1-498f-a903-458b8e6dc2f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1feb64c908840da849faa5ec9dee973', 'request_id': 'req-f80ffe4d-37c1-498f-a903-458b8e6dc2f7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:21.542895 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f80ffe4d-37c1-498f-a903-458b8e6dc2f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1feb64c908840da849faa5ec9dee973', 'request_id': 'req-f80ffe4d-37c1-498f-a903-458b8e6dc2f7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:21.561631 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f80ffe4d-37c1-498f-a903-458b8e6dc2f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1feb64c908840da849faa5ec9dee973', 'request_id': 'req-f80ffe4d-37c1-498f-a903-458b8e6dc2f7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:21.611637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f80ffe4d-37c1-498f-a903-458b8e6dc2f7 admin admin] The token cache is being invalidate because project f1feb64c908840da849faa5ec9dee973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:45:21.613268 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f80ffe4d-37c1-498f-a903-458b8e6dc2f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:21.617795 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f80ffe4d-37c1-498f-a903-458b8e6dc2f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:21.621300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1179/2381] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:45:21 2022] DELETE /identity/v3/projects/f1feb64c908840da849faa5ec9dee973 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:45:21.633260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce3133-05eb-4d78-b772-89c666982726 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:21.634134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce3133-05eb-4d78-b772-89c666982726 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:21.634134 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce3133-05eb-4d78-b772-89c666982726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:21.665749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0bce3133-05eb-4d78-b772-89c666982726 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:21.667808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0bce3133-05eb-4d78-b772-89c666982726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:21.728074 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:21.863269 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a847f3-c974-40e7-b8f9-aba2273118b4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:21.864184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a847f3-c974-40e7-b8f9-aba2273118b4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:21.864331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a847f3-c974-40e7-b8f9-aba2273118b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:21.871185 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1203/2382] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:21.917156 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-32a847f3-c974-40e7-b8f9-aba2273118b4 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:21.918895 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-32a847f3-c974-40e7-b8f9-aba2273118b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:21.955325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1180/2383] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:21.961641 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce3133-05eb-4d78-b772-89c666982726 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:21.997834 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce3133-05eb-4d78-b772-89c666982726 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:22.023435 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb630da9-3fe5-4954-bd0e-d49998d59c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:22.024876 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb630da9-3fe5-4954-bd0e-d49998d59c0a admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:22.025965 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb630da9-3fe5-4954-bd0e-d49998d59c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:22.028080 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb630da9-3fe5-4954-bd0e-d49998d59c0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:22.033200 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb630da9-3fe5-4954-bd0e-d49998d59c0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:45:22.033871 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb630da9-3fe5-4954-bd0e-d49998d59c0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:22.039987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb630da9-3fe5-4954-bd0e-d49998d59c0a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:22.077972 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1204/2384] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:45:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:45:22.078737 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a847f3-c974-40e7-b8f9-aba2273118b4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:22.132982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a847f3-c974-40e7-b8f9-aba2273118b4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:22.146767 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a23ac9-f5b1-4caf-a13d-ad6a2cf9c19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:22.166642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a23ac9-f5b1-4caf-a13d-ad6a2cf9c19b admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:22.167523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a23ac9-f5b1-4caf-a13d-ad6a2cf9c19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:22.168275 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a23ac9-f5b1-4caf-a13d-ad6a2cf9c19b admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:22.169826 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a23ac9-f5b1-4caf-a13d-ad6a2cf9c19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:22.173935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a23ac9-f5b1-4caf-a13d-ad6a2cf9c19b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:22.254114 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1181/2385] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:45:22 2022] POST /identity/v3/projects => generated 400 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:45:22.264751 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb630da9-3fe5-4954-bd0e-d49998d59c0a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:22.285720 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb630da9-3fe5-4954-bd0e-d49998d59c0a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:22.538827 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c97868-62f9-4c70-acbf-e9ff6163d462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:22.540916 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c97868-62f9-4c70-acbf-e9ff6163d462 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:22.541692 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c97868-62f9-4c70-acbf-e9ff6163d462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:22.546517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c97868-62f9-4c70-acbf-e9ff6163d462 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:22.546517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c97868-62f9-4c70-acbf-e9ff6163d462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:22.564505 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c97868-62f9-4c70-acbf-e9ff6163d462 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:22.648540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1205/2386] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:45:22 2022] POST /identity/v3/users => generated 301 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:45:22.650937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a23ac9-f5b1-4caf-a13d-ad6a2cf9c19b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:22.675323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a23ac9-f5b1-4caf-a13d-ad6a2cf9c19b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:22.695745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded868a2-c147-4c7b-9bda-4fd67e734e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:22.697200 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded868a2-c147-4c7b-9bda-4fd67e734e4b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:22.697738 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded868a2-c147-4c7b-9bda-4fd67e734e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:22.698750 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded868a2-c147-4c7b-9bda-4fd67e734e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:22.700442 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded868a2-c147-4c7b-9bda-4fd67e734e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:22.703544 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded868a2-c147-4c7b-9bda-4fd67e734e4b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:22.740559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c97868-62f9-4c70-acbf-e9ff6163d462 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:22.741658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1182/2387] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:45:22 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:45:22.771180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c97868-62f9-4c70-acbf-e9ff6163d462 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:22.772269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9a54f-fbde-439c-81f8-fcb38af4b682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:22.773321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9a54f-fbde-439c-81f8-fcb38af4b682 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:22.773791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9a54f-fbde-439c-81f8-fcb38af4b682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:22.774233 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9a54f-fbde-439c-81f8-fcb38af4b682 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:22.775511 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9a54f-fbde-439c-81f8-fcb38af4b682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:22.778731 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9a54f-fbde-439c-81f8-fcb38af4b682 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:22.816278 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1206/2388] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:45:22 2022] GET /identity/v3/roles => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:45:22.823413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded868a2-c147-4c7b-9bda-4fd67e734e4b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:22.856719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded868a2-c147-4c7b-9bda-4fd67e734e4b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:22.887288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df6682-5cf3-49e5-8e4c-1854f186cfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:22.891739 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df6682-5cf3-49e5-8e4c-1854f186cfd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:22.892306 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df6682-5cf3-49e5-8e4c-1854f186cfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:22.892948 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df6682-5cf3-49e5-8e4c-1854f186cfd3 admin admin] PATH_INFO: `/v3/projects/8d8dcc74809b48bb8495a38fa1bfee6b/users/ba911b59c3c1477daaf3204607e6e767/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:22.936520 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df6682-5cf3-49e5-8e4c-1854f186cfd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d8dcc74809b48bb8495a38fa1bfee6b, user_id=ba911b59c3c1477daaf3204607e6e767, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:22.945455 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df6682-5cf3-49e5-8e4c-1854f186cfd3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:23.004859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35357617-cdfc-40c1-aee1-8557936aa0fe None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:23.005292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35357617-cdfc-40c1-aee1-8557936aa0fe None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:23.005672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35357617-cdfc-40c1-aee1-8557936aa0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:23.007046 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1183/2389] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:45:22 2022] PUT /identity/v3/projects/8d8dcc74809b48bb8495a38fa1bfee6b/users/ba911b59c3c1477daaf3204607e6e767/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:45:23.045283 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-35357617-cdfc-40c1-aee1-8557936aa0fe None None] MFA Rules not processed for user `ba911b59c3c1477daaf3204607e6e767`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:23.047166 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-35357617-cdfc-40c1-aee1-8557936aa0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:23.193486 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1207/2390] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:45:23 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:45:23.203129 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df6682-5cf3-49e5-8e4c-1854f186cfd3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:23.207549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-23df6682-5cf3-49e5-8e4c-1854f186cfd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:23.307910 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570c1ec-471c-4b3b-b93a-37be057526db None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:23.308633 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570c1ec-471c-4b3b-b93a-37be057526db None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:23.309167 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570c1ec-471c-4b3b-b93a-37be057526db None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:23.312004 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1208/2391] 10.222.0.110 () {54 vars in 926 bytes} [Thu May 26 16:45:23 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:45:23.327638 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41da9c-24ac-4f65-bd3c-43732b945d62 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:23.328072 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41da9c-24ac-4f65-bd3c-43732b945d62 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:23.328518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41da9c-24ac-4f65-bd3c-43732b945d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:23.398508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:23.417745 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:23.452157 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0a41da9c-24ac-4f65-bd3c-43732b945d62 None None] MFA Rules not processed for user `0043a7d5877f41de905afe6bef355867`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:23.460210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0a41da9c-24ac-4f65-bd3c-43732b945d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:23.589389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df6682-5cf3-49e5-8e4c-1854f186cfd3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:23.603859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356c9ed-e062-43da-b9b3-c6a799b97341 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:23.606133 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356c9ed-e062-43da-b9b3-c6a799b97341 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:23.606418 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356c9ed-e062-43da-b9b3-c6a799b97341 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:23.606754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356c9ed-e062-43da-b9b3-c6a799b97341 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:23.640241 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356c9ed-e062-43da-b9b3-c6a799b97341 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:23.643053 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356c9ed-e062-43da-b9b3-c6a799b97341 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:23.669109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1184/2392] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:45:23 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:23.684966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1209/2393] 10.222.0.110 () {58 vars in 1023 bytes} [Thu May 26 16:45:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:45:23.709039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356c9ed-e062-43da-b9b3-c6a799b97341 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:23.711295 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9356c9ed-e062-43da-b9b3-c6a799b97341 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:23.933490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356c9ed-e062-43da-b9b3-c6a799b97341 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:23.941871 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b903c59-e920-4fe8-894a-4928f22e35ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '363d16eebb3f40a1be71506961cc3c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:23.942605 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b903c59-e920-4fe8-894a-4928f22e35ad service glance] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:23.942905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b903c59-e920-4fe8-894a-4928f22e35ad service glance] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:23.943204 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b903c59-e920-4fe8-894a-4928f22e35ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:23.977951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b903c59-e920-4fe8-894a-4928f22e35ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:23.981207 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b903c59-e920-4fe8-894a-4928f22e35ad service glance] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:23.996319 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1185/2394] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:45:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:24.131187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c73d3f-da00-44a3-b3f7-5b34086420cf None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:24.131187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c73d3f-da00-44a3-b3f7-5b34086420cf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:24.131187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c73d3f-da00-44a3-b3f7-5b34086420cf None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:24.132393 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1210/2395] 10.222.0.110 () {54 vars in 926 bytes} [Thu May 26 16:45:24 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:45:24.144455 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e60f5-3d52-4a9c-9080-5534f38f2ff0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:24.145016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e60f5-3d52-4a9c-9080-5534f38f2ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:24.147888 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e60f5-3d52-4a9c-9080-5534f38f2ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:24.193014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6a0e60f5-3d52-4a9c-9080-5534f38f2ff0 None None] MFA Rules not processed for user `f2411c1c780449e1a24fecb747cc3761`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:24.196534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6a0e60f5-3d52-4a9c-9080-5534f38f2ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:24.319149 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1186/2396] 10.222.0.110 () {58 vars in 1023 bytes} [Thu May 26 16:45:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:24.320117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c73d3f-da00-44a3-b3f7-5b34086420cf None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:24.323793 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-47c73d3f-da00-44a3-b3f7-5b34086420cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:24.350025 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c73d3f-da00-44a3-b3f7-5b34086420cf None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:24.361111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32373f1-3d8e-4360-8177-ffe1b5c5f4c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:24.361111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32373f1-3d8e-4360-8177-ffe1b5c5f4c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:24.361111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32373f1-3d8e-4360-8177-ffe1b5c5f4c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:24.361111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32373f1-3d8e-4360-8177-ffe1b5c5f4c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:24.373373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32373f1-3d8e-4360-8177-ffe1b5c5f4c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:24.374701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32373f1-3d8e-4360-8177-ffe1b5c5f4c4 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:24.406637 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1211/2397] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:45:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:24.541381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039a665-66a1-4202-a3fd-5c089a1985db None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:24.542947 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039a665-66a1-4202-a3fd-5c089a1985db None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:24.543837 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039a665-66a1-4202-a3fd-5c089a1985db None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:24.547485 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1187/2398] 10.222.0.110 () {54 vars in 926 bytes} [Thu May 26 16:45:24 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:45:24.560682 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda80824-1eb1-44e2-9d9c-13197764d135 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:24.561447 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda80824-1eb1-44e2-9d9c-13197764d135 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:24.561984 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda80824-1eb1-44e2-9d9c-13197764d135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:24.585458 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-eda80824-1eb1-44e2-9d9c-13197764d135 None None] MFA Rules not processed for user `0043a7d5877f41de905afe6bef355867`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:24.587434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-eda80824-1eb1-44e2-9d9c-13197764d135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:24.601894 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1212/2399] 10.222.0.110 () {58 vars in 1023 bytes} [Thu May 26 16:45:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:45:24.638165 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039a665-66a1-4202-a3fd-5c089a1985db None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:24.695530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039a665-66a1-4202-a3fd-5c089a1985db None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:24.717190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95e723-768c-4137-a939-75c1c27b2eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:24.719318 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95e723-768c-4137-a939-75c1c27b2eef service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:24.720768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95e723-768c-4137-a939-75c1c27b2eef service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:24.721144 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95e723-768c-4137-a939-75c1c27b2eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:24.753408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95e723-768c-4137-a939-75c1c27b2eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:24.758084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95e723-768c-4137-a939-75c1c27b2eef service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:24.799991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1188/2400] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:45:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:29.957544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda80824-1eb1-44e2-9d9c-13197764d135 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:30.093434 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda80824-1eb1-44e2-9d9c-13197764d135 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:30.103294 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4107a-8d46-483d-8a6b-cb4803850be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:30.104417 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4107a-8d46-483d-8a6b-cb4803850be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:30.104417 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4107a-8d46-483d-8a6b-cb4803850be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:30.104417 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4107a-8d46-483d-8a6b-cb4803850be2 admin admin] PATH_INFO: `/v3/users/ba911b59c3c1477daaf3204607e6e767` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:30.107159 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4107a-8d46-483d-8a6b-cb4803850be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba911b59c3c1477daaf3204607e6e767)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:30.109251 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4107a-8d46-483d-8a6b-cb4803850be2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:30.199115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7ca4107a-8d46-483d-8a6b-cb4803850be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba911b59c3c1477daaf3204607e6e767'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:30.221896 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7ca4107a-8d46-483d-8a6b-cb4803850be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba911b59c3c1477daaf3204607e6e767'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:30.222810 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7ca4107a-8d46-483d-8a6b-cb4803850be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba911b59c3c1477daaf3204607e6e767'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:30.235920 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7ca4107a-8d46-483d-8a6b-cb4803850be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba911b59c3c1477daaf3204607e6e767'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:30.237087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7ca4107a-8d46-483d-8a6b-cb4803850be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba911b59c3c1477daaf3204607e6e767'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:30.245301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:30.258633 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1213/2401] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:45:29 2022] DELETE /identity/v3/users/ba911b59c3c1477daaf3204607e6e767 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:45:30.262308 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f2040-c504-4cc8-a330-ec7211768ae8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:30.263208 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f2040-c504-4cc8-a330-ec7211768ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:30.263208 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f2040-c504-4cc8-a330-ec7211768ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:30.294104 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d33f2040-c504-4cc8-a330-ec7211768ae8 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:30.296449 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d33f2040-c504-4cc8-a330-ec7211768ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:30.395186 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:30.416901 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1189/2402] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:45:30.428092 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4107a-8d46-483d-8a6b-cb4803850be2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:30.430115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7ca4107a-8d46-483d-8a6b-cb4803850be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:30.524874 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4107a-8d46-483d-8a6b-cb4803850be2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:30.529965 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90997812-e71c-4864-ba18-7eed4e8d7065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:30.530920 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90997812-e71c-4864-ba18-7eed4e8d7065 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:30.531220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90997812-e71c-4864-ba18-7eed4e8d7065 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:30.531689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90997812-e71c-4864-ba18-7eed4e8d7065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:30.543721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90997812-e71c-4864-ba18-7eed4e8d7065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:30.546119 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90997812-e71c-4864-ba18-7eed4e8d7065 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:30.560800 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1214/2403] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:45:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:30.940587 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f2040-c504-4cc8-a330-ec7211768ae8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:30.945656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92eb9d-ccbf-435f-a9ec-d35803479b5d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:30.947125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d33f2040-c504-4cc8-a330-ec7211768ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:30.949807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92eb9d-ccbf-435f-a9ec-d35803479b5d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:30.949807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92eb9d-ccbf-435f-a9ec-d35803479b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:30.970886 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f2040-c504-4cc8-a330-ec7211768ae8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:30.977629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc6529-a7d3-4970-a187-4cefc019d7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:30.979257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc6529-a7d3-4970-a187-4cefc019d7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:30.981406 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc6529-a7d3-4970-a187-4cefc019d7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:30.981705 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc6529-a7d3-4970-a187-4cefc019d7bd admin admin] PATH_INFO: `/v3/projects/8d8dcc74809b48bb8495a38fa1bfee6b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:30.983384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc6529-a7d3-4970-a187-4cefc019d7bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d8dcc74809b48bb8495a38fa1bfee6b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:30.983543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ba92eb9d-ccbf-435f-a9ec-d35803479b5d None None] MFA Rules not processed for user `a5413c5a7c704500a628940d04ca40a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:30.985488 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ba92eb9d-ccbf-435f-a9ec-d35803479b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:30.985800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc6529-a7d3-4970-a187-4cefc019d7bd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:31.074523 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-40dc6529-a7d3-4970-a187-4cefc019d7bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d8dcc74809b48bb8495a38fa1bfee6b', 'request_id': 'req-40dc6529-a7d3-4970-a187-4cefc019d7bd'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:31.085777 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-40dc6529-a7d3-4970-a187-4cefc019d7bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d8dcc74809b48bb8495a38fa1bfee6b', 'request_id': 'req-40dc6529-a7d3-4970-a187-4cefc019d7bd'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:31.096767 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-40dc6529-a7d3-4970-a187-4cefc019d7bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d8dcc74809b48bb8495a38fa1bfee6b', 'request_id': 'req-40dc6529-a7d3-4970-a187-4cefc019d7bd'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:31.097647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1215/2404] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:45:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:45:31.115331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-40dc6529-a7d3-4970-a187-4cefc019d7bd admin admin] The token cache is being invalidate because project 8d8dcc74809b48bb8495a38fa1bfee6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:45:31.116333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-40dc6529-a7d3-4970-a187-4cefc019d7bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:31.118542 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-40dc6529-a7d3-4970-a187-4cefc019d7bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:31.121490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1190/2405] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:45:30 2022] DELETE /identity/v3/projects/8d8dcc74809b48bb8495a38fa1bfee6b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:45:33.811446 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92eb9d-ccbf-435f-a9ec-d35803479b5d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:33.816380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ba92eb9d-ccbf-435f-a9ec-d35803479b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:34.001478 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92eb9d-ccbf-435f-a9ec-d35803479b5d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:34.034387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:34.085659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3554-eed9-4bcc-ad4f-f9388f419512 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ffef7640dd1487ab2ea91fc0f4be9e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:34.086330 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3554-eed9-4bcc-ad4f-f9388f419512 service placement] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:34.086794 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3554-eed9-4bcc-ad4f-f9388f419512 service placement] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:34.087109 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3554-eed9-4bcc-ad4f-f9388f419512 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:34.089003 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f1bc3554-eed9-4bcc-ad4f-f9388f419512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:34.104221 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc3554-eed9-4bcc-ad4f-f9388f419512 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:34.106617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc3554-eed9-4bcc-ad4f-f9388f419512 service placement] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:34.123114 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1216/2406] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:45:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:37.228300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b99bc-08fe-46b8-8f52-acc86767191f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:37.229043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b99bc-08fe-46b8-8f52-acc86767191f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:37.229043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b99bc-08fe-46b8-8f52-acc86767191f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:37.268535 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-372b99bc-08fe-46b8-8f52-acc86767191f None None] MFA Rules not processed for user `ebf3257328b94092b544cb0dadb789c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:37.270755 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-372b99bc-08fe-46b8-8f52-acc86767191f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:37.383942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1191/2407] 10.222.0.110 () {58 vars in 1014 bytes} [Thu May 26 16:45:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:37.404787 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3554-eed9-4bcc-ad4f-f9388f419512 service placement] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:37.408112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f1bc3554-eed9-4bcc-ad4f-f9388f419512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:37.553328 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b99bc-08fe-46b8-8f52-acc86767191f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:37.556671 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-372b99bc-08fe-46b8-8f52-acc86767191f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:37.590394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3554-eed9-4bcc-ad4f-f9388f419512 service placement] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:37.601465 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92b459-ae8f-40c2-9369-9df3601d1a1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4502c57e324c31a8bce12770a92371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:37.603321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92b459-ae8f-40c2-9369-9df3601d1a1b service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:37.603793 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92b459-ae8f-40c2-9369-9df3601d1a1b service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:37.604502 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92b459-ae8f-40c2-9369-9df3601d1a1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:37.624008 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92b459-ae8f-40c2-9369-9df3601d1a1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:37.628013 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92b459-ae8f-40c2-9369-9df3601d1a1b service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:37.650829 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1217/2408] 10.222.0.110 () {60 vars in 1389 bytes} [Thu May 26 16:45:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 16:45:37.665771 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b2c6c-284f-4e22-bf48-7b5f85c3efd6 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:37.667333 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b2c6c-284f-4e22-bf48-7b5f85c3efd6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:37.667333 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b2c6c-284f-4e22-bf48-7b5f85c3efd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:37.724064 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9e0b2c6c-284f-4e22-bf48-7b5f85c3efd6 None None] MFA Rules not processed for user `ebf3257328b94092b544cb0dadb789c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:37.726502 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9e0b2c6c-284f-4e22-bf48-7b5f85c3efd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:37.750086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1218/2409] 10.222.0.110 () {58 vars in 1014 bytes} [Thu May 26 16:45:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:37.756487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b99bc-08fe-46b8-8f52-acc86767191f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:37.773660 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93eff4a-ff8c-462d-8d80-d334c64c8e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:37.775529 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93eff4a-ff8c-462d-8d80-d334c64c8e55 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:37.776073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93eff4a-ff8c-462d-8d80-d334c64c8e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:37.776598 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93eff4a-ff8c-462d-8d80-d334c64c8e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:37.788598 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d93eff4a-ff8c-462d-8d80-d334c64c8e55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:37.828353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b2c6c-284f-4e22-bf48-7b5f85c3efd6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:37.875441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b2c6c-284f-4e22-bf48-7b5f85c3efd6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:37.898860 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b16e5-35b2-4662-b36d-2123906bbb60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4502c57e324c31a8bce12770a92371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:37.906246 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b16e5-35b2-4662-b36d-2123906bbb60 service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:37.906891 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b16e5-35b2-4662-b36d-2123906bbb60 service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:37.907497 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b16e5-35b2-4662-b36d-2123906bbb60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:37.926170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:37.955113 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b16e5-35b2-4662-b36d-2123906bbb60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:37.960335 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b16e5-35b2-4662-b36d-2123906bbb60 service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:37.984077 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1219/2410] 10.222.0.110 () {60 vars in 1389 bytes} [Thu May 26 16:45:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:45:38.061583 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93eff4a-ff8c-462d-8d80-d334c64c8e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:38.064433 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93eff4a-ff8c-462d-8d80-d334c64c8e55 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:38.109755 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1192/2411] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:45:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:45:47.975190 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=66 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:48.088796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=13 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:11.513778 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5ba63-93f8-46c5-ac07-9fba074d8221 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:11.514414 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5ba63-93f8-46c5-ac07-9fba074d8221 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:11.514693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5ba63-93f8-46c5-ac07-9fba074d8221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:11.542939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a7d5ba63-93f8-46c5-ac07-9fba074d8221 None None] MFA Rules not processed for user `713e3f20f94849c5bb6b88ba5af39868`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:11.544238 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a7d5ba63-93f8-46c5-ac07-9fba074d8221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:11.694831 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1220/2412] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:46:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:46:15.008967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea641e1-71e1-4b4e-9019-077c53e581de None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:15.009602 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea641e1-71e1-4b4e-9019-077c53e581de None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:15.010014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea641e1-71e1-4b4e-9019-077c53e581de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:15.036527 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cea641e1-71e1-4b4e-9019-077c53e581de None None] MFA Rules not processed for user `ebf3257328b94092b544cb0dadb789c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:15.037626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cea641e1-71e1-4b4e-9019-077c53e581de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:15.046751 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1193/2413] 10.222.0.110 () {58 vars in 972 bytes} [Thu May 26 16:46:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:46:15.081969 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5ba63-93f8-46c5-ac07-9fba074d8221 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:15.102930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5ba63-93f8-46c5-ac07-9fba074d8221 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:15.112691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbbd52-6779-4451-9f1d-492c784ccda9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4502c57e324c31a8bce12770a92371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:15.114767 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbbd52-6779-4451-9f1d-492c784ccda9 service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:15.115087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbbd52-6779-4451-9f1d-492c784ccda9 service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:15.115410 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbbd52-6779-4451-9f1d-492c784ccda9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:15.138810 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbbd52-6779-4451-9f1d-492c784ccda9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:15.140572 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbbd52-6779-4451-9f1d-492c784ccda9 service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:15.150639 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1221/2414] 10.222.0.110 () {60 vars in 1389 bytes} [Thu May 26 16:46:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:46:25.026859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:25.147135 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=31 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:26.819333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea641e1-71e1-4b4e-9019-077c53e581de None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:26.821615 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cea641e1-71e1-4b4e-9019-077c53e581de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:26.840178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea641e1-71e1-4b4e-9019-077c53e581de None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:26.845446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d20620-67ea-4760-a9bf-7f5cb9f53639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:26.846137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d20620-67ea-4760-a9bf-7f5cb9f53639 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:26.846429 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d20620-67ea-4760-a9bf-7f5cb9f53639 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:26.846759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d20620-67ea-4760-a9bf-7f5cb9f53639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:26.848758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-22d20620-67ea-4760-a9bf-7f5cb9f53639 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:26.951406 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d20620-67ea-4760-a9bf-7f5cb9f53639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:26.952884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d20620-67ea-4760-a9bf-7f5cb9f53639 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:26.968068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1194/2415] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:46:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:46:29.532413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca4011-2435-4c90-ae5f-9cd79a4d045c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:29.533741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca4011-2435-4c90-ae5f-9cd79a4d045c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:29.533741 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca4011-2435-4c90-ae5f-9cd79a4d045c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:29.552804 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e9ca4011-2435-4c90-ae5f-9cd79a4d045c None None] MFA Rules not processed for user `01d3da9345ed40f396730e41ccdda091`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:29.554044 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e9ca4011-2435-4c90-ae5f-9cd79a4d045c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:29.631199 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1222/2416] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:46:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:46:36.960808 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=30 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:39.618296 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=25 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:16.523855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb3d0c-e8ff-4963-9a5b-a3211b960481 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:16.524418 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb3d0c-e8ff-4963-9a5b-a3211b960481 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:16.524418 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb3d0c-e8ff-4963-9a5b-a3211b960481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:16.544357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a4bb3d0c-e8ff-4963-9a5b-a3211b960481 None None] MFA Rules not processed for user `7535a906d3884263b6f031080c72cc6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:16.546291 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a4bb3d0c-e8ff-4963-9a5b-a3211b960481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:16.604534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1195/2417] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:47:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:47:26.596092 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=25 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:28.189576 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca4011-2435-4c90-ae5f-9cd79a4d045c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:28.200543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca4011-2435-4c90-ae5f-9cd79a4d045c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:28.204105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f5ebc-cd7c-4da1-85ab-36202c82e9b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:28.204767 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f5ebc-cd7c-4da1-85ab-36202c82e9b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:28.205056 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f5ebc-cd7c-4da1-85ab-36202c82e9b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:28.205350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f5ebc-cd7c-4da1-85ab-36202c82e9b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:28.207216 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-519f5ebc-cd7c-4da1-85ab-36202c82e9b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:28.288464 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f5ebc-cd7c-4da1-85ab-36202c82e9b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:28.298296 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f5ebc-cd7c-4da1-85ab-36202c82e9b6 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:28.313176 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1223/2418] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:47:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:47:29.043710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb3d0c-e8ff-4963-9a5b-a3211b960481 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:29.054705 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb3d0c-e8ff-4963-9a5b-a3211b960481 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:29.059516 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06430223-53c3-4b3d-92be-8b74a86e163e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:29.060284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06430223-53c3-4b3d-92be-8b74a86e163e service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:29.060673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06430223-53c3-4b3d-92be-8b74a86e163e service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:29.061045 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06430223-53c3-4b3d-92be-8b74a86e163e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:29.063374 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-06430223-53c3-4b3d-92be-8b74a86e163e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:29.079081 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06430223-53c3-4b3d-92be-8b74a86e163e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:29.080636 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06430223-53c3-4b3d-92be-8b74a86e163e service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:29.093017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1196/2419] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:47:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:47:38.307422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=34 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:39.087332 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=6 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:39.686940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f5ebc-cd7c-4da1-85ab-36202c82e9b6 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:39.688501 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-519f5ebc-cd7c-4da1-85ab-36202c82e9b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:39.756761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f5ebc-cd7c-4da1-85ab-36202c82e9b6 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:39.760737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2ab90-842a-40be-8954-9d4423dd5f04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:39.761711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2ab90-842a-40be-8954-9d4423dd5f04 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:39.762005 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2ab90-842a-40be-8954-9d4423dd5f04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:39.762287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2ab90-842a-40be-8954-9d4423dd5f04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:39.764250 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8de2ab90-842a-40be-8954-9d4423dd5f04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:39.777113 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2ab90-842a-40be-8954-9d4423dd5f04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:39.780152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2ab90-842a-40be-8954-9d4423dd5f04 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:39.790656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1224/2420] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:47:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:47:47.122916 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36c3ce-5140-44f3-8436-8a49604accea None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:47.123654 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36c3ce-5140-44f3-8436-8a49604accea None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:47.123654 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36c3ce-5140-44f3-8436-8a49604accea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:47.142427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6c36c3ce-5140-44f3-8436-8a49604accea None None] MFA Rules not processed for user `01d3da9345ed40f396730e41ccdda091`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:47.143665 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6c36c3ce-5140-44f3-8436-8a49604accea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:47.151255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1197/2421] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:47:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:47:47.907902 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2ab90-842a-40be-8954-9d4423dd5f04 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:47.909658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8de2ab90-842a-40be-8954-9d4423dd5f04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:47.925979 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2ab90-842a-40be-8954-9d4423dd5f04 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:47.930902 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a619e2-1d1f-45b9-aada-f6a46b9317f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ffef7640dd1487ab2ea91fc0f4be9e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:47.931601 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a619e2-1d1f-45b9-aada-f6a46b9317f9 service placement] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:47.931941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a619e2-1d1f-45b9-aada-f6a46b9317f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:47.932290 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a619e2-1d1f-45b9-aada-f6a46b9317f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:47.934192 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-27a619e2-1d1f-45b9-aada-f6a46b9317f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:47.947308 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a619e2-1d1f-45b9-aada-f6a46b9317f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:47.949102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a619e2-1d1f-45b9-aada-f6a46b9317f9 service placement] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:47.964744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1225/2422] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:47:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:47:50.376492 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36c3ce-5140-44f3-8436-8a49604accea None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:50.400089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36c3ce-5140-44f3-8436-8a49604accea None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:50.402955 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815699d0-9e77-42bb-a62e-47cba00b8c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:50.403631 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815699d0-9e77-42bb-a62e-47cba00b8c0d service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:50.403919 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815699d0-9e77-42bb-a62e-47cba00b8c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:50.404228 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815699d0-9e77-42bb-a62e-47cba00b8c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:50.406215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-815699d0-9e77-42bb-a62e-47cba00b8c0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:50.418490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815699d0-9e77-42bb-a62e-47cba00b8c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:50.420594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815699d0-9e77-42bb-a62e-47cba00b8c0d service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:50.430718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1198/2423] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:47:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:47:53.752193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28070f03-6a25-4fd5-85c9-53d5a84c2f07 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:53.753108 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28070f03-6a25-4fd5-85c9-53d5a84c2f07 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:53.753108 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28070f03-6a25-4fd5-85c9-53d5a84c2f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:53.776703 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-28070f03-6a25-4fd5-85c9-53d5a84c2f07 None None] MFA Rules not processed for user `713e3f20f94849c5bb6b88ba5af39868`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:53.779169 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-28070f03-6a25-4fd5-85c9-53d5a84c2f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:53.789132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1226/2424] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:47:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:00.426263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=9 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:00.819775 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815699d0-9e77-42bb-a62e-47cba00b8c0d service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:00.822610 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-815699d0-9e77-42bb-a62e-47cba00b8c0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:00.846457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815699d0-9e77-42bb-a62e-47cba00b8c0d service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:00.855549 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96aae5-1f1d-4c7c-852f-85a8a13f2b16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:00.856835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96aae5-1f1d-4c7c-852f-85a8a13f2b16 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:00.857419 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96aae5-1f1d-4c7c-852f-85a8a13f2b16 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:00.858008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96aae5-1f1d-4c7c-852f-85a8a13f2b16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:00.860994 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2c96aae5-1f1d-4c7c-852f-85a8a13f2b16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:00.878071 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96aae5-1f1d-4c7c-852f-85a8a13f2b16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:00.880137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96aae5-1f1d-4c7c-852f-85a8a13f2b16 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:00.893352 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1199/2425] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:48:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:48:03.769210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=35 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:04.667680 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28070f03-6a25-4fd5-85c9-53d5a84c2f07 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:04.691256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28070f03-6a25-4fd5-85c9-53d5a84c2f07 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:04.700817 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb06a0-6c21-4f24-9713-25b6b7882d9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:04.701531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb06a0-6c21-4f24-9713-25b6b7882d9e service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:04.701818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb06a0-6c21-4f24-9713-25b6b7882d9e service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:04.702216 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb06a0-6c21-4f24-9713-25b6b7882d9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:04.704519 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7ddb06a0-6c21-4f24-9713-25b6b7882d9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:04.717704 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb06a0-6c21-4f24-9713-25b6b7882d9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:04.719351 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb06a0-6c21-4f24-9713-25b6b7882d9e service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:04.731205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1227/2426] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:48:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:48:10.887911 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=6 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:11.533561 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96aae5-1f1d-4c7c-852f-85a8a13f2b16 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:11.557597 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96aae5-1f1d-4c7c-852f-85a8a13f2b16 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:11.578683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dd4e4-ec60-4de4-9ec7-38542d5f3302 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:11.580313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dd4e4-ec60-4de4-9ec7-38542d5f3302 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:11.581158 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dd4e4-ec60-4de4-9ec7-38542d5f3302 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:11.582123 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dd4e4-ec60-4de4-9ec7-38542d5f3302 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:11.585721 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f50dd4e4-ec60-4de4-9ec7-38542d5f3302 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:11.606001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dd4e4-ec60-4de4-9ec7-38542d5f3302 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:11.607679 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dd4e4-ec60-4de4-9ec7-38542d5f3302 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:11.631245 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1200/2427] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:48:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:48:14.726819 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=6 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:19.191996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb06a0-6c21-4f24-9713-25b6b7882d9e service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:19.210824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb06a0-6c21-4f24-9713-25b6b7882d9e service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:19.219017 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aeb7ef-a946-4bd7-9bba-895ecaeb2cd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:19.220047 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aeb7ef-a946-4bd7-9bba-895ecaeb2cd3 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:19.220589 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aeb7ef-a946-4bd7-9bba-895ecaeb2cd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:19.220881 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aeb7ef-a946-4bd7-9bba-895ecaeb2cd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:19.222885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-87aeb7ef-a946-4bd7-9bba-895ecaeb2cd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:19.234690 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aeb7ef-a946-4bd7-9bba-895ecaeb2cd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:19.236458 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aeb7ef-a946-4bd7-9bba-895ecaeb2cd3 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:19.253080 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1228/2428] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:48:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:48:20.096558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad23ca9-2536-48b7-8f2b-221fd208db4f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:20.097326 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad23ca9-2536-48b7-8f2b-221fd208db4f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:20.097326 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad23ca9-2536-48b7-8f2b-221fd208db4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:20.124014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7ad23ca9-2536-48b7-8f2b-221fd208db4f None None] MFA Rules not processed for user `ebf3257328b94092b544cb0dadb789c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:20.126118 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7ad23ca9-2536-48b7-8f2b-221fd208db4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:20.137400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1201/2429] 10.222.0.110 () {58 vars in 972 bytes} [Thu May 26 16:48:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:48:20.204041 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aeb7ef-a946-4bd7-9bba-895ecaeb2cd3 service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:20.216147 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aeb7ef-a946-4bd7-9bba-895ecaeb2cd3 service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:20.221333 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e5b16-2cc9-4c7d-832e-43d22b71fcb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4502c57e324c31a8bce12770a92371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:20.221980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e5b16-2cc9-4c7d-832e-43d22b71fcb8 service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:20.222264 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e5b16-2cc9-4c7d-832e-43d22b71fcb8 service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:20.222591 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e5b16-2cc9-4c7d-832e-43d22b71fcb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:20.232542 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e5b16-2cc9-4c7d-832e-43d22b71fcb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:20.234175 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e5b16-2cc9-4c7d-832e-43d22b71fcb8 service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:20.244277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1229/2430] 10.222.0.110 () {60 vars in 1389 bytes} [Thu May 26 16:48:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 16:48:28.652239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad23ca9-2536-48b7-8f2b-221fd208db4f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:28.654666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7ad23ca9-2536-48b7-8f2b-221fd208db4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:28.760614 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad23ca9-2536-48b7-8f2b-221fd208db4f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:28.766293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7eec0a-3f00-4866-81da-d26d2602bbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:28.767470 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7eec0a-3f00-4866-81da-d26d2602bbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:28.772276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7eec0a-3f00-4866-81da-d26d2602bbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:28.773090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7eec0a-3f00-4866-81da-d26d2602bbd7 admin admin] PATH_INFO: `/v3/users/a5413c5a7c704500a628940d04ca40a8` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:28.775558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7eec0a-3f00-4866-81da-d26d2602bbd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5413c5a7c704500a628940d04ca40a8)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:28.780156 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7eec0a-3f00-4866-81da-d26d2602bbd7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:28.862427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7f7eec0a-3f00-4866-81da-d26d2602bbd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5413c5a7c704500a628940d04ca40a8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:28.863577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7f7eec0a-3f00-4866-81da-d26d2602bbd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5413c5a7c704500a628940d04ca40a8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:28.877926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7f7eec0a-3f00-4866-81da-d26d2602bbd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5413c5a7c704500a628940d04ca40a8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:28.877926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7f7eec0a-3f00-4866-81da-d26d2602bbd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5413c5a7c704500a628940d04ca40a8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:28.892230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7f7eec0a-3f00-4866-81da-d26d2602bbd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5413c5a7c704500a628940d04ca40a8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:28.925988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1202/2431] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:48:28 2022] DELETE /identity/v3/users/a5413c5a7c704500a628940d04ca40a8 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:48:29.163244 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e5b16-2cc9-4c7d-832e-43d22b71fcb8 service swift] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:29.181514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e5b16-2cc9-4c7d-832e-43d22b71fcb8 service swift] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:29.267765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3e7de-c6da-4efe-b425-380a504cf9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:29.268869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3e7de-c6da-4efe-b425-380a504cf9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:29.269158 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3e7de-c6da-4efe-b425-380a504cf9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:29.269440 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3e7de-c6da-4efe-b425-380a504cf9a4 admin admin] PATH_INFO: `/v3/projects/4148d58fe39e4e07b7bc5fcbfebe146d` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:29.270943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3e7de-c6da-4efe-b425-380a504cf9a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4148d58fe39e4e07b7bc5fcbfebe146d)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:29.272878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3e7de-c6da-4efe-b425-380a504cf9a4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:29.333527 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d8f3e7de-c6da-4efe-b425-380a504cf9a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4148d58fe39e4e07b7bc5fcbfebe146d', 'request_id': 'req-d8f3e7de-c6da-4efe-b425-380a504cf9a4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:29.344339 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d8f3e7de-c6da-4efe-b425-380a504cf9a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4148d58fe39e4e07b7bc5fcbfebe146d', 'request_id': 'req-d8f3e7de-c6da-4efe-b425-380a504cf9a4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:29.353280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d8f3e7de-c6da-4efe-b425-380a504cf9a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4148d58fe39e4e07b7bc5fcbfebe146d', 'request_id': 'req-d8f3e7de-c6da-4efe-b425-380a504cf9a4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:29.372256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d8f3e7de-c6da-4efe-b425-380a504cf9a4 admin admin] The token cache is being invalidate because project 4148d58fe39e4e07b7bc5fcbfebe146d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:48:29.372710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d8f3e7de-c6da-4efe-b425-380a504cf9a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:29.373542 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d8f3e7de-c6da-4efe-b425-380a504cf9a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:29.375207 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1230/2432] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:48:29 2022] DELETE /identity/v3/projects/4148d58fe39e4e07b7bc5fcbfebe146d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:48:29.379451 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7eec0a-3f00-4866-81da-d26d2602bbd7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:29.381423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7f7eec0a-3f00-4866-81da-d26d2602bbd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:29.395133 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7eec0a-3f00-4866-81da-d26d2602bbd7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:29.468972 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754bd9e-c9c3-46a5-929e-83b106930227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:29.469869 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754bd9e-c9c3-46a5-929e-83b106930227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:29.470159 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754bd9e-c9c3-46a5-929e-83b106930227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:29.470441 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754bd9e-c9c3-46a5-929e-83b106930227 admin admin] PATH_INFO: `/v3/users/abe192ac55ca4ed194eb7f5a0ea98883` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:29.471798 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754bd9e-c9c3-46a5-929e-83b106930227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abe192ac55ca4ed194eb7f5a0ea98883)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:29.473744 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754bd9e-c9c3-46a5-929e-83b106930227 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:29.476000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:29.537392 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7754bd9e-c9c3-46a5-929e-83b106930227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abe192ac55ca4ed194eb7f5a0ea98883'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:29.538149 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7754bd9e-c9c3-46a5-929e-83b106930227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abe192ac55ca4ed194eb7f5a0ea98883'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:29.547135 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7754bd9e-c9c3-46a5-929e-83b106930227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abe192ac55ca4ed194eb7f5a0ea98883'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:29.547981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7754bd9e-c9c3-46a5-929e-83b106930227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abe192ac55ca4ed194eb7f5a0ea98883'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:29.557018 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7754bd9e-c9c3-46a5-929e-83b106930227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abe192ac55ca4ed194eb7f5a0ea98883'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:29.575829 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1203/2433] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:48:29 2022] DELETE /identity/v3/users/abe192ac55ca4ed194eb7f5a0ea98883 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:48:29.784787 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3e7de-c6da-4efe-b425-380a504cf9a4 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:29.786363 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d8f3e7de-c6da-4efe-b425-380a504cf9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:29.814195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3e7de-c6da-4efe-b425-380a504cf9a4 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:29.909029 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2472b8-392a-4506-b009-cb108ffc0f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:29.909956 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2472b8-392a-4506-b009-cb108ffc0f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:29.910246 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2472b8-392a-4506-b009-cb108ffc0f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:29.910532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2472b8-392a-4506-b009-cb108ffc0f93 admin admin] PATH_INFO: `/v3/projects/967495223327427fa677a316e1ba8ee0` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:29.912663 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2472b8-392a-4506-b009-cb108ffc0f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=967495223327427fa677a316e1ba8ee0)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:29.914632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2472b8-392a-4506-b009-cb108ffc0f93 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:29.922513 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:29.975887 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-aa2472b8-392a-4506-b009-cb108ffc0f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '967495223327427fa677a316e1ba8ee0', 'request_id': 'req-aa2472b8-392a-4506-b009-cb108ffc0f93'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:29.985982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-aa2472b8-392a-4506-b009-cb108ffc0f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '967495223327427fa677a316e1ba8ee0', 'request_id': 'req-aa2472b8-392a-4506-b009-cb108ffc0f93'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:29.992644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-aa2472b8-392a-4506-b009-cb108ffc0f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '967495223327427fa677a316e1ba8ee0', 'request_id': 'req-aa2472b8-392a-4506-b009-cb108ffc0f93'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:30.009690 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-aa2472b8-392a-4506-b009-cb108ffc0f93 admin admin] The token cache is being invalidate because project 967495223327427fa677a316e1ba8ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:48:30.010178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-aa2472b8-392a-4506-b009-cb108ffc0f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:30.011219 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-aa2472b8-392a-4506-b009-cb108ffc0f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:48:30.013437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1231/2434] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:48:29 2022] DELETE /identity/v3/projects/967495223327427fa677a316e1ba8ee0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:48:39.572097 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=26,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:40.003451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:45.668644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754bd9e-c9c3-46a5-929e-83b106930227 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:45.670131 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7754bd9e-c9c3-46a5-929e-83b106930227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:45.746613 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754bd9e-c9c3-46a5-929e-83b106930227 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:45.834180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31eda3-f767-4c4b-971e-89eb07777103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:45.834826 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31eda3-f767-4c4b-971e-89eb07777103 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:45.835174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31eda3-f767-4c4b-971e-89eb07777103 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:45.835639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31eda3-f767-4c4b-971e-89eb07777103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:45.837590 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5a31eda3-f767-4c4b-971e-89eb07777103 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:45.948063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31eda3-f767-4c4b-971e-89eb07777103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:45.949690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31eda3-f767-4c4b-971e-89eb07777103 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:45.963080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1204/2435] 10.222.0.110 () {60 vars in 1401 bytes} [Thu May 26 16:48:45 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3270 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:48:48.454008 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e95826-44e4-40b1-917a-0e53b9c37c4f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:48.454879 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e95826-44e4-40b1-917a-0e53b9c37c4f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:48.454879 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e95826-44e4-40b1-917a-0e53b9c37c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:48.475306 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-47e95826-44e4-40b1-917a-0e53b9c37c4f None None] MFA Rules not processed for user `ebf3257328b94092b544cb0dadb789c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:48.476550 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-47e95826-44e4-40b1-917a-0e53b9c37c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:48.542845 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1232/2436] 10.222.0.110 () {58 vars in 1014 bytes} [Thu May 26 16:48:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:48:48.559299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31eda3-f767-4c4b-971e-89eb07777103 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:48.561037 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5a31eda3-f767-4c4b-971e-89eb07777103 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:48.658996 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31eda3-f767-4c4b-971e-89eb07777103 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:48.664148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a2346-4aa4-42e6-b71c-a31a99f1b78e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4502c57e324c31a8bce12770a92371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:48.664820 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a2346-4aa4-42e6-b71c-a31a99f1b78e service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:48.665101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a2346-4aa4-42e6-b71c-a31a99f1b78e service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:48.665378 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a2346-4aa4-42e6-b71c-a31a99f1b78e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:48.676016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a2346-4aa4-42e6-b71c-a31a99f1b78e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:48.677639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a2346-4aa4-42e6-b71c-a31a99f1b78e service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:48.682707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:48.687752 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1205/2437] 10.222.0.110 () {60 vars in 1389 bytes} [Thu May 26 16:48:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:48:58.533224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=25 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:07.981762 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c5d49-6331-405c-ac3f-3054740f2ecc None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:07.982482 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c5d49-6331-405c-ac3f-3054740f2ecc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:07.982482 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c5d49-6331-405c-ac3f-3054740f2ecc None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:07.983914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1233/2438] 10.222.0.110 () {54 vars in 926 bytes} [Thu May 26 16:49:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:07.990928 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc2b81-27bb-4100-a9b2-ea474a759985 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:07.991483 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc2b81-27bb-4100-a9b2-ea474a759985 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:07.991810 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc2b81-27bb-4100-a9b2-ea474a759985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:08.017132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-addc2b81-27bb-4100-a9b2-ea474a759985 None None] MFA Rules not processed for user `0043a7d5877f41de905afe6bef355867`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:08.019276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-addc2b81-27bb-4100-a9b2-ea474a759985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:08.084560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c5d49-6331-405c-ac3f-3054740f2ecc None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:08.087565 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2a8c5d49-6331-405c-ac3f-3054740f2ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:08.101641 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c5d49-6331-405c-ac3f-3054740f2ecc None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:08.108293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3da890-1afe-48e7-86f1-e9b551364161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:08.109111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3da890-1afe-48e7-86f1-e9b551364161 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:08.109644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3da890-1afe-48e7-86f1-e9b551364161 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:08.110150 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3da890-1afe-48e7-86f1-e9b551364161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:08.113883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-df3da890-1afe-48e7-86f1-e9b551364161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:08.120404 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1206/2439] 10.222.0.110 () {58 vars in 1023 bytes} [Thu May 26 16:49:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:08.135347 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc2b81-27bb-4100-a9b2-ea474a759985 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:08.137314 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-addc2b81-27bb-4100-a9b2-ea474a759985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:08.226400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc2b81-27bb-4100-a9b2-ea474a759985 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:08.226400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff9dc8-56e2-4fd1-89b4-547922077b69 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '363d16eebb3f40a1be71506961cc3c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:08.226400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff9dc8-56e2-4fd1-89b4-547922077b69 service glance] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:08.226400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff9dc8-56e2-4fd1-89b4-547922077b69 service glance] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:08.226998 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff9dc8-56e2-4fd1-89b4-547922077b69 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:08.240433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3da890-1afe-48e7-86f1-e9b551364161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:08.241399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff9dc8-56e2-4fd1-89b4-547922077b69 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:08.243385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff9dc8-56e2-4fd1-89b4-547922077b69 service glance] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:08.243610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3da890-1afe-48e7-86f1-e9b551364161 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:08.257587 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1207/2440] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:08.257931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1234/2441] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:08.344260 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bda1cb-a300-4487-831b-d8904ad362c5 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:08.344651 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bda1cb-a300-4487-831b-d8904ad362c5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:08.345048 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bda1cb-a300-4487-831b-d8904ad362c5 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:08.347202 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1208/2442] 10.222.0.110 () {54 vars in 926 bytes} [Thu May 26 16:49:08 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:08.353548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d1292-5190-4602-af8d-6800d71b4777 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:08.353838 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d1292-5190-4602-af8d-6800d71b4777 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:08.354314 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d1292-5190-4602-af8d-6800d71b4777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:08.386067 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ad0d1292-5190-4602-af8d-6800d71b4777 None None] MFA Rules not processed for user `f2411c1c780449e1a24fecb747cc3761`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:08.387927 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ad0d1292-5190-4602-af8d-6800d71b4777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:08.405030 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1235/2443] 10.222.0.110 () {58 vars in 1023 bytes} [Thu May 26 16:49:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:08.411997 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bda1cb-a300-4487-831b-d8904ad362c5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:08.415930 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-03bda1cb-a300-4487-831b-d8904ad362c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:08.442647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bda1cb-a300-4487-831b-d8904ad362c5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:08.447987 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4502672-1591-4e2a-a50f-d07e69f3c32a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:08.448666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4502672-1591-4e2a-a50f-d07e69f3c32a service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:08.448956 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4502672-1591-4e2a-a50f-d07e69f3c32a service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:08.449698 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4502672-1591-4e2a-a50f-d07e69f3c32a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:08.459125 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4502672-1591-4e2a-a50f-d07e69f3c32a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:08.460866 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4502672-1591-4e2a-a50f-d07e69f3c32a service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:08.475074 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1209/2444] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:08.574331 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c7bf9-e4cc-4653-a800-2a4ba4c804fd None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:08.574662 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c7bf9-e4cc-4653-a800-2a4ba4c804fd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:08.575082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c7bf9-e4cc-4653-a800-2a4ba4c804fd None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:08.576875 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1236/2445] 10.222.0.110 () {54 vars in 926 bytes} [Thu May 26 16:49:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:08.581976 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d982cb-916d-45ce-a7d5-be0cd10c5d5c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:08.582875 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d982cb-916d-45ce-a7d5-be0cd10c5d5c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:08.582875 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d982cb-916d-45ce-a7d5-be0cd10c5d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:08.603226 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-15d982cb-916d-45ce-a7d5-be0cd10c5d5c None None] MFA Rules not processed for user `0043a7d5877f41de905afe6bef355867`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:08.604561 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-15d982cb-916d-45ce-a7d5-be0cd10c5d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:08.615077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1210/2446] 10.222.0.110 () {58 vars in 1023 bytes} [Thu May 26 16:49:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:08.634803 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c7bf9-e4cc-4653-a800-2a4ba4c804fd None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:08.647886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c7bf9-e4cc-4653-a800-2a4ba4c804fd None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:08.651590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff53618-d88f-4b37-92ed-954b79082026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:08.652300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff53618-d88f-4b37-92ed-954b79082026 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:08.652651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff53618-d88f-4b37-92ed-954b79082026 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:08.652991 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff53618-d88f-4b37-92ed-954b79082026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:08.663975 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff53618-d88f-4b37-92ed-954b79082026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:08.665784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff53618-d88f-4b37-92ed-954b79082026 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:08.685427 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1237/2447] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:10.691554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233339e-cbcd-480f-ac80-f1b63580c13a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:10.692037 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233339e-cbcd-480f-ac80-f1b63580c13a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:10.692137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233339e-cbcd-480f-ac80-f1b63580c13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:10.712332 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0233339e-cbcd-480f-ac80-f1b63580c13a None None] MFA Rules not processed for user `ebf3257328b94092b544cb0dadb789c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:10.713557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0233339e-cbcd-480f-ac80-f1b63580c13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:10.721579 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1211/2448] 10.222.0.110 () {58 vars in 1014 bytes} [Thu May 26 16:49:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:10.734171 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff53618-d88f-4b37-92ed-954b79082026 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:10.745921 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff53618-d88f-4b37-92ed-954b79082026 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:10.752063 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c35e4-fcad-48c5-9912-4a7f701ae9d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4502c57e324c31a8bce12770a92371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:10.752719 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c35e4-fcad-48c5-9912-4a7f701ae9d4 service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:10.753008 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c35e4-fcad-48c5-9912-4a7f701ae9d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:10.753292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c35e4-fcad-48c5-9912-4a7f701ae9d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:10.762008 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c35e4-fcad-48c5-9912-4a7f701ae9d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:10.764056 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c35e4-fcad-48c5-9912-4a7f701ae9d4 service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:10.772277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1238/2449] 10.222.0.110 () {60 vars in 1389 bytes} [Thu May 26 16:49:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:49:12.273818 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233339e-cbcd-480f-ac80-f1b63580c13a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:12.276078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0233339e-cbcd-480f-ac80-f1b63580c13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:12.404149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c35e4-fcad-48c5-9912-4a7f701ae9d4 service swift] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:12.406411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b37c35e4-fcad-48c5-9912-4a7f701ae9d4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:12.427202 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233339e-cbcd-480f-ac80-f1b63580c13a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:12.444638 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c35e4-fcad-48c5-9912-4a7f701ae9d4 service swift] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:12.448290 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3108e-61af-4bde-b6c2-20eca84f2e93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ffef7640dd1487ab2ea91fc0f4be9e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:12.449074 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3108e-61af-4bde-b6c2-20eca84f2e93 service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:12.449387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff394d1-0fa4-4c16-8aa9-8f0e1c68e1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:12.449536 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3108e-61af-4bde-b6c2-20eca84f2e93 service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:12.449915 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3108e-61af-4bde-b6c2-20eca84f2e93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:12.450267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff394d1-0fa4-4c16-8aa9-8f0e1c68e1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:12.450558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff394d1-0fa4-4c16-8aa9-8f0e1c68e1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:12.450870 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff394d1-0fa4-4c16-8aa9-8f0e1c68e1a4 admin admin] PATH_INFO: `/v3/users/713e3f20f94849c5bb6b88ba5af39868` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:12.452312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff394d1-0fa4-4c16-8aa9-8f0e1c68e1a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=713e3f20f94849c5bb6b88ba5af39868)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:12.452584 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a6c3108e-61af-4bde-b6c2-20eca84f2e93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:12.454910 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff394d1-0fa4-4c16-8aa9-8f0e1c68e1a4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:12.469600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3108e-61af-4bde-b6c2-20eca84f2e93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:12.471492 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3108e-61af-4bde-b6c2-20eca84f2e93 service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:12.478830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:12.492264 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1212/2450] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:12.551459 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-dff394d1-0fa4-4c16-8aa9-8f0e1c68e1a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713e3f20f94849c5bb6b88ba5af39868'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:12.570173 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-dff394d1-0fa4-4c16-8aa9-8f0e1c68e1a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713e3f20f94849c5bb6b88ba5af39868'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:12.571036 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-dff394d1-0fa4-4c16-8aa9-8f0e1c68e1a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713e3f20f94849c5bb6b88ba5af39868'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:12.581177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-dff394d1-0fa4-4c16-8aa9-8f0e1c68e1a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713e3f20f94849c5bb6b88ba5af39868'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:12.582083 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-dff394d1-0fa4-4c16-8aa9-8f0e1c68e1a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713e3f20f94849c5bb6b88ba5af39868'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:12.602701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1239/2451] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:12 2022] DELETE /identity/v3/users/713e3f20f94849c5bb6b88ba5af39868 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:12.973556 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3108e-61af-4bde-b6c2-20eca84f2e93 service placement] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:12.995764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3108e-61af-4bde-b6c2-20eca84f2e93 service placement] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:13.122229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e11625-9902-479b-b1b0-7951524151bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:13.124033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e11625-9902-479b-b1b0-7951524151bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:13.124605 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e11625-9902-479b-b1b0-7951524151bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:13.125168 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e11625-9902-479b-b1b0-7951524151bf admin admin] PATH_INFO: `/v3/projects/ae85b68d75094b0f8ae94a86c4b1f36e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:13.127485 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e11625-9902-479b-b1b0-7951524151bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae85b68d75094b0f8ae94a86c4b1f36e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:13.130333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e11625-9902-479b-b1b0-7951524151bf admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:13.211354 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f8e11625-9902-479b-b1b0-7951524151bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae85b68d75094b0f8ae94a86c4b1f36e', 'request_id': 'req-f8e11625-9902-479b-b1b0-7951524151bf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:13.224097 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f8e11625-9902-479b-b1b0-7951524151bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae85b68d75094b0f8ae94a86c4b1f36e', 'request_id': 'req-f8e11625-9902-479b-b1b0-7951524151bf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:13.241656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f8e11625-9902-479b-b1b0-7951524151bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae85b68d75094b0f8ae94a86c4b1f36e', 'request_id': 'req-f8e11625-9902-479b-b1b0-7951524151bf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:13.257978 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f8e11625-9902-479b-b1b0-7951524151bf admin admin] The token cache is being invalidate because project ae85b68d75094b0f8ae94a86c4b1f36e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:13.259212 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f8e11625-9902-479b-b1b0-7951524151bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:13.260040 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f8e11625-9902-479b-b1b0-7951524151bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:13.262473 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1213/2452] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:12 2022] DELETE /identity/v3/projects/ae85b68d75094b0f8ae94a86c4b1f36e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:13.269516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414a773-d54c-4789-a123-aaf5c83404af None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:13.269813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414a773-d54c-4789-a123-aaf5c83404af None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:13.270105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414a773-d54c-4789-a123-aaf5c83404af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:13.295096 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9414a773-d54c-4789-a123-aaf5c83404af None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:13.296595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9414a773-d54c-4789-a123-aaf5c83404af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:13.338097 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:13.405286 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1240/2453] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:13.413825 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547be6f6-c7c3-4a93-9cee-0b30692e16b0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:13.414939 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547be6f6-c7c3-4a93-9cee-0b30692e16b0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:13.415401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547be6f6-c7c3-4a93-9cee-0b30692e16b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:13.436571 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-547be6f6-c7c3-4a93-9cee-0b30692e16b0 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:13.437813 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-547be6f6-c7c3-4a93-9cee-0b30692e16b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:13.450419 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1214/2454] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:13.452226 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414a773-d54c-4789-a123-aaf5c83404af None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:13.463282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414a773-d54c-4789-a123-aaf5c83404af None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:13.468790 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9acc2-88b4-4032-b521-72c59fa133f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:13.470209 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9acc2-88b4-4032-b521-72c59fa133f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:13.471179 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9acc2-88b4-4032-b521-72c59fa133f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:13.471840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9acc2-88b4-4032-b521-72c59fa133f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:13.472941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9acc2-88b4-4032-b521-72c59fa133f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:49:13.473487 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9acc2-88b4-4032-b521-72c59fa133f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:13.476181 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9acc2-88b4-4032-b521-72c59fa133f7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:13.492030 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1241/2455] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:49:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:49:13.496279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547be6f6-c7c3-4a93-9cee-0b30692e16b0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:13.508401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547be6f6-c7c3-4a93-9cee-0b30692e16b0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:13.513350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace4dde-6adb-48eb-ae2d-a1d9029c72ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:13.514020 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace4dde-6adb-48eb-ae2d-a1d9029c72ec admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:13.514304 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace4dde-6adb-48eb-ae2d-a1d9029c72ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:13.514596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace4dde-6adb-48eb-ae2d-a1d9029c72ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:13.515399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace4dde-6adb-48eb-ae2d-a1d9029c72ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:13.517482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace4dde-6adb-48eb-ae2d-a1d9029c72ec admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:13.564145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1215/2456] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:13 2022] POST /identity/v3/projects => generated 406 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:13.567721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9acc2-88b4-4032-b521-72c59fa133f7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:13.579882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9acc2-88b4-4032-b521-72c59fa133f7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:13.649442 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32daf2-1baf-4ba0-b0e4-9e4ba8b7c6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:13.650192 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32daf2-1baf-4ba0-b0e4-9e4ba8b7c6cb admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:13.650512 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32daf2-1baf-4ba0-b0e4-9e4ba8b7c6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:13.650906 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32daf2-1baf-4ba0-b0e4-9e4ba8b7c6cb admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:13.651676 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32daf2-1baf-4ba0-b0e4-9e4ba8b7c6cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:13.653823 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32daf2-1baf-4ba0-b0e4-9e4ba8b7c6cb admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:13.679904 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1242/2457] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:13 2022] POST /identity/v3/users => generated 304 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:13.684067 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace4dde-6adb-48eb-ae2d-a1d9029c72ec admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:13.695566 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace4dde-6adb-48eb-ae2d-a1d9029c72ec admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:13.700611 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae0d0b-1313-4454-a3ad-3baaeb36ba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:13.701411 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae0d0b-1313-4454-a3ad-3baaeb36ba0f admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:13.701763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae0d0b-1313-4454-a3ad-3baaeb36ba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:13.702114 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae0d0b-1313-4454-a3ad-3baaeb36ba0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:13.702962 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae0d0b-1313-4454-a3ad-3baaeb36ba0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:13.704792 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae0d0b-1313-4454-a3ad-3baaeb36ba0f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:13.716959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1216/2458] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:13 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:13.722431 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32daf2-1baf-4ba0-b0e4-9e4ba8b7c6cb admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:13.732462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32daf2-1baf-4ba0-b0e4-9e4ba8b7c6cb admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:13.737792 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0e954-9088-4bf4-a911-19a5210d4936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:13.738468 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0e954-9088-4bf4-a911-19a5210d4936 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:13.738809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0e954-9088-4bf4-a911-19a5210d4936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:13.739089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0e954-9088-4bf4-a911-19a5210d4936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:13.739822 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0e954-9088-4bf4-a911-19a5210d4936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:13.750806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0e954-9088-4bf4-a911-19a5210d4936 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:13.762610 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1243/2459] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:13 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:13.766106 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae0d0b-1313-4454-a3ad-3baaeb36ba0f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:13.776453 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae0d0b-1313-4454-a3ad-3baaeb36ba0f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:13.782557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6a6f4-da23-4411-b63d-3929a618a4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:13.783507 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6a6f4-da23-4411-b63d-3929a618a4d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:13.783796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6a6f4-da23-4411-b63d-3929a618a4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:13.784075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6a6f4-da23-4411-b63d-3929a618a4d9 admin admin] PATH_INFO: `/v3/projects/0db891df92dd40cf846b971b590b9e2e/users/a81bc8de237e44da9aee3c5e62377ea0/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:13.801803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6a6f4-da23-4411-b63d-3929a618a4d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0db891df92dd40cf846b971b590b9e2e, user_id=a81bc8de237e44da9aee3c5e62377ea0, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:13.804579 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6a6f4-da23-4411-b63d-3929a618a4d9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:13.819865 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1217/2460] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:13 2022] PUT /identity/v3/projects/0db891df92dd40cf846b971b590b9e2e/users/a81bc8de237e44da9aee3c5e62377ea0/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:13.824950 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72276d10-99cb-46db-a162-c9de73c4a935 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:13.825245 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72276d10-99cb-46db-a162-c9de73c4a935 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:13.825526 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72276d10-99cb-46db-a162-c9de73c4a935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:13.846302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-72276d10-99cb-46db-a162-c9de73c4a935 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:13.847583 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-72276d10-99cb-46db-a162-c9de73c4a935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:13.913798 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1244/2461] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:13.924298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6a6f4-da23-4411-b63d-3929a618a4d9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:13.926047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e8e6a6f4-da23-4411-b63d-3929a618a4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:13.948691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:13.993078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6a6f4-da23-4411-b63d-3929a618a4d9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:13.997065 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a57e1d-a1bf-4d43-8ce9-857b1e459f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:13.997746 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a57e1d-a1bf-4d43-8ce9-857b1e459f54 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:13.998034 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a57e1d-a1bf-4d43-8ce9-857b1e459f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:13.998315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a57e1d-a1bf-4d43-8ce9-857b1e459f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:14.008589 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a57e1d-a1bf-4d43-8ce9-857b1e459f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:14.010043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a57e1d-a1bf-4d43-8ce9-857b1e459f54 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:14.025196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1218/2462] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:14.309271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72276d10-99cb-46db-a162-c9de73c4a935 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:14.313401 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-72276d10-99cb-46db-a162-c9de73c4a935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:14.333094 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72276d10-99cb-46db-a162-c9de73c4a935 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:14.337087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45386c7d-8dc9-4f45-a1b5-99fdf695d3b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:14.338166 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45386c7d-8dc9-4f45-a1b5-99fdf695d3b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:14.338664 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45386c7d-8dc9-4f45-a1b5-99fdf695d3b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:14.339111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45386c7d-8dc9-4f45-a1b5-99fdf695d3b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:14.341280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-45386c7d-8dc9-4f45-a1b5-99fdf695d3b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:14.371215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45386c7d-8dc9-4f45-a1b5-99fdf695d3b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:14.375439 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45386c7d-8dc9-4f45-a1b5-99fdf695d3b7 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:14.391582 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1245/2463] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:15.418227 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c266a-8a01-400a-9eb1-cb6eaba4fd5e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:15.418835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c266a-8a01-400a-9eb1-cb6eaba4fd5e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:15.419175 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c266a-8a01-400a-9eb1-cb6eaba4fd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:15.452841 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4e4c266a-8a01-400a-9eb1-cb6eaba4fd5e None None] MFA Rules not processed for user `a81bc8de237e44da9aee3c5e62377ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:15.454702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4e4c266a-8a01-400a-9eb1-cb6eaba4fd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:15.576616 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1219/2464] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:15 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:15.582866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45386c7d-8dc9-4f45-a1b5-99fdf695d3b7 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:15.601745 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45386c7d-8dc9-4f45-a1b5-99fdf695d3b7 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:15.608168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e640b-543c-468f-b4d5-6c3de512c0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:15.609166 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e640b-543c-468f-b4d5-6c3de512c0ac admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:15.609627 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e640b-543c-468f-b4d5-6c3de512c0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:15.610743 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e640b-543c-468f-b4d5-6c3de512c0ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:15.612292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e640b-543c-468f-b4d5-6c3de512c0ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:15.614631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e640b-543c-468f-b4d5-6c3de512c0ac admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:15.644100 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1246/2465] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:15 2022] POST /identity/v3/projects => generated 404 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:15.648049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c266a-8a01-400a-9eb1-cb6eaba4fd5e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:15.661687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c266a-8a01-400a-9eb1-cb6eaba4fd5e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:15.773439 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7f1c2-93b9-4747-9eef-99a52aad6c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:15.774198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7f1c2-93b9-4747-9eef-99a52aad6c73 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:15.774534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7f1c2-93b9-4747-9eef-99a52aad6c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:15.774838 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7f1c2-93b9-4747-9eef-99a52aad6c73 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:15.779747 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7f1c2-93b9-4747-9eef-99a52aad6c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:15.781980 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7f1c2-93b9-4747-9eef-99a52aad6c73 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:15.809338 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1220/2466] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:15 2022] POST /identity/v3/users => generated 309 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:15.810613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e640b-543c-468f-b4d5-6c3de512c0ac admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:15.820362 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:15.826817 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e640b-543c-468f-b4d5-6c3de512c0ac admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:15.832546 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38922a4d-e3a7-47ab-9d21-d8dcc27f0443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:15.833906 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38922a4d-e3a7-47ab-9d21-d8dcc27f0443 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:15.835195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38922a4d-e3a7-47ab-9d21-d8dcc27f0443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:15.835419 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38922a4d-e3a7-47ab-9d21-d8dcc27f0443 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:15.836378 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38922a4d-e3a7-47ab-9d21-d8dcc27f0443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:15.839002 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38922a4d-e3a7-47ab-9d21-d8dcc27f0443 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:15.854624 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1247/2467] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:15 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:15.858871 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7f1c2-93b9-4747-9eef-99a52aad6c73 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:15.875222 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7f1c2-93b9-4747-9eef-99a52aad6c73 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:15.888294 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2cc39-32a4-439c-a8de-1905965f8b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:15.893564 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2cc39-32a4-439c-a8de-1905965f8b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:15.895191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2cc39-32a4-439c-a8de-1905965f8b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:15.895927 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2cc39-32a4-439c-a8de-1905965f8b29 admin admin] PATH_INFO: `/v3/projects/63f7dfcc94b64f38841c56565f6419f0/users/25b187632d2c4ea0a11ab1a511e3c3b5/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:15.930284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2cc39-32a4-439c-a8de-1905965f8b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f7dfcc94b64f38841c56565f6419f0, user_id=25b187632d2c4ea0a11ab1a511e3c3b5, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:15.934868 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2cc39-32a4-439c-a8de-1905965f8b29 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:15.956661 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1221/2468] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:15 2022] PUT /identity/v3/projects/63f7dfcc94b64f38841c56565f6419f0/users/25b187632d2c4ea0a11ab1a511e3c3b5/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:15.960746 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38922a4d-e3a7-47ab-9d21-d8dcc27f0443 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:15.983465 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38922a4d-e3a7-47ab-9d21-d8dcc27f0443 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:16.119394 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af154c-43af-472b-81fd-3ab1cc72253e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:16.120168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af154c-43af-472b-81fd-3ab1cc72253e admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:16.120685 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af154c-43af-472b-81fd-3ab1cc72253e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:16.121501 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af154c-43af-472b-81fd-3ab1cc72253e admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:16.124220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af154c-43af-472b-81fd-3ab1cc72253e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:16.125990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af154c-43af-472b-81fd-3ab1cc72253e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:16.149011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1248/2469] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:15 2022] GET /identity/v3/roles => generated 1427 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:16.150381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2cc39-32a4-439c-a8de-1905965f8b29 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:16.169054 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2cc39-32a4-439c-a8de-1905965f8b29 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:16.181690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbf4c9-3415-400b-a54c-e0a02ccad59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:16.182512 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbf4c9-3415-400b-a54c-e0a02ccad59a admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:16.182830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbf4c9-3415-400b-a54c-e0a02ccad59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:16.183114 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbf4c9-3415-400b-a54c-e0a02ccad59a admin admin] PATH_INFO: `/v3/projects/63f7dfcc94b64f38841c56565f6419f0/users/25b187632d2c4ea0a11ab1a511e3c3b5/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:16.199665 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbbf4c9-3415-400b-a54c-e0a02ccad59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f7dfcc94b64f38841c56565f6419f0, user_id=25b187632d2c4ea0a11ab1a511e3c3b5, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:16.202880 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbbf4c9-3415-400b-a54c-e0a02ccad59a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:16.214098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:16.229593 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1222/2470] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:16 2022] PUT /identity/v3/projects/63f7dfcc94b64f38841c56565f6419f0/users/25b187632d2c4ea0a11ab1a511e3c3b5/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:17.314870 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ed08f-1cd6-4d64-b177-885d58cb3256 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.315440 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ed08f-1cd6-4d64-b177-885d58cb3256 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.315614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ed08f-1cd6-4d64-b177-885d58cb3256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.376373 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-326ed08f-1cd6-4d64-b177-885d58cb3256 None None] MFA Rules not processed for user `25b187632d2c4ea0a11ab1a511e3c3b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:17.377669 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-326ed08f-1cd6-4d64-b177-885d58cb3256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:17.599216 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1249/2471] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:17 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:19.755477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbf4c9-3415-400b-a54c-e0a02ccad59a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:19.833664 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbf4c9-3415-400b-a54c-e0a02ccad59a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:19.838662 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75949d9-7b57-4d81-adb8-12257c83ab81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:19.839560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75949d9-7b57-4d81-adb8-12257c83ab81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:19.839848 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75949d9-7b57-4d81-adb8-12257c83ab81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:19.840131 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75949d9-7b57-4d81-adb8-12257c83ab81 admin admin] PATH_INFO: `/v3/users/a81bc8de237e44da9aee3c5e62377ea0` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:19.841403 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75949d9-7b57-4d81-adb8-12257c83ab81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a81bc8de237e44da9aee3c5e62377ea0)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:19.843497 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75949d9-7b57-4d81-adb8-12257c83ab81 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:19.895797 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b75949d9-7b57-4d81-adb8-12257c83ab81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a81bc8de237e44da9aee3c5e62377ea0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:19.896467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b75949d9-7b57-4d81-adb8-12257c83ab81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a81bc8de237e44da9aee3c5e62377ea0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:19.904214 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b75949d9-7b57-4d81-adb8-12257c83ab81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a81bc8de237e44da9aee3c5e62377ea0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:19.904954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b75949d9-7b57-4d81-adb8-12257c83ab81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a81bc8de237e44da9aee3c5e62377ea0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:19.913289 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b75949d9-7b57-4d81-adb8-12257c83ab81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a81bc8de237e44da9aee3c5e62377ea0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:19.934884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1223/2472] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:19 2022] DELETE /identity/v3/users/a81bc8de237e44da9aee3c5e62377ea0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:20.012646 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ed08f-1cd6-4d64-b177-885d58cb3256 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:20.019160 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-326ed08f-1cd6-4d64-b177-885d58cb3256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:20.035987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ed08f-1cd6-4d64-b177-885d58cb3256 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:20.116875 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8d177-71c1-4757-a317-a9eff9c2bbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:20.117825 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8d177-71c1-4757-a317-a9eff9c2bbdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:20.118174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8d177-71c1-4757-a317-a9eff9c2bbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:20.118471 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8d177-71c1-4757-a317-a9eff9c2bbdf admin admin] PATH_INFO: `/v3/users/01d3da9345ed40f396730e41ccdda091` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:20.119942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8d177-71c1-4757-a317-a9eff9c2bbdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=01d3da9345ed40f396730e41ccdda091)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:20.122053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8d177-71c1-4757-a317-a9eff9c2bbdf admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:20.144038 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:20.151764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75949d9-7b57-4d81-adb8-12257c83ab81 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:20.153491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b75949d9-7b57-4d81-adb8-12257c83ab81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:20.169715 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75949d9-7b57-4d81-adb8-12257c83ab81 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:20.178358 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec105a-176b-47f4-812a-e2b1dedd92ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:20.179292 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec105a-176b-47f4-812a-e2b1dedd92ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:20.179579 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec105a-176b-47f4-812a-e2b1dedd92ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:20.179918 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec105a-176b-47f4-812a-e2b1dedd92ac admin admin] PATH_INFO: `/v3/projects/0db891df92dd40cf846b971b590b9e2e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:20.181296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec105a-176b-47f4-812a-e2b1dedd92ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=0db891df92dd40cf846b971b590b9e2e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:20.183353 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec105a-176b-47f4-812a-e2b1dedd92ac admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:20.212728 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1dc8d177-71c1-4757-a317-a9eff9c2bbdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01d3da9345ed40f396730e41ccdda091'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.231354 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1dc8d177-71c1-4757-a317-a9eff9c2bbdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01d3da9345ed40f396730e41ccdda091'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.232139 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1dc8d177-71c1-4757-a317-a9eff9c2bbdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01d3da9345ed40f396730e41ccdda091'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.243318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1dc8d177-71c1-4757-a317-a9eff9c2bbdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01d3da9345ed40f396730e41ccdda091'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.243939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1dc8d177-71c1-4757-a317-a9eff9c2bbdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01d3da9345ed40f396730e41ccdda091'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.269846 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1250/2473] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:20 2022] DELETE /identity/v3/users/01d3da9345ed40f396730e41ccdda091 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:20.277126 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-75ec105a-176b-47f4-812a-e2b1dedd92ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0db891df92dd40cf846b971b590b9e2e', 'request_id': 'req-75ec105a-176b-47f4-812a-e2b1dedd92ac'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.285939 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-75ec105a-176b-47f4-812a-e2b1dedd92ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0db891df92dd40cf846b971b590b9e2e', 'request_id': 'req-75ec105a-176b-47f4-812a-e2b1dedd92ac'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.294897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-75ec105a-176b-47f4-812a-e2b1dedd92ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0db891df92dd40cf846b971b590b9e2e', 'request_id': 'req-75ec105a-176b-47f4-812a-e2b1dedd92ac'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.307825 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-75ec105a-176b-47f4-812a-e2b1dedd92ac admin admin] The token cache is being invalidate because project 0db891df92dd40cf846b971b590b9e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:20.308111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-75ec105a-176b-47f4-812a-e2b1dedd92ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.308843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-75ec105a-176b-47f4-812a-e2b1dedd92ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.310754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1224/2474] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:20 2022] DELETE /identity/v3/projects/0db891df92dd40cf846b971b590b9e2e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:20.320551 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8d177-71c1-4757-a317-a9eff9c2bbdf admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:20.322831 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1dc8d177-71c1-4757-a317-a9eff9c2bbdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:20.408262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8d177-71c1-4757-a317-a9eff9c2bbdf admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:20.413215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427f4ee-1e2f-4136-bc8c-d9e6062a52e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:20.414416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427f4ee-1e2f-4136-bc8c-d9e6062a52e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:20.414742 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427f4ee-1e2f-4136-bc8c-d9e6062a52e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:20.415032 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427f4ee-1e2f-4136-bc8c-d9e6062a52e8 admin admin] PATH_INFO: `/v3/users/25b187632d2c4ea0a11ab1a511e3c3b5` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:20.416292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427f4ee-1e2f-4136-bc8c-d9e6062a52e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25b187632d2c4ea0a11ab1a511e3c3b5)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:20.418257 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427f4ee-1e2f-4136-bc8c-d9e6062a52e8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:20.480110 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec105a-176b-47f4-812a-e2b1dedd92ac admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:20.481601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-75ec105a-176b-47f4-812a-e2b1dedd92ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:20.483282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2427f4ee-1e2f-4136-bc8c-d9e6062a52e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b187632d2c4ea0a11ab1a511e3c3b5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.488371 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:20.507119 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2427f4ee-1e2f-4136-bc8c-d9e6062a52e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b187632d2c4ea0a11ab1a511e3c3b5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.507905 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2427f4ee-1e2f-4136-bc8c-d9e6062a52e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b187632d2c4ea0a11ab1a511e3c3b5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.519586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2427f4ee-1e2f-4136-bc8c-d9e6062a52e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b187632d2c4ea0a11ab1a511e3c3b5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.520223 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2427f4ee-1e2f-4136-bc8c-d9e6062a52e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b187632d2c4ea0a11ab1a511e3c3b5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.536164 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1251/2475] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:20 2022] DELETE /identity/v3/users/25b187632d2c4ea0a11ab1a511e3c3b5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:20.578669 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec105a-176b-47f4-812a-e2b1dedd92ac admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:20.666793 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3a221-26a2-4daa-8ce6-e810a4881621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:20.668056 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3a221-26a2-4daa-8ce6-e810a4881621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:20.668716 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3a221-26a2-4daa-8ce6-e810a4881621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:20.669083 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3a221-26a2-4daa-8ce6-e810a4881621 admin admin] PATH_INFO: `/v3/projects/978e25a00d4e49a6839459aa85972998` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:20.670960 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3a221-26a2-4daa-8ce6-e810a4881621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=978e25a00d4e49a6839459aa85972998)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:20.674058 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3a221-26a2-4daa-8ce6-e810a4881621 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:20.732423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cfd3a221-26a2-4daa-8ce6-e810a4881621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978e25a00d4e49a6839459aa85972998', 'request_id': 'req-cfd3a221-26a2-4daa-8ce6-e810a4881621'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.739809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427f4ee-1e2f-4136-bc8c-d9e6062a52e8 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:20.741501 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2427f4ee-1e2f-4136-bc8c-d9e6062a52e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:20.743459 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cfd3a221-26a2-4daa-8ce6-e810a4881621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978e25a00d4e49a6839459aa85972998', 'request_id': 'req-cfd3a221-26a2-4daa-8ce6-e810a4881621'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.753464 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cfd3a221-26a2-4daa-8ce6-e810a4881621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978e25a00d4e49a6839459aa85972998', 'request_id': 'req-cfd3a221-26a2-4daa-8ce6-e810a4881621'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.756341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427f4ee-1e2f-4136-bc8c-d9e6062a52e8 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:20.769052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:20.771927 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cfd3a221-26a2-4daa-8ce6-e810a4881621 admin admin] The token cache is being invalidate because project 978e25a00d4e49a6839459aa85972998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:20.772396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cfd3a221-26a2-4daa-8ce6-e810a4881621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.772905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cfd3a221-26a2-4daa-8ce6-e810a4881621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.775374 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1225/2476] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:20 2022] DELETE /identity/v3/projects/978e25a00d4e49a6839459aa85972998 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:20.785336 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d6de9-3beb-4362-9bec-d2021d7b91b0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:20.785764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d6de9-3beb-4362-9bec-d2021d7b91b0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:20.786120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d6de9-3beb-4362-9bec-d2021d7b91b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:20.805084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-004d6de9-3beb-4362-9bec-d2021d7b91b0 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:20.806412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-004d6de9-3beb-4362-9bec-d2021d7b91b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:20.833505 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b872eba-c630-4dd6-8708-69f084c43989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:20.834405 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b872eba-c630-4dd6-8708-69f084c43989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:20.835060 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b872eba-c630-4dd6-8708-69f084c43989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:20.835060 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b872eba-c630-4dd6-8708-69f084c43989 admin admin] PATH_INFO: `/v3/projects/63f7dfcc94b64f38841c56565f6419f0` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:20.836792 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b872eba-c630-4dd6-8708-69f084c43989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f7dfcc94b64f38841c56565f6419f0)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:20.838795 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b872eba-c630-4dd6-8708-69f084c43989 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:20.844698 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:20.875142 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1226/2477] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:20.883486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c4776-766c-4482-b856-433e31d78b42 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:20.883863 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c4776-766c-4482-b856-433e31d78b42 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:20.884203 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c4776-766c-4482-b856-433e31d78b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:20.890225 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8b872eba-c630-4dd6-8708-69f084c43989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f7dfcc94b64f38841c56565f6419f0', 'request_id': 'req-8b872eba-c630-4dd6-8708-69f084c43989'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.900327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8b872eba-c630-4dd6-8708-69f084c43989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f7dfcc94b64f38841c56565f6419f0', 'request_id': 'req-8b872eba-c630-4dd6-8708-69f084c43989'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.903912 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-138c4776-766c-4482-b856-433e31d78b42 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:20.905128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-138c4776-766c-4482-b856-433e31d78b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:20.908688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8b872eba-c630-4dd6-8708-69f084c43989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f7dfcc94b64f38841c56565f6419f0', 'request_id': 'req-8b872eba-c630-4dd6-8708-69f084c43989'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.922775 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8b872eba-c630-4dd6-8708-69f084c43989 admin admin] The token cache is being invalidate because project 63f7dfcc94b64f38841c56565f6419f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:20.923062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8b872eba-c630-4dd6-8708-69f084c43989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.923705 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8b872eba-c630-4dd6-8708-69f084c43989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.925268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1252/2478] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:20 2022] DELETE /identity/v3/projects/63f7dfcc94b64f38841c56565f6419f0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:20.930842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b36ef-d155-444d-b9b6-14df64bff01c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:20.930842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b36ef-d155-444d-b9b6-14df64bff01c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:20.930842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b36ef-d155-444d-b9b6-14df64bff01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:20.948972 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9e7b36ef-d155-444d-b9b6-14df64bff01c None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:20.950195 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9e7b36ef-d155-444d-b9b6-14df64bff01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:20.972727 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1227/2479] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:20.977106 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c4776-766c-4482-b856-433e31d78b42 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:20.988028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c4776-766c-4482-b856-433e31d78b42 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:20.994367 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cef6b2-388b-4ef6-85f4-4f2bf463b20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:20.995426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cef6b2-388b-4ef6-85f4-4f2bf463b20b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:20.995954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cef6b2-388b-4ef6-85f4-4f2bf463b20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:20.996449 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cef6b2-388b-4ef6-85f4-4f2bf463b20b admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:20.997703 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cef6b2-388b-4ef6-85f4-4f2bf463b20b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:49:20.998024 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cef6b2-388b-4ef6-85f4-4f2bf463b20b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.000244 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cef6b2-388b-4ef6-85f4-4f2bf463b20b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.015957 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1228/2480] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:49:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:49:21.019925 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cef6b2-388b-4ef6-85f4-4f2bf463b20b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.026491 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1253/2481] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:21.030772 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cef6b2-388b-4ef6-85f4-4f2bf463b20b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.035205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494281b-9504-441f-921e-bc295eec36ab None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.035495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494281b-9504-441f-921e-bc295eec36ab None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.035868 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494281b-9504-441f-921e-bc295eec36ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.036366 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba6c1b-d619-40ea-aa14-e835065bc205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.037055 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba6c1b-d619-40ea-aa14-e835065bc205 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.037339 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba6c1b-d619-40ea-aa14-e835065bc205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.037619 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba6c1b-d619-40ea-aa14-e835065bc205 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.038298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba6c1b-d619-40ea-aa14-e835065bc205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.040499 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba6c1b-d619-40ea-aa14-e835065bc205 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.056084 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c494281b-9504-441f-921e-bc295eec36ab None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:21.057284 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c494281b-9504-441f-921e-bc295eec36ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:21.065388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1254/2482] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:21.067568 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1229/2483] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:21 2022] POST /identity/v3/projects => generated 374 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:21.069591 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494281b-9504-441f-921e-bc295eec36ab None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.072230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba6c1b-d619-40ea-aa14-e835065bc205 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.079485 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494281b-9504-441f-921e-bc295eec36ab None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.113446 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:21.135951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba6c1b-d619-40ea-aa14-e835065bc205 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.139137 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74110ae3-d435-4ee8-9d8d-5328be1ceeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.139874 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74110ae3-d435-4ee8-9d8d-5328be1ceeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.140298 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74110ae3-d435-4ee8-9d8d-5328be1ceeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.141140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74110ae3-d435-4ee8-9d8d-5328be1ceeb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.141270 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b39a2d-b559-4414-a82f-1376248f84d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.141916 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b39a2d-b559-4414-a82f-1376248f84d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.142077 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74110ae3-d435-4ee8-9d8d-5328be1ceeb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:49:21.142188 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b39a2d-b559-4414-a82f-1376248f84d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.142455 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b39a2d-b559-4414-a82f-1376248f84d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.142563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74110ae3-d435-4ee8-9d8d-5328be1ceeb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.143164 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b39a2d-b559-4414-a82f-1376248f84d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.144340 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74110ae3-d435-4ee8-9d8d-5328be1ceeb7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.145051 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b39a2d-b559-4414-a82f-1376248f84d6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.156082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1255/2484] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:49:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:49:21.160693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74110ae3-d435-4ee8-9d8d-5328be1ceeb7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.170011 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1230/2485] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:21 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:21.170990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74110ae3-d435-4ee8-9d8d-5328be1ceeb7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.171173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b39a2d-b559-4414-a82f-1376248f84d6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.175666 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfeb1e1-bed6-43ff-9226-be82622a1696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.176317 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeb1e1-bed6-43ff-9226-be82622a1696 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.176609 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeb1e1-bed6-43ff-9226-be82622a1696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.176883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeb1e1-bed6-43ff-9226-be82622a1696 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.177576 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfeb1e1-bed6-43ff-9226-be82622a1696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.179623 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfeb1e1-bed6-43ff-9226-be82622a1696 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.181481 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b39a2d-b559-4414-a82f-1376248f84d6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.186838 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83274b99-c186-434c-bec9-aa80a69c2190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.188037 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83274b99-c186-434c-bec9-aa80a69c2190 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.188323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83274b99-c186-434c-bec9-aa80a69c2190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.188632 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83274b99-c186-434c-bec9-aa80a69c2190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.189819 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83274b99-c186-434c-bec9-aa80a69c2190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.191834 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83274b99-c186-434c-bec9-aa80a69c2190 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.202622 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1231/2486] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:21 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:21.207401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83274b99-c186-434c-bec9-aa80a69c2190 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.208472 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1256/2487] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:21 2022] POST /identity/v3/projects => generated 366 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:21.212552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfeb1e1-bed6-43ff-9226-be82622a1696 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.217471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83274b99-c186-434c-bec9-aa80a69c2190 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.240223 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:21.279356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075aedb-80dc-408d-bdf1-1a8ae8078f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.280035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075aedb-80dc-408d-bdf1-1a8ae8078f95 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.280315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075aedb-80dc-408d-bdf1-1a8ae8078f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.280589 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075aedb-80dc-408d-bdf1-1a8ae8078f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.281339 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075aedb-80dc-408d-bdf1-1a8ae8078f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.282992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075aedb-80dc-408d-bdf1-1a8ae8078f95 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.283939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfeb1e1-bed6-43ff-9226-be82622a1696 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.288904 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae070a86-6a40-4199-aabc-7ff6629cd2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.289573 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae070a86-6a40-4199-aabc-7ff6629cd2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.289878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae070a86-6a40-4199-aabc-7ff6629cd2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.290147 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae070a86-6a40-4199-aabc-7ff6629cd2e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.290913 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae070a86-6a40-4199-aabc-7ff6629cd2e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.292838 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae070a86-6a40-4199-aabc-7ff6629cd2e0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.294177 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1232/2488] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:21 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:21.298594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075aedb-80dc-408d-bdf1-1a8ae8078f95 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.309775 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075aedb-80dc-408d-bdf1-1a8ae8078f95 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.317306 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1257/2489] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:21 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:21.317480 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb5fdb-4492-42a6-bc82-d4fd36a58634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.318786 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae070a86-6a40-4199-aabc-7ff6629cd2e0 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.318900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb5fdb-4492-42a6-bc82-d4fd36a58634 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.319448 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb5fdb-4492-42a6-bc82-d4fd36a58634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.319923 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb5fdb-4492-42a6-bc82-d4fd36a58634 admin admin] PATH_INFO: `/v3/projects/1ce14d7d08c842d78dd3b5795ce4b2be/users/c389e76c18d04c8bba7bdb6c703d0baa/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.335330 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae070a86-6a40-4199-aabc-7ff6629cd2e0 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.340208 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb5fdb-4492-42a6-bc82-d4fd36a58634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce14d7d08c842d78dd3b5795ce4b2be, user_id=c389e76c18d04c8bba7bdb6c703d0baa, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.342939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dd55b-f4cf-4032-ab84-57050f343dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.343157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb5fdb-4492-42a6-bc82-d4fd36a58634 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.344052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dd55b-f4cf-4032-ab84-57050f343dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.344540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dd55b-f4cf-4032-ab84-57050f343dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.345024 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dd55b-f4cf-4032-ab84-57050f343dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.346308 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dd55b-f4cf-4032-ab84-57050f343dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.349254 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dd55b-f4cf-4032-ab84-57050f343dc5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.357980 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1233/2490] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:21 2022] PUT /identity/v3/projects/1ce14d7d08c842d78dd3b5795ce4b2be/users/c389e76c18d04c8bba7bdb6c703d0baa/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:21.368145 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1258/2491] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:21 2022] GET /identity/v3/roles => generated 1427 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:21.371926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff44422-16dc-4415-a982-145e3d50872d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.372221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff44422-16dc-4415-a982-145e3d50872d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.372506 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff44422-16dc-4415-a982-145e3d50872d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.375737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dd55b-f4cf-4032-ab84-57050f343dc5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.387525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dd55b-f4cf-4032-ab84-57050f343dc5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.400959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2ff44422-16dc-4415-a982-145e3d50872d None None] MFA Rules not processed for user `c389e76c18d04c8bba7bdb6c703d0baa`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:21.402072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2ff44422-16dc-4415-a982-145e3d50872d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:21.451277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24457270-a643-420d-9633-b35b3132dc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.452032 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24457270-a643-420d-9633-b35b3132dc61 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.452388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24457270-a643-420d-9633-b35b3132dc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.452734 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24457270-a643-420d-9633-b35b3132dc61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.454042 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24457270-a643-420d-9633-b35b3132dc61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.455710 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24457270-a643-420d-9633-b35b3132dc61 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.465949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1259/2492] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:21 2022] GET /identity/v3/roles => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:21.470221 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24457270-a643-420d-9633-b35b3132dc61 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.478641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1234/2493] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:21.479858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff44422-16dc-4415-a982-145e3d50872d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.485098 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24457270-a643-420d-9633-b35b3132dc61 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.490207 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5108a2-108c-4e76-9024-f750bccd6fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.491197 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5108a2-108c-4e76-9024-f750bccd6fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.491551 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5108a2-108c-4e76-9024-f750bccd6fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.492177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5108a2-108c-4e76-9024-f750bccd6fb6 admin admin] PATH_INFO: `/v3/projects/97bc3e0339654c558d373ded09524d88/users/ab72f420363b46b288f4e2a3a6e89508/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.492475 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff44422-16dc-4415-a982-145e3d50872d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.497187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86d430-a94a-4215-9ac2-239bfdd475c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.497859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86d430-a94a-4215-9ac2-239bfdd475c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.498148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86d430-a94a-4215-9ac2-239bfdd475c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.498434 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86d430-a94a-4215-9ac2-239bfdd475c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.499170 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86d430-a94a-4215-9ac2-239bfdd475c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.502263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86d430-a94a-4215-9ac2-239bfdd475c1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.509527 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5108a2-108c-4e76-9024-f750bccd6fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97bc3e0339654c558d373ded09524d88, user_id=ab72f420363b46b288f4e2a3a6e89508, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.512216 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5108a2-108c-4e76-9024-f750bccd6fb6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.523084 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:21.538251 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1260/2494] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:21 2022] PUT /identity/v3/projects/97bc3e0339654c558d373ded09524d88/users/ab72f420363b46b288f4e2a3a6e89508/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:21.538729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1235/2495] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:21 2022] POST /identity/v3/projects => generated 374 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:21.540152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86d430-a94a-4215-9ac2-239bfdd475c1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.540401 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d07b1-328b-4c3f-8c83-2069a5628161 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.540584 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d07b1-328b-4c3f-8c83-2069a5628161 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.540815 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d07b1-328b-4c3f-8c83-2069a5628161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.569776 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0e6d07b1-328b-4c3f-8c83-2069a5628161 None None] MFA Rules not processed for user `ab72f420363b46b288f4e2a3a6e89508`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:21.571155 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0e6d07b1-328b-4c3f-8c83-2069a5628161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:21.605708 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86d430-a94a-4215-9ac2-239bfdd475c1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.611394 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4393f-6fef-4907-9473-daa539f6e8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.612073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4393f-6fef-4907-9473-daa539f6e8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.612363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4393f-6fef-4907-9473-daa539f6e8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.612640 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4393f-6fef-4907-9473-daa539f6e8d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.613322 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4393f-6fef-4907-9473-daa539f6e8d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.615293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4393f-6fef-4907-9473-daa539f6e8d5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.624065 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:21.637960 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1236/2496] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:21 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:21.639149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1261/2497] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:21.642046 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4393f-6fef-4907-9473-daa539f6e8d5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.643366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d07b1-328b-4c3f-8c83-2069a5628161 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.652453 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4393f-6fef-4907-9473-daa539f6e8d5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.653602 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d07b1-328b-4c3f-8c83-2069a5628161 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.657537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4a21f-08f2-4e5e-8bfe-e1c870ad542d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.658235 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4a21f-08f2-4e5e-8bfe-e1c870ad542d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.658405 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ce854-74d7-416c-8862-0f08c627af59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.658540 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4a21f-08f2-4e5e-8bfe-e1c870ad542d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.658835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4a21f-08f2-4e5e-8bfe-e1c870ad542d admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.659103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ce854-74d7-416c-8862-0f08c627af59 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.659408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ce854-74d7-416c-8862-0f08c627af59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.659565 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4a21f-08f2-4e5e-8bfe-e1c870ad542d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.659669 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ce854-74d7-416c-8862-0f08c627af59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.660367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ce854-74d7-416c-8862-0f08c627af59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.661220 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4a21f-08f2-4e5e-8bfe-e1c870ad542d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.662270 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ce854-74d7-416c-8862-0f08c627af59 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.672662 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1237/2498] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:21 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:21.676747 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4a21f-08f2-4e5e-8bfe-e1c870ad542d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.686817 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4a21f-08f2-4e5e-8bfe-e1c870ad542d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.690272 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1262/2499] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:21 2022] POST /identity/v3/projects => generated 366 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:21.692070 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45963b-ad25-4650-9985-e71abd3b15c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.693190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45963b-ad25-4650-9985-e71abd3b15c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.693321 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45963b-ad25-4650-9985-e71abd3b15c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.693542 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45963b-ad25-4650-9985-e71abd3b15c2 admin admin] PATH_INFO: `/v3/projects/695cbc961f3e4f4e8397ce29863f70b2/users/2a2344b924024dfb9e3ef7c9c13d1434/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.694136 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ce854-74d7-416c-8862-0f08c627af59 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.708519 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45963b-ad25-4650-9985-e71abd3b15c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=695cbc961f3e4f4e8397ce29863f70b2, user_id=2a2344b924024dfb9e3ef7c9c13d1434, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.711233 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45963b-ad25-4650-9985-e71abd3b15c2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.725023 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1238/2500] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:21 2022] PUT /identity/v3/projects/695cbc961f3e4f4e8397ce29863f70b2/users/2a2344b924024dfb9e3ef7c9c13d1434/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:21.729019 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45963b-ad25-4650-9985-e71abd3b15c2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.758952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ce854-74d7-416c-8862-0f08c627af59 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.795855 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45963b-ad25-4650-9985-e71abd3b15c2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.801412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e3a1d-7a17-4686-9657-9a66cfa8dd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.802080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e3a1d-7a17-4686-9657-9a66cfa8dd5d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.802368 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e3a1d-7a17-4686-9657-9a66cfa8dd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.802754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e3a1d-7a17-4686-9657-9a66cfa8dd5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.803482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e3a1d-7a17-4686-9657-9a66cfa8dd5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.805087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e3a1d-7a17-4686-9657-9a66cfa8dd5d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.815739 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1239/2501] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:21 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:21.816926 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f86260-a312-4c9d-bb5d-110e4c94d6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.817641 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f86260-a312-4c9d-bb5d-110e4c94d6da admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.817929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f86260-a312-4c9d-bb5d-110e4c94d6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.818211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f86260-a312-4c9d-bb5d-110e4c94d6da admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.819068 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f86260-a312-4c9d-bb5d-110e4c94d6da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.819788 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e3a1d-7a17-4686-9657-9a66cfa8dd5d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.820993 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f86260-a312-4c9d-bb5d-110e4c94d6da admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.829378 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e3a1d-7a17-4686-9657-9a66cfa8dd5d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.834085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2acda-385a-4d7d-b852-988753bbe763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.834986 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2acda-385a-4d7d-b852-988753bbe763 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.835266 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2acda-385a-4d7d-b852-988753bbe763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.835546 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2acda-385a-4d7d-b852-988753bbe763 admin admin] PATH_INFO: `/v3/projects/695cbc961f3e4f4e8397ce29863f70b2/users/2a2344b924024dfb9e3ef7c9c13d1434/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.838920 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2acda-385a-4d7d-b852-988753bbe763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=695cbc961f3e4f4e8397ce29863f70b2, user_id=2a2344b924024dfb9e3ef7c9c13d1434, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.841564 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2acda-385a-4d7d-b852-988753bbe763 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.841731 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1263/2502] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:21 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:21.845612 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f86260-a312-4c9d-bb5d-110e4c94d6da admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.851611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:21.853481 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1240/2503] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:21 2022] PUT /identity/v3/projects/695cbc961f3e4f4e8397ce29863f70b2/users/2a2344b924024dfb9e3ef7c9c13d1434/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:21.856445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f86260-a312-4c9d-bb5d-110e4c94d6da admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.865404 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d451a-1e18-42eb-95fc-5b1277577d68 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.865777 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d451a-1e18-42eb-95fc-5b1277577d68 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.866072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d451a-1e18-42eb-95fc-5b1277577d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.892622 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-879d451a-1e18-42eb-95fc-5b1277577d68 None None] MFA Rules not processed for user `2a2344b924024dfb9e3ef7c9c13d1434`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:21.893845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-879d451a-1e18-42eb-95fc-5b1277577d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:21.917977 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee54bf1-3ee3-4a88-94b0-8e979fa33d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.918587 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee54bf1-3ee3-4a88-94b0-8e979fa33d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.918888 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee54bf1-3ee3-4a88-94b0-8e979fa33d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.919164 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee54bf1-3ee3-4a88-94b0-8e979fa33d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.920307 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee54bf1-3ee3-4a88-94b0-8e979fa33d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.922955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee54bf1-3ee3-4a88-94b0-8e979fa33d7c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.936867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1264/2504] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:21 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:21.937815 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee54bf1-3ee3-4a88-94b0-8e979fa33d7c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.947701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee54bf1-3ee3-4a88-94b0-8e979fa33d7c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.952467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418d1ba-aca7-4080-8175-f5224f54a845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.953376 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418d1ba-aca7-4080-8175-f5224f54a845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.953661 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418d1ba-aca7-4080-8175-f5224f54a845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.953935 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418d1ba-aca7-4080-8175-f5224f54a845 admin admin] PATH_INFO: `/v3/projects/cd96482743a2486abec8847aba2508b4/users/3a12f139f52a4eca92ab9547613632f7/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.968140 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1241/2505] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:21.968952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418d1ba-aca7-4080-8175-f5224f54a845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd96482743a2486abec8847aba2508b4, user_id=3a12f139f52a4eca92ab9547613632f7, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.971673 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418d1ba-aca7-4080-8175-f5224f54a845 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.981419 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d451a-1e18-42eb-95fc-5b1277577d68 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.982888 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-879d451a-1e18-42eb-95fc-5b1277577d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:21.986968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1265/2506] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:21 2022] PUT /identity/v3/projects/cd96482743a2486abec8847aba2508b4/users/3a12f139f52a4eca92ab9547613632f7/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:21.991569 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418d1ba-aca7-4080-8175-f5224f54a845 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.014124 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:22.044072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d451a-1e18-42eb-95fc-5b1277577d68 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.058393 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418d1ba-aca7-4080-8175-f5224f54a845 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.063206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e09185-9762-4c9d-b04a-f3c74aa098ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.063866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e09185-9762-4c9d-b04a-f3c74aa098ef admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.064151 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e09185-9762-4c9d-b04a-f3c74aa098ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.064444 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e09185-9762-4c9d-b04a-f3c74aa098ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.065182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e09185-9762-4c9d-b04a-f3c74aa098ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.066865 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e09185-9762-4c9d-b04a-f3c74aa098ef admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.078613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1266/2507] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:21 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:22.081625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e09185-9762-4c9d-b04a-f3c74aa098ef admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.091108 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e09185-9762-4c9d-b04a-f3c74aa098ef admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.094921 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac22ed-8000-4dab-b0a4-9e1a48ef8001 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.095581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac22ed-8000-4dab-b0a4-9e1a48ef8001 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.095868 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac22ed-8000-4dab-b0a4-9e1a48ef8001 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.096145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac22ed-8000-4dab-b0a4-9e1a48ef8001 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.096474 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75897a13-9bf9-4105-87d4-573196216ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.097345 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75897a13-9bf9-4105-87d4-573196216ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.097636 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75897a13-9bf9-4105-87d4-573196216ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.097919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75897a13-9bf9-4105-87d4-573196216ba7 admin admin] PATH_INFO: `/v3/projects/cd96482743a2486abec8847aba2508b4/users/3a12f139f52a4eca92ab9547613632f7/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.099930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75897a13-9bf9-4105-87d4-573196216ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd96482743a2486abec8847aba2508b4, user_id=3a12f139f52a4eca92ab9547613632f7, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.102809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75897a13-9bf9-4105-87d4-573196216ba7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.114056 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1267/2508] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:22 2022] PUT /identity/v3/projects/cd96482743a2486abec8847aba2508b4/users/3a12f139f52a4eca92ab9547613632f7/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:22.124114 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2afbc2-ab50-45ce-bb83-2e6fe4d63207 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.124403 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2afbc2-ab50-45ce-bb83-2e6fe4d63207 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.124714 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2afbc2-ab50-45ce-bb83-2e6fe4d63207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.151393 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-af2afbc2-ab50-45ce-bb83-2e6fe4d63207 None None] MFA Rules not processed for user `3a12f139f52a4eca92ab9547613632f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:22.152630 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-af2afbc2-ab50-45ce-bb83-2e6fe4d63207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:22.158336 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac22ed-8000-4dab-b0a4-9e1a48ef8001 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.159848 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac22ed-8000-4dab-b0a4-9e1a48ef8001 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.170078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1242/2509] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:22.202659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:22.226757 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1268/2510] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:22.244323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac22ed-8000-4dab-b0a4-9e1a48ef8001 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.253073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac22ed-8000-4dab-b0a4-9e1a48ef8001 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.307629 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd937f6-da99-420e-8fc9-367bcf2f68c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.308288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd937f6-da99-420e-8fc9-367bcf2f68c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.308577 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd937f6-da99-420e-8fc9-367bcf2f68c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.308858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd937f6-da99-420e-8fc9-367bcf2f68c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.322673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd937f6-da99-420e-8fc9-367bcf2f68c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.324165 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd937f6-da99-420e-8fc9-367bcf2f68c9 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.334968 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1243/2511] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:22.555620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2afbc2-ab50-45ce-bb83-2e6fe4d63207 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.628041 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2afbc2-ab50-45ce-bb83-2e6fe4d63207 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.633313 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89cfc5-dcf0-4d21-8710-7e6053a530aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.634328 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89cfc5-dcf0-4d21-8710-7e6053a530aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.634495 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89cfc5-dcf0-4d21-8710-7e6053a530aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.634953 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89cfc5-dcf0-4d21-8710-7e6053a530aa admin admin] PATH_INFO: `/v3/users/c389e76c18d04c8bba7bdb6c703d0baa` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.636090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89cfc5-dcf0-4d21-8710-7e6053a530aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c389e76c18d04c8bba7bdb6c703d0baa)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.638189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89cfc5-dcf0-4d21-8710-7e6053a530aa admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.696198 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8c89cfc5-dcf0-4d21-8710-7e6053a530aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c389e76c18d04c8bba7bdb6c703d0baa'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.710900 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8c89cfc5-dcf0-4d21-8710-7e6053a530aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c389e76c18d04c8bba7bdb6c703d0baa'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.711841 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8c89cfc5-dcf0-4d21-8710-7e6053a530aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c389e76c18d04c8bba7bdb6c703d0baa'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.726099 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8c89cfc5-dcf0-4d21-8710-7e6053a530aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c389e76c18d04c8bba7bdb6c703d0baa'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.726833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8c89cfc5-dcf0-4d21-8710-7e6053a530aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c389e76c18d04c8bba7bdb6c703d0baa'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.740558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1269/2512] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:22 2022] DELETE /identity/v3/users/c389e76c18d04c8bba7bdb6c703d0baa => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:22.745097 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d3767-e0a0-4dac-b4d1-74d68856f619 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.745388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d3767-e0a0-4dac-b4d1-74d68856f619 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.745672 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d3767-e0a0-4dac-b4d1-74d68856f619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.766132 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8f9d3767-e0a0-4dac-b4d1-74d68856f619 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:22.767390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8f9d3767-e0a0-4dac-b4d1-74d68856f619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:22.789569 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89cfc5-dcf0-4d21-8710-7e6053a530aa admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.791030 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8c89cfc5-dcf0-4d21-8710-7e6053a530aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:22.802813 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:22.834200 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1244/2513] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:22.844250 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d3767-e0a0-4dac-b4d1-74d68856f619 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.845675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8f9d3767-e0a0-4dac-b4d1-74d68856f619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:22.857907 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89cfc5-dcf0-4d21-8710-7e6053a530aa admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.862721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17cfc5-d9a3-4313-bd5e-9c29169c9992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.863669 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17cfc5-d9a3-4313-bd5e-9c29169c9992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.863883 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17cfc5-d9a3-4313-bd5e-9c29169c9992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.864162 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17cfc5-d9a3-4313-bd5e-9c29169c9992 admin admin] PATH_INFO: `/v3/users/ab72f420363b46b288f4e2a3a6e89508` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.865598 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17cfc5-d9a3-4313-bd5e-9c29169c9992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab72f420363b46b288f4e2a3a6e89508)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.867365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17cfc5-d9a3-4313-bd5e-9c29169c9992 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.872142 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:22.907181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d3767-e0a0-4dac-b4d1-74d68856f619 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.911292 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab9c16-3c3e-4e25-a0c6-3d3d21abbb40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.911947 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab9c16-3c3e-4e25-a0c6-3d3d21abbb40 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.912235 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab9c16-3c3e-4e25-a0c6-3d3d21abbb40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.912517 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab9c16-3c3e-4e25-a0c6-3d3d21abbb40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.920705 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-bc17cfc5-d9a3-4313-bd5e-9c29169c9992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab72f420363b46b288f4e2a3a6e89508'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.923009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab9c16-3c3e-4e25-a0c6-3d3d21abbb40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.924514 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab9c16-3c3e-4e25-a0c6-3d3d21abbb40 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.933433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-bc17cfc5-d9a3-4313-bd5e-9c29169c9992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab72f420363b46b288f4e2a3a6e89508'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.934170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-bc17cfc5-d9a3-4313-bd5e-9c29169c9992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab72f420363b46b288f4e2a3a6e89508'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.935306 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1245/2514] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:22.943265 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-bc17cfc5-d9a3-4313-bd5e-9c29169c9992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab72f420363b46b288f4e2a3a6e89508'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.943939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-bc17cfc5-d9a3-4313-bd5e-9c29169c9992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab72f420363b46b288f4e2a3a6e89508'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.957027 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1270/2515] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:22 2022] DELETE /identity/v3/users/ab72f420363b46b288f4e2a3a6e89508 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:22.961709 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaf142-f069-498a-9048-5a756d9bfc18 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.961999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaf142-f069-498a-9048-5a756d9bfc18 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.962277 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaf142-f069-498a-9048-5a756d9bfc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.981121 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5baaf142-f069-498a-9048-5a756d9bfc18 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:22.982412 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5baaf142-f069-498a-9048-5a756d9bfc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:23.046022 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1246/2516] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:23.056092 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17cfc5-d9a3-4313-bd5e-9c29169c9992 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:23.057489 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bc17cfc5-d9a3-4313-bd5e-9c29169c9992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:23.122962 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17cfc5-d9a3-4313-bd5e-9c29169c9992 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:23.127255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5c465-4c99-49fa-be3a-d657030c658d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:23.127908 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5c465-4c99-49fa-be3a-d657030c658d service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.128194 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5c465-4c99-49fa-be3a-d657030c658d service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.128472 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5c465-4c99-49fa-be3a-d657030c658d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.138365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5c465-4c99-49fa-be3a-d657030c658d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:23.139824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5c465-4c99-49fa-be3a-d657030c658d service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:23.149689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1271/2517] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:23.260684 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaf142-f069-498a-9048-5a756d9bfc18 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:23.262472 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5baaf142-f069-498a-9048-5a756d9bfc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:23.274913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaf142-f069-498a-9048-5a756d9bfc18 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:23.280000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd364e31-bd79-40a4-bb8c-189ccf05970c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:23.280927 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd364e31-bd79-40a4-bb8c-189ccf05970c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.281209 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd364e31-bd79-40a4-bb8c-189ccf05970c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.281483 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd364e31-bd79-40a4-bb8c-189ccf05970c admin admin] PATH_INFO: `/v3/projects/1ce14d7d08c842d78dd3b5795ce4b2be` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.282730 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd364e31-bd79-40a4-bb8c-189ccf05970c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ce14d7d08c842d78dd3b5795ce4b2be)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:23.284637 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd364e31-bd79-40a4-bb8c-189ccf05970c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:23.339316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dd364e31-bd79-40a4-bb8c-189ccf05970c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ce14d7d08c842d78dd3b5795ce4b2be', 'request_id': 'req-dd364e31-bd79-40a4-bb8c-189ccf05970c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.349270 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dd364e31-bd79-40a4-bb8c-189ccf05970c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ce14d7d08c842d78dd3b5795ce4b2be', 'request_id': 'req-dd364e31-bd79-40a4-bb8c-189ccf05970c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.362902 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dd364e31-bd79-40a4-bb8c-189ccf05970c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ce14d7d08c842d78dd3b5795ce4b2be', 'request_id': 'req-dd364e31-bd79-40a4-bb8c-189ccf05970c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.392318 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dd364e31-bd79-40a4-bb8c-189ccf05970c admin admin] The token cache is being invalidate because project 1ce14d7d08c842d78dd3b5795ce4b2be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:23.392851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dd364e31-bd79-40a4-bb8c-189ccf05970c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.393935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dd364e31-bd79-40a4-bb8c-189ccf05970c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.396300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1247/2518] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:23 2022] DELETE /identity/v3/projects/1ce14d7d08c842d78dd3b5795ce4b2be => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:23.400762 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5c465-4c99-49fa-be3a-d657030c658d service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:23.412079 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5c465-4c99-49fa-be3a-d657030c658d service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:23.471472 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1c0a1-8711-40f4-bd9c-106091aef73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:23.472361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1c0a1-8711-40f4-bd9c-106091aef73f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.472645 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1c0a1-8711-40f4-bd9c-106091aef73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.472924 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1c0a1-8711-40f4-bd9c-106091aef73f admin admin] PATH_INFO: `/v3/users/2a2344b924024dfb9e3ef7c9c13d1434` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.474155 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1c0a1-8711-40f4-bd9c-106091aef73f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a2344b924024dfb9e3ef7c9c13d1434)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:23.476316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1c0a1-8711-40f4-bd9c-106091aef73f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:23.486014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd364e31-bd79-40a4-bb8c-189ccf05970c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:23.487452 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dd364e31-bd79-40a4-bb8c-189ccf05970c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:23.495612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:23.502498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd364e31-bd79-40a4-bb8c-189ccf05970c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:23.510244 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cef46-6a15-49c6-86e7-1dd4b8c1148b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:23.511109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cef46-6a15-49c6-86e7-1dd4b8c1148b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.511459 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cef46-6a15-49c6-86e7-1dd4b8c1148b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.511784 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cef46-6a15-49c6-86e7-1dd4b8c1148b admin admin] PATH_INFO: `/v3/projects/97bc3e0339654c558d373ded09524d88` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.513246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cef46-6a15-49c6-86e7-1dd4b8c1148b admin admin] RBAC: Authorizing `identity:delete_project(project_id=97bc3e0339654c558d373ded09524d88)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:23.515249 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cef46-6a15-49c6-86e7-1dd4b8c1148b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:23.531272 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:23.557654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-85a1c0a1-8711-40f4-bd9c-106091aef73f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a2344b924024dfb9e3ef7c9c13d1434'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.573249 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-688cef46-6a15-49c6-86e7-1dd4b8c1148b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97bc3e0339654c558d373ded09524d88', 'request_id': 'req-688cef46-6a15-49c6-86e7-1dd4b8c1148b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.575858 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-85a1c0a1-8711-40f4-bd9c-106091aef73f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a2344b924024dfb9e3ef7c9c13d1434'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.576600 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-85a1c0a1-8711-40f4-bd9c-106091aef73f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a2344b924024dfb9e3ef7c9c13d1434'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.583182 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-688cef46-6a15-49c6-86e7-1dd4b8c1148b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97bc3e0339654c558d373ded09524d88', 'request_id': 'req-688cef46-6a15-49c6-86e7-1dd4b8c1148b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.585642 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-85a1c0a1-8711-40f4-bd9c-106091aef73f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a2344b924024dfb9e3ef7c9c13d1434'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.586505 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-85a1c0a1-8711-40f4-bd9c-106091aef73f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a2344b924024dfb9e3ef7c9c13d1434'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.590817 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-688cef46-6a15-49c6-86e7-1dd4b8c1148b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97bc3e0339654c558d373ded09524d88', 'request_id': 'req-688cef46-6a15-49c6-86e7-1dd4b8c1148b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.601639 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1272/2519] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:23 2022] DELETE /identity/v3/users/2a2344b924024dfb9e3ef7c9c13d1434 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:23.605126 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-688cef46-6a15-49c6-86e7-1dd4b8c1148b admin admin] The token cache is being invalidate because project 97bc3e0339654c558d373ded09524d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:23.605425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-688cef46-6a15-49c6-86e7-1dd4b8c1148b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.606291 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-688cef46-6a15-49c6-86e7-1dd4b8c1148b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.611489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1248/2520] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:23 2022] DELETE /identity/v3/projects/97bc3e0339654c558d373ded09524d88 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:23.612455 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1c0a1-8711-40f4-bd9c-106091aef73f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:23.614125 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-85a1c0a1-8711-40f4-bd9c-106091aef73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:23.692494 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1c0a1-8711-40f4-bd9c-106091aef73f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:23.697955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903ec31-de4e-470b-be03-2313fbc76796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:23.699728 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903ec31-de4e-470b-be03-2313fbc76796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.699728 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903ec31-de4e-470b-be03-2313fbc76796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.700104 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903ec31-de4e-470b-be03-2313fbc76796 admin admin] PATH_INFO: `/v3/users/3a12f139f52a4eca92ab9547613632f7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.701464 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903ec31-de4e-470b-be03-2313fbc76796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a12f139f52a4eca92ab9547613632f7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:23.704027 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903ec31-de4e-470b-be03-2313fbc76796 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:23.772845 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c903ec31-de4e-470b-be03-2313fbc76796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a12f139f52a4eca92ab9547613632f7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.796851 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c903ec31-de4e-470b-be03-2313fbc76796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a12f139f52a4eca92ab9547613632f7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.798045 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c903ec31-de4e-470b-be03-2313fbc76796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a12f139f52a4eca92ab9547613632f7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.813364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c903ec31-de4e-470b-be03-2313fbc76796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a12f139f52a4eca92ab9547613632f7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.814185 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c903ec31-de4e-470b-be03-2313fbc76796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a12f139f52a4eca92ab9547613632f7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.837941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1273/2521] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:23 2022] DELETE /identity/v3/users/3a12f139f52a4eca92ab9547613632f7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:24.012608 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cef46-6a15-49c6-86e7-1dd4b8c1148b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:24.014178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-688cef46-6a15-49c6-86e7-1dd4b8c1148b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:24.094904 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cef46-6a15-49c6-86e7-1dd4b8c1148b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:24.170146 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba71fe6-adfe-443e-bddb-17a89ad655d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:24.171071 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba71fe6-adfe-443e-bddb-17a89ad655d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.171553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba71fe6-adfe-443e-bddb-17a89ad655d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.171864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba71fe6-adfe-443e-bddb-17a89ad655d2 admin admin] PATH_INFO: `/v3/projects/695cbc961f3e4f4e8397ce29863f70b2` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.173150 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba71fe6-adfe-443e-bddb-17a89ad655d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=695cbc961f3e4f4e8397ce29863f70b2)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:24.175127 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba71fe6-adfe-443e-bddb-17a89ad655d2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:24.223052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:24.223719 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903ec31-de4e-470b-be03-2313fbc76796 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:24.225607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c903ec31-de4e-470b-be03-2313fbc76796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:24.239144 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eba71fe6-adfe-443e-bddb-17a89ad655d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '695cbc961f3e4f4e8397ce29863f70b2', 'request_id': 'req-eba71fe6-adfe-443e-bddb-17a89ad655d2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:24.240873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903ec31-de4e-470b-be03-2313fbc76796 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:24.248733 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eba71fe6-adfe-443e-bddb-17a89ad655d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '695cbc961f3e4f4e8397ce29863f70b2', 'request_id': 'req-eba71fe6-adfe-443e-bddb-17a89ad655d2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:24.257866 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eba71fe6-adfe-443e-bddb-17a89ad655d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '695cbc961f3e4f4e8397ce29863f70b2', 'request_id': 'req-eba71fe6-adfe-443e-bddb-17a89ad655d2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:24.266900 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:24.273205 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eba71fe6-adfe-443e-bddb-17a89ad655d2 admin admin] The token cache is being invalidate because project 695cbc961f3e4f4e8397ce29863f70b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:24.273501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eba71fe6-adfe-443e-bddb-17a89ad655d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:24.274246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eba71fe6-adfe-443e-bddb-17a89ad655d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:24.275982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1249/2522] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:24 2022] DELETE /identity/v3/projects/695cbc961f3e4f4e8397ce29863f70b2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:24.281511 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0982e9-4621-4ac7-b2db-ccddab203703 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.281878 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0982e9-4621-4ac7-b2db-ccddab203703 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.282263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0982e9-4621-4ac7-b2db-ccddab203703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.301969 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4c0982e9-4621-4ac7-b2db-ccddab203703 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:24.303338 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4c0982e9-4621-4ac7-b2db-ccddab203703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:24.316960 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f91615-f2dc-4fa7-8a79-ae8ca8f9dacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:24.317825 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f91615-f2dc-4fa7-8a79-ae8ca8f9dacc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.318105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f91615-f2dc-4fa7-8a79-ae8ca8f9dacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.318376 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f91615-f2dc-4fa7-8a79-ae8ca8f9dacc admin admin] PATH_INFO: `/v3/projects/cd96482743a2486abec8847aba2508b4` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.319646 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f91615-f2dc-4fa7-8a79-ae8ca8f9dacc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd96482743a2486abec8847aba2508b4)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:24.321578 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f91615-f2dc-4fa7-8a79-ae8ca8f9dacc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:24.379538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-84f91615-f2dc-4fa7-8a79-ae8ca8f9dacc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd96482743a2486abec8847aba2508b4', 'request_id': 'req-84f91615-f2dc-4fa7-8a79-ae8ca8f9dacc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:24.385947 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1250/2523] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:24.387486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d7024-6bb6-4a60-9e12-33bc1fd4ecfd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.387780 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d7024-6bb6-4a60-9e12-33bc1fd4ecfd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.388058 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d7024-6bb6-4a60-9e12-33bc1fd4ecfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.389771 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-84f91615-f2dc-4fa7-8a79-ae8ca8f9dacc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd96482743a2486abec8847aba2508b4', 'request_id': 'req-84f91615-f2dc-4fa7-8a79-ae8ca8f9dacc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:24.397517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-84f91615-f2dc-4fa7-8a79-ae8ca8f9dacc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd96482743a2486abec8847aba2508b4', 'request_id': 'req-84f91615-f2dc-4fa7-8a79-ae8ca8f9dacc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:24.408399 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c06d7024-6bb6-4a60-9e12-33bc1fd4ecfd None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:24.409666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c06d7024-6bb6-4a60-9e12-33bc1fd4ecfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:24.411939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-84f91615-f2dc-4fa7-8a79-ae8ca8f9dacc admin admin] The token cache is being invalidate because project cd96482743a2486abec8847aba2508b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:24.412234 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-84f91615-f2dc-4fa7-8a79-ae8ca8f9dacc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:24.412864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-84f91615-f2dc-4fa7-8a79-ae8ca8f9dacc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:24.414702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1274/2524] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:24 2022] DELETE /identity/v3/projects/cd96482743a2486abec8847aba2508b4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:24.419824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7be3a-09b6-4ba7-a27b-2757be1d5132 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.420113 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7be3a-09b6-4ba7-a27b-2757be1d5132 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.420399 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7be3a-09b6-4ba7-a27b-2757be1d5132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.439234 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3bd7be3a-09b6-4ba7-a27b-2757be1d5132 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:24.440462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3bd7be3a-09b6-4ba7-a27b-2757be1d5132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:24.474786 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1251/2525] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:24.479118 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d7024-6bb6-4a60-9e12-33bc1fd4ecfd None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:24.490350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d7024-6bb6-4a60-9e12-33bc1fd4ecfd None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:24.496040 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea06a3e-ed64-4d31-856c-26c32a7202b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:24.496714 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea06a3e-ed64-4d31-856c-26c32a7202b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.496998 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea06a3e-ed64-4d31-856c-26c32a7202b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.497276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea06a3e-ed64-4d31-856c-26c32a7202b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.497999 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea06a3e-ed64-4d31-856c-26c32a7202b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:49:24.498306 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea06a3e-ed64-4d31-856c-26c32a7202b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:24.500625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea06a3e-ed64-4d31-856c-26c32a7202b2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:24.507148 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1275/2526] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:24.517509 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1252/2527] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:49:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:49:24.517701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4eb02-4b9e-4692-98e5-eed34dded06e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.517701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4eb02-4b9e-4692-98e5-eed34dded06e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.517701 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4eb02-4b9e-4692-98e5-eed34dded06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.518625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea06a3e-ed64-4d31-856c-26c32a7202b2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:24.529089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea06a3e-ed64-4d31-856c-26c32a7202b2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:24.534873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05fdf2-4b02-4af1-85c8-24c01599d544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:24.535717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05fdf2-4b02-4af1-85c8-24c01599d544 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.535896 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-19b4eb02-4b9e-4692-98e5-eed34dded06e None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:24.536068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05fdf2-4b02-4af1-85c8-24c01599d544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.536276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05fdf2-4b02-4af1-85c8-24c01599d544 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.536969 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05fdf2-4b02-4af1-85c8-24c01599d544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:24.537124 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-19b4eb02-4b9e-4692-98e5-eed34dded06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:24.539202 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05fdf2-4b02-4af1-85c8-24c01599d544 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:24.545826 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1276/2528] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:24.550698 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4eb02-4b9e-4692-98e5-eed34dded06e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:24.561604 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4eb02-4b9e-4692-98e5-eed34dded06e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:24.567046 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458974a-512b-40b3-ac14-3edfbb88d154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:24.567720 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458974a-512b-40b3-ac14-3edfbb88d154 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.568010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458974a-512b-40b3-ac14-3edfbb88d154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.568299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458974a-512b-40b3-ac14-3edfbb88d154 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.569118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458974a-512b-40b3-ac14-3edfbb88d154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:49:24.569580 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458974a-512b-40b3-ac14-3edfbb88d154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:24.569975 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1253/2529] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:24 2022] POST /identity/v3/projects => generated 366 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:24.571246 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458974a-512b-40b3-ac14-3edfbb88d154 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:24.574293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05fdf2-4b02-4af1-85c8-24c01599d544 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:24.587511 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1277/2530] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:49:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:49:24.592560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458974a-512b-40b3-ac14-3edfbb88d154 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:24.603875 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458974a-512b-40b3-ac14-3edfbb88d154 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:24.614353 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:24.640463 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:24.654066 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05fdf2-4b02-4af1-85c8-24c01599d544 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:24.659080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadea6c-c099-4aa1-be95-02939377e7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:24.659765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadea6c-c099-4aa1-be95-02939377e7a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.660058 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadea6c-c099-4aa1-be95-02939377e7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.660338 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadea6c-c099-4aa1-be95-02939377e7a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.661034 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadea6c-c099-4aa1-be95-02939377e7a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:24.663503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadea6c-c099-4aa1-be95-02939377e7a4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:24.673760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88b21d-bb2b-4eac-b4a0-1a3001c2699c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:24.674454 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88b21d-bb2b-4eac-b4a0-1a3001c2699c admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.674782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88b21d-bb2b-4eac-b4a0-1a3001c2699c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.675067 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88b21d-bb2b-4eac-b4a0-1a3001c2699c admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.675797 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88b21d-bb2b-4eac-b4a0-1a3001c2699c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:24.677730 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88b21d-bb2b-4eac-b4a0-1a3001c2699c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:24.707831 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1254/2531] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:24 2022] POST /identity/v3/users => generated 284 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:24.711048 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadea6c-c099-4aa1-be95-02939377e7a4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:24.725613 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadea6c-c099-4aa1-be95-02939377e7a4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:24.730767 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db760e95-7a8f-4c0c-9d7a-9574f43d6084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:24.731737 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db760e95-7a8f-4c0c-9d7a-9574f43d6084 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.731737 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db760e95-7a8f-4c0c-9d7a-9574f43d6084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.732046 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db760e95-7a8f-4c0c-9d7a-9574f43d6084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.732758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db760e95-7a8f-4c0c-9d7a-9574f43d6084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:24.735078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db760e95-7a8f-4c0c-9d7a-9574f43d6084 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:24.750058 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1255/2532] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:24 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:24.758732 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db760e95-7a8f-4c0c-9d7a-9574f43d6084 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:24.771361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db760e95-7a8f-4c0c-9d7a-9574f43d6084 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:24.777112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6e9c4-99fe-437a-ac0b-487d099db768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:24.777840 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6e9c4-99fe-437a-ac0b-487d099db768 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.778116 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6e9c4-99fe-437a-ac0b-487d099db768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.778394 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6e9c4-99fe-437a-ac0b-487d099db768 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.779400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6e9c4-99fe-437a-ac0b-487d099db768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:24.781085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6e9c4-99fe-437a-ac0b-487d099db768 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:24.797776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1256/2533] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:24 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:24.799247 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6e9c4-99fe-437a-ac0b-487d099db768 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:24.810351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6e9c4-99fe-437a-ac0b-487d099db768 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:24.815761 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4e817-26d2-454c-8b2d-cddb0e0c527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:24.816666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4e817-26d2-454c-8b2d-cddb0e0c527e admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.816956 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4e817-26d2-454c-8b2d-cddb0e0c527e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.817241 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4e817-26d2-454c-8b2d-cddb0e0c527e admin admin] PATH_INFO: `/v3/projects/0a4bf0eeca8043b6bf75aac174df83e0/users/3572d07b706047a5a2ffbb01253dc69f/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.821644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1278/2534] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:24 2022] POST /identity/v3/projects => generated 380 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:24.826144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88b21d-bb2b-4eac-b4a0-1a3001c2699c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:24.833318 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4e817-26d2-454c-8b2d-cddb0e0c527e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a4bf0eeca8043b6bf75aac174df83e0, user_id=3572d07b706047a5a2ffbb01253dc69f, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:24.836012 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4e817-26d2-454c-8b2d-cddb0e0c527e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:24.849680 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1257/2535] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:24 2022] PUT /identity/v3/projects/0a4bf0eeca8043b6bf75aac174df83e0/users/3572d07b706047a5a2ffbb01253dc69f/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:24.860908 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12136075-6568-4fdb-9730-dc90fb035c08 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.861194 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12136075-6568-4fdb-9730-dc90fb035c08 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.861471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12136075-6568-4fdb-9730-dc90fb035c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.888336 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-12136075-6568-4fdb-9730-dc90fb035c08 None None] MFA Rules not processed for user `3572d07b706047a5a2ffbb01253dc69f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:24.889794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-12136075-6568-4fdb-9730-dc90fb035c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:24.889962 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88b21d-bb2b-4eac-b4a0-1a3001c2699c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:24.952583 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da20bc-d6a9-419d-beab-1ac87aed4b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:24.953536 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da20bc-d6a9-419d-beab-1ac87aed4b2d admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.953827 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da20bc-d6a9-419d-beab-1ac87aed4b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.954114 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da20bc-d6a9-419d-beab-1ac87aed4b2d admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.954839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da20bc-d6a9-419d-beab-1ac87aed4b2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:24.956781 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da20bc-d6a9-419d-beab-1ac87aed4b2d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:24.959810 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1258/2536] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:24.964876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12136075-6568-4fdb-9730-dc90fb035c08 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:24.979271 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12136075-6568-4fdb-9730-dc90fb035c08 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:24.981091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1279/2537] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:24 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:24.985739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da20bc-d6a9-419d-beab-1ac87aed4b2d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:24.988584 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e9a06-ec33-4f92-baa3-7ed103ba50a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:24.989259 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e9a06-ec33-4f92-baa3-7ed103ba50a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.989571 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e9a06-ec33-4f92-baa3-7ed103ba50a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.989818 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e9a06-ec33-4f92-baa3-7ed103ba50a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.990790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e9a06-ec33-4f92-baa3-7ed103ba50a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:24.992600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e9a06-ec33-4f92-baa3-7ed103ba50a2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:24.996570 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da20bc-d6a9-419d-beab-1ac87aed4b2d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:25.001522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1cc71-9695-4050-92b5-cd6f3d66a8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:25.002223 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1cc71-9695-4050-92b5-cd6f3d66a8fc admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.002517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1cc71-9695-4050-92b5-cd6f3d66a8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.002832 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1cc71-9695-4050-92b5-cd6f3d66a8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.003564 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1cc71-9695-4050-92b5-cd6f3d66a8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:25.005171 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1cc71-9695-4050-92b5-cd6f3d66a8fc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:25.017740 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1280/2538] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:24 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:25.021552 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1cc71-9695-4050-92b5-cd6f3d66a8fc admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:25.031702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1259/2539] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:24 2022] POST /identity/v3/projects => generated 366 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:25.035733 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e9a06-ec33-4f92-baa3-7ed103ba50a2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:25.036191 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1cc71-9695-4050-92b5-cd6f3d66a8fc admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:25.085274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:25.091471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:25.110520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ad281-fc62-4164-a7a0-e83f150d1143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:25.111366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ad281-fc62-4164-a7a0-e83f150d1143 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.111658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ad281-fc62-4164-a7a0-e83f150d1143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.112468 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ad281-fc62-4164-a7a0-e83f150d1143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.112931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ad281-fc62-4164-a7a0-e83f150d1143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:25.114639 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ad281-fc62-4164-a7a0-e83f150d1143 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:25.115863 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e9a06-ec33-4f92-baa3-7ed103ba50a2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:25.120738 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f74a5-65ec-4fa0-a624-523cc71c92d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:25.121455 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f74a5-65ec-4fa0-a624-523cc71c92d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.121868 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f74a5-65ec-4fa0-a624-523cc71c92d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.122151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f74a5-65ec-4fa0-a624-523cc71c92d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.122955 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f74a5-65ec-4fa0-a624-523cc71c92d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:25.124919 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f74a5-65ec-4fa0-a624-523cc71c92d5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:25.128450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1281/2540] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:25 2022] GET /identity/v3/roles => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:25.129483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ad281-fc62-4164-a7a0-e83f150d1143 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:25.140083 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ad281-fc62-4164-a7a0-e83f150d1143 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:25.145031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9113d-b1c4-4c27-a614-dff4320beaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:25.148252 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1260/2541] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:25 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:25.148381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9113d-b1c4-4c27-a614-dff4320beaba admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.148381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9113d-b1c4-4c27-a614-dff4320beaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.148381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9113d-b1c4-4c27-a614-dff4320beaba admin admin] PATH_INFO: `/v3/projects/26c7101151c04d2bb9b050f3bec9236f/users/b6fdf1f3107744e8874dc26e9574f91d/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.149239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f74a5-65ec-4fa0-a624-523cc71c92d5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:25.160000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f74a5-65ec-4fa0-a624-523cc71c92d5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:25.162829 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9113d-b1c4-4c27-a614-dff4320beaba admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c7101151c04d2bb9b050f3bec9236f, user_id=b6fdf1f3107744e8874dc26e9574f91d, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:25.165038 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3bf6a-e46f-41d0-9145-146fc497b7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:25.165698 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3bf6a-e46f-41d0-9145-146fc497b7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.165935 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9113d-b1c4-4c27-a614-dff4320beaba admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:25.166039 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3bf6a-e46f-41d0-9145-146fc497b7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.166255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3bf6a-e46f-41d0-9145-146fc497b7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.167009 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3bf6a-e46f-41d0-9145-146fc497b7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:25.168654 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3bf6a-e46f-41d0-9145-146fc497b7f6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:25.180642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1261/2542] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:25 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:25.182062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1282/2543] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:25 2022] PUT /identity/v3/projects/26c7101151c04d2bb9b050f3bec9236f/users/b6fdf1f3107744e8874dc26e9574f91d/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:25.189249 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3bf6a-e46f-41d0-9145-146fc497b7f6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:25.193534 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38f4d9-da08-44d7-90b5-1b2b58383d30 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.193819 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38f4d9-da08-44d7-90b5-1b2b58383d30 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.194102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38f4d9-da08-44d7-90b5-1b2b58383d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.199485 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3bf6a-e46f-41d0-9145-146fc497b7f6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:25.220790 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8a38f4d9-da08-44d7-90b5-1b2b58383d30 None None] MFA Rules not processed for user `b6fdf1f3107744e8874dc26e9574f91d`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:25.222009 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8a38f4d9-da08-44d7-90b5-1b2b58383d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:25.260162 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a0f59-faa5-4069-8386-1d43f3cb3f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:25.261064 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a0f59-faa5-4069-8386-1d43f3cb3f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.261351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a0f59-faa5-4069-8386-1d43f3cb3f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.261631 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a0f59-faa5-4069-8386-1d43f3cb3f5e admin admin] PATH_INFO: `/v3/projects/6b02dd07398a46a4a7a371660220e8cc/users/54a652c796ab4786bfc4cdcc377a15f4/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.276822 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a0f59-faa5-4069-8386-1d43f3cb3f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b02dd07398a46a4a7a371660220e8cc, user_id=54a652c796ab4786bfc4cdcc377a15f4, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:25.279560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a0f59-faa5-4069-8386-1d43f3cb3f5e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:25.290439 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1283/2544] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:25.294964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38f4d9-da08-44d7-90b5-1b2b58383d30 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:25.299354 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1262/2545] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:25 2022] PUT /identity/v3/projects/6b02dd07398a46a4a7a371660220e8cc/users/54a652c796ab4786bfc4cdcc377a15f4/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:25.303101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a0f59-faa5-4069-8386-1d43f3cb3f5e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:25.307869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38f4d9-da08-44d7-90b5-1b2b58383d30 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:25.366292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1420208-01f4-4283-bb9d-75b9f560f97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:25.366794 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a0f59-faa5-4069-8386-1d43f3cb3f5e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:25.367053 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1420208-01f4-4283-bb9d-75b9f560f97c admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.367351 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1420208-01f4-4283-bb9d-75b9f560f97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.367637 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1420208-01f4-4283-bb9d-75b9f560f97c admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.368400 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1420208-01f4-4283-bb9d-75b9f560f97c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:25.370333 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1420208-01f4-4283-bb9d-75b9f560f97c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:25.371753 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b951b61-087e-48e3-80c6-149f69817b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:25.372434 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b951b61-087e-48e3-80c6-149f69817b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.372723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b951b61-087e-48e3-80c6-149f69817b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.373005 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b951b61-087e-48e3-80c6-149f69817b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.373872 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b951b61-087e-48e3-80c6-149f69817b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:25.375569 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b951b61-087e-48e3-80c6-149f69817b71 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:25.385841 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1263/2546] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:25 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:25.391730 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b951b61-087e-48e3-80c6-149f69817b71 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:25.397639 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1284/2547] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:25 2022] POST /identity/v3/projects => generated 382 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:25.401466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1420208-01f4-4283-bb9d-75b9f560f97c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:25.403502 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b951b61-087e-48e3-80c6-149f69817b71 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:25.435693 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:25.438467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:25.463576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446491e4-0e22-4272-af9f-e3c720edf378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:25.464472 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446491e4-0e22-4272-af9f-e3c720edf378 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.464751 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446491e4-0e22-4272-af9f-e3c720edf378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.465025 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446491e4-0e22-4272-af9f-e3c720edf378 admin admin] PATH_INFO: `/v3/projects/6b02dd07398a46a4a7a371660220e8cc/users/54a652c796ab4786bfc4cdcc377a15f4/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.466234 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1420208-01f4-4283-bb9d-75b9f560f97c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:25.467062 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446491e4-0e22-4272-af9f-e3c720edf378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b02dd07398a46a4a7a371660220e8cc, user_id=54a652c796ab4786bfc4cdcc377a15f4, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:25.470288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446491e4-0e22-4272-af9f-e3c720edf378 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:25.471723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381cf62-b8c6-448b-8631-0911c58724f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:25.472522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381cf62-b8c6-448b-8631-0911c58724f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.472685 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381cf62-b8c6-448b-8631-0911c58724f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.472968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381cf62-b8c6-448b-8631-0911c58724f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.473660 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381cf62-b8c6-448b-8631-0911c58724f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:25.475617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381cf62-b8c6-448b-8631-0911c58724f7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:25.481174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1264/2548] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:25 2022] PUT /identity/v3/projects/6b02dd07398a46a4a7a371660220e8cc/users/54a652c796ab4786bfc4cdcc377a15f4/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:25.493120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774e7ea-8799-4ecd-ba8c-4c18251fd742 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.493413 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774e7ea-8799-4ecd-ba8c-4c18251fd742 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.493695 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774e7ea-8799-4ecd-ba8c-4c18251fd742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.498649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1285/2549] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:25 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:25.499539 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381cf62-b8c6-448b-8631-0911c58724f7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:25.509133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381cf62-b8c6-448b-8631-0911c58724f7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:25.521460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2774e7ea-8799-4ecd-ba8c-4c18251fd742 None None] MFA Rules not processed for user `54a652c796ab4786bfc4cdcc377a15f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:25.522718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2774e7ea-8799-4ecd-ba8c-4c18251fd742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:25.581595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0be91-a66b-4a9b-a26a-804d8d0d7fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:25.582996 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0be91-a66b-4a9b-a26a-804d8d0d7fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.583381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0be91-a66b-4a9b-a26a-804d8d0d7fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.583681 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0be91-a66b-4a9b-a26a-804d8d0d7fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.584491 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0be91-a66b-4a9b-a26a-804d8d0d7fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:25.586117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0be91-a66b-4a9b-a26a-804d8d0d7fc5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:25.597536 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1286/2550] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:25 2022] GET /identity/v3/roles => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:25.601635 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0be91-a66b-4a9b-a26a-804d8d0d7fc5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:25.605685 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1265/2551] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:25.613871 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0be91-a66b-4a9b-a26a-804d8d0d7fc5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:25.618047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774e7ea-8799-4ecd-ba8c-4c18251fd742 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:25.619370 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c07002-6084-41c2-9896-18ffd05006f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:25.619589 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2774e7ea-8799-4ecd-ba8c-4c18251fd742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:25.620132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c07002-6084-41c2-9896-18ffd05006f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.620424 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c07002-6084-41c2-9896-18ffd05006f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.620702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c07002-6084-41c2-9896-18ffd05006f6 admin admin] PATH_INFO: `/v3/projects/e8032679b88443e9b51c4670e15a89fc/users/05d19b2a53274c618a77e59b81821edf/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.639313 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c07002-6084-41c2-9896-18ffd05006f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8032679b88443e9b51c4670e15a89fc, user_id=05d19b2a53274c618a77e59b81821edf, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:25.643013 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c07002-6084-41c2-9896-18ffd05006f6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:25.660050 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1287/2552] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:25 2022] PUT /identity/v3/projects/e8032679b88443e9b51c4670e15a89fc/users/05d19b2a53274c618a77e59b81821edf/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:25.664163 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c07002-6084-41c2-9896-18ffd05006f6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:25.691574 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774e7ea-8799-4ecd-ba8c-4c18251fd742 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:25.746898 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c07002-6084-41c2-9896-18ffd05006f6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:25.756510 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cf1d1-933e-44c9-a300-e15db66dd1c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:25.757089 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cf1d1-933e-44c9-a300-e15db66dd1c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.757383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cf1d1-933e-44c9-a300-e15db66dd1c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.757787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cf1d1-933e-44c9-a300-e15db66dd1c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.759705 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc3e2d-0162-4574-9e11-947bced45a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:25.760500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc3e2d-0162-4574-9e11-947bced45a7e admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.760911 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc3e2d-0162-4574-9e11-947bced45a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.761254 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc3e2d-0162-4574-9e11-947bced45a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.762065 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc3e2d-0162-4574-9e11-947bced45a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:25.763817 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc3e2d-0162-4574-9e11-947bced45a7e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:25.777166 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1288/2553] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:25 2022] GET /identity/v3/roles => generated 1427 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:25.781406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc3e2d-0162-4574-9e11-947bced45a7e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:25.792402 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc3e2d-0162-4574-9e11-947bced45a7e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:25.796161 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:25.800187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12476c0-09c8-4176-99d8-ec9025f4685f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:25.801371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12476c0-09c8-4176-99d8-ec9025f4685f admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.801518 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12476c0-09c8-4176-99d8-ec9025f4685f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.802071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12476c0-09c8-4176-99d8-ec9025f4685f admin admin] PATH_INFO: `/v3/projects/e8032679b88443e9b51c4670e15a89fc/users/05d19b2a53274c618a77e59b81821edf/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.806217 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12476c0-09c8-4176-99d8-ec9025f4685f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8032679b88443e9b51c4670e15a89fc, user_id=05d19b2a53274c618a77e59b81821edf, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:25.809568 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12476c0-09c8-4176-99d8-ec9025f4685f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:25.824464 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1289/2554] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:25 2022] PUT /identity/v3/projects/e8032679b88443e9b51c4670e15a89fc/users/05d19b2a53274c618a77e59b81821edf/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:25.836294 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef193fc6-24f2-4e34-a0f7-e4c5c4254f31 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.836590 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef193fc6-24f2-4e34-a0f7-e4c5c4254f31 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.836873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef193fc6-24f2-4e34-a0f7-e4c5c4254f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.841442 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cf1d1-933e-44c9-a300-e15db66dd1c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:25.843050 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cf1d1-933e-44c9-a300-e15db66dd1c5 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:25.854011 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1266/2555] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:25.868484 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ef193fc6-24f2-4e34-a0f7-e4c5c4254f31 None None] MFA Rules not processed for user `05d19b2a53274c618a77e59b81821edf`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:25.869724 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ef193fc6-24f2-4e34-a0f7-e4c5c4254f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:25.877396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:25.941182 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cf1d1-933e-44c9-a300-e15db66dd1c5 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:25.953599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cf1d1-933e-44c9-a300-e15db66dd1c5 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:25.969571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1290/2556] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:25.982922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef193fc6-24f2-4e34-a0f7-e4c5c4254f31 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:25.984868 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ef193fc6-24f2-4e34-a0f7-e4c5c4254f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:26.015769 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c7e8d-0872-4275-b836-fc0c7f3fb1f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:26.016462 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c7e8d-0872-4275-b836-fc0c7f3fb1f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:26.016757 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c7e8d-0872-4275-b836-fc0c7f3fb1f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:26.017015 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c7e8d-0872-4275-b836-fc0c7f3fb1f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:26.055016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef193fc6-24f2-4e34-a0f7-e4c5c4254f31 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:26.058598 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35de58-1dc0-4862-ae52-b99b582db7ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:26.059257 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35de58-1dc0-4862-ae52-b99b582db7ad service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:26.059538 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35de58-1dc0-4862-ae52-b99b582db7ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:26.059817 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35de58-1dc0-4862-ae52-b99b582db7ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:26.070397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35de58-1dc0-4862-ae52-b99b582db7ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:26.072605 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35de58-1dc0-4862-ae52-b99b582db7ad service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:26.085537 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1291/2557] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:26.092544 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c7e8d-0872-4275-b836-fc0c7f3fb1f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:26.094016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c7e8d-0872-4275-b836-fc0c7f3fb1f4 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:26.104020 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1267/2558] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:26.496524 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35de58-1dc0-4862-ae52-b99b582db7ad service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:26.505983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35de58-1dc0-4862-ae52-b99b582db7ad service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:26.510724 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59190e63-b3a1-4b43-b67b-cc57dd92d80b tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d19b2a53274c618a77e59b81821edf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8032679b88443e9b51c4670e15a89fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:26.511401 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59190e63-b3a1-4b43-b67b-cc57dd92d80b tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:26.511762 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59190e63-b3a1-4b43-b67b-cc57dd92d80b tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:26.512071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59190e63-b3a1-4b43-b67b-cc57dd92d80b tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:26.512921 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59190e63-b3a1-4b43-b67b-cc57dd92d80b tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:49:26.513237 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59190e63-b3a1-4b43-b67b-cc57dd92d80b tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:26.514917 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59190e63-b3a1-4b43-b67b-cc57dd92d80b tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:26.527106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1292/2559] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:49:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:49:26.531920 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c7e8d-0872-4275-b836-fc0c7f3fb1f4 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:26.543925 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c7e8d-0872-4275-b836-fc0c7f3fb1f4 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:26.549608 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce5ecf-166c-490f-93ec-a82f70354c7d tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d19b2a53274c618a77e59b81821edf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8032679b88443e9b51c4670e15a89fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:26.550269 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce5ecf-166c-490f-93ec-a82f70354c7d tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:26.550560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce5ecf-166c-490f-93ec-a82f70354c7d tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:26.550892 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce5ecf-166c-490f-93ec-a82f70354c7d tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:26.551587 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce5ecf-166c-490f-93ec-a82f70354c7d tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:26.553515 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce5ecf-166c-490f-93ec-a82f70354c7d tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:26.581584 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1268/2560] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:26 2022] POST /identity/v3/projects => generated 355 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:26.586456 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59190e63-b3a1-4b43-b67b-cc57dd92d80b tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:26.597532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59190e63-b3a1-4b43-b67b-cc57dd92d80b tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:26.666376 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d6c11-ed23-43a5-8eb4-2bd2103d1277 tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d19b2a53274c618a77e59b81821edf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8032679b88443e9b51c4670e15a89fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:26.667164 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d6c11-ed23-43a5-8eb4-2bd2103d1277 tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:26.667450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d6c11-ed23-43a5-8eb4-2bd2103d1277 tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:26.667730 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d6c11-ed23-43a5-8eb4-2bd2103d1277 tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:26.668553 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d6c11-ed23-43a5-8eb4-2bd2103d1277 tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:49:26.668864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d6c11-ed23-43a5-8eb4-2bd2103d1277 tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:26.670530 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d6c11-ed23-43a5-8eb4-2bd2103d1277 tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:26.683632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1293/2561] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:49:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:49:26.723739 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce5ecf-166c-490f-93ec-a82f70354c7d tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:26.734953 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce5ecf-166c-490f-93ec-a82f70354c7d tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:26.739748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7110a-25b5-4350-b682-0a84c2a09e9a tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d19b2a53274c618a77e59b81821edf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8032679b88443e9b51c4670e15a89fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:26.740624 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7110a-25b5-4350-b682-0a84c2a09e9a tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:26.740912 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7110a-25b5-4350-b682-0a84c2a09e9a tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:26.741193 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7110a-25b5-4350-b682-0a84c2a09e9a tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] PATH_INFO: `/v3/projects/ec757dfe7352458c87db9c4f9a3f565d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:26.742418 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7110a-25b5-4350-b682-0a84c2a09e9a tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ec757dfe7352458c87db9c4f9a3f565d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:26.744425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7110a-25b5-4350-b682-0a84c2a09e9a tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:26.797798 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-79a7110a-25b5-4350-b682-0a84c2a09e9a tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec757dfe7352458c87db9c4f9a3f565d', 'request_id': 'req-79a7110a-25b5-4350-b682-0a84c2a09e9a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:26.799530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:26.805924 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-79a7110a-25b5-4350-b682-0a84c2a09e9a tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec757dfe7352458c87db9c4f9a3f565d', 'request_id': 'req-79a7110a-25b5-4350-b682-0a84c2a09e9a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:26.814130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-79a7110a-25b5-4350-b682-0a84c2a09e9a tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec757dfe7352458c87db9c4f9a3f565d', 'request_id': 'req-79a7110a-25b5-4350-b682-0a84c2a09e9a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:26.825942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-79a7110a-25b5-4350-b682-0a84c2a09e9a tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] The token cache is being invalidate because project ec757dfe7352458c87db9c4f9a3f565d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:26.826231 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-79a7110a-25b5-4350-b682-0a84c2a09e9a tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:26.826983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-79a7110a-25b5-4350-b682-0a84c2a09e9a tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:26.829163 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1269/2562] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:26 2022] DELETE /identity/v3/projects/ec757dfe7352458c87db9c4f9a3f565d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:27.049940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d6c11-ed23-43a5-8eb4-2bd2103d1277 tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:27.051668 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e15d6c11-ed23-43a5-8eb4-2bd2103d1277 tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:27.084408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:27.121260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d6c11-ed23-43a5-8eb4-2bd2103d1277 tempest-VolumeQuotaClassesTest-1202994791 tempest-VolumeQuotaClassesTest-1202994791-project-admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:27.206796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b360c78-b695-4b43-851b-54f9248c1466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:27.207725 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b360c78-b695-4b43-851b-54f9248c1466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:27.208003 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b360c78-b695-4b43-851b-54f9248c1466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:27.208336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b360c78-b695-4b43-851b-54f9248c1466 admin admin] PATH_INFO: `/v3/users/b6fdf1f3107744e8874dc26e9574f91d` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:27.209658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b360c78-b695-4b43-851b-54f9248c1466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6fdf1f3107744e8874dc26e9574f91d)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:27.211813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b360c78-b695-4b43-851b-54f9248c1466 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:27.276730 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7b360c78-b695-4b43-851b-54f9248c1466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6fdf1f3107744e8874dc26e9574f91d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:27.290153 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7b360c78-b695-4b43-851b-54f9248c1466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6fdf1f3107744e8874dc26e9574f91d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:27.290909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7b360c78-b695-4b43-851b-54f9248c1466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6fdf1f3107744e8874dc26e9574f91d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:27.299938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7b360c78-b695-4b43-851b-54f9248c1466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6fdf1f3107744e8874dc26e9574f91d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:27.300580 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7b360c78-b695-4b43-851b-54f9248c1466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6fdf1f3107744e8874dc26e9574f91d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:27.319712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1294/2563] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:27 2022] DELETE /identity/v3/users/b6fdf1f3107744e8874dc26e9574f91d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:27.331219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e596d-b060-4818-aecb-099e8124a1b4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:27.331219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e596d-b060-4818-aecb-099e8124a1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:27.331865 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e596d-b060-4818-aecb-099e8124a1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:27.364750 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0c9e596d-b060-4818-aecb-099e8124a1b4 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:27.366560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0c9e596d-b060-4818-aecb-099e8124a1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:27.458494 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1270/2564] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:27.465396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b360c78-b695-4b43-851b-54f9248c1466 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:27.467069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7b360c78-b695-4b43-851b-54f9248c1466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:27.538916 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b360c78-b695-4b43-851b-54f9248c1466 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:27.545457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce301f98-c57a-444b-9f3f-16b40ee5b2cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:27.546896 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce301f98-c57a-444b-9f3f-16b40ee5b2cb service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:27.547401 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce301f98-c57a-444b-9f3f-16b40ee5b2cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:27.547549 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce301f98-c57a-444b-9f3f-16b40ee5b2cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:27.556803 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:27.559665 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce301f98-c57a-444b-9f3f-16b40ee5b2cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:27.561157 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce301f98-c57a-444b-9f3f-16b40ee5b2cb service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:27.573650 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1295/2565] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:27.821095 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50945ab7-604b-49a4-a2bc-82c49c4a3ee3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:27.821587 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50945ab7-604b-49a4-a2bc-82c49c4a3ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:27.822062 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50945ab7-604b-49a4-a2bc-82c49c4a3ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:27.844253 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-50945ab7-604b-49a4-a2bc-82c49c4a3ee3 None None] MFA Rules not processed for user `ebf3257328b94092b544cb0dadb789c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:27.845729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-50945ab7-604b-49a4-a2bc-82c49c4a3ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:27.914955 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1271/2566] 10.222.0.110 () {58 vars in 972 bytes} [Thu May 26 16:49:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:27.924241 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce301f98-c57a-444b-9f3f-16b40ee5b2cb service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:27.925440 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ce301f98-c57a-444b-9f3f-16b40ee5b2cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:27.937940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50945ab7-604b-49a4-a2bc-82c49c4a3ee3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:27.939420 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-50945ab7-604b-49a4-a2bc-82c49c4a3ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:27.940625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce301f98-c57a-444b-9f3f-16b40ee5b2cb service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:27.956517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d73cd-6fd3-4801-a60a-23c80438534a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:27.957500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d73cd-6fd3-4801-a60a-23c80438534a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:27.958230 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d73cd-6fd3-4801-a60a-23c80438534a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:27.958230 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d73cd-6fd3-4801-a60a-23c80438534a admin admin] PATH_INFO: `/v3/projects/26c7101151c04d2bb9b050f3bec9236f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:27.959689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d73cd-6fd3-4801-a60a-23c80438534a admin admin] RBAC: Authorizing `identity:delete_project(project_id=26c7101151c04d2bb9b050f3bec9236f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:27.961910 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d73cd-6fd3-4801-a60a-23c80438534a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:28.022124 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1f5d73cd-6fd3-4801-a60a-23c80438534a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c7101151c04d2bb9b050f3bec9236f', 'request_id': 'req-1f5d73cd-6fd3-4801-a60a-23c80438534a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:28.022433 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50945ab7-604b-49a4-a2bc-82c49c4a3ee3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:28.029168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1f5d73cd-6fd3-4801-a60a-23c80438534a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c7101151c04d2bb9b050f3bec9236f', 'request_id': 'req-1f5d73cd-6fd3-4801-a60a-23c80438534a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:28.036365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1f5d73cd-6fd3-4801-a60a-23c80438534a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c7101151c04d2bb9b050f3bec9236f', 'request_id': 'req-1f5d73cd-6fd3-4801-a60a-23c80438534a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:28.051096 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1f5d73cd-6fd3-4801-a60a-23c80438534a admin admin] The token cache is being invalidate because project 26c7101151c04d2bb9b050f3bec9236f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:28.051386 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1f5d73cd-6fd3-4801-a60a-23c80438534a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:28.052040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1f5d73cd-6fd3-4801-a60a-23c80438534a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:28.052993 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:28.053696 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1296/2567] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:27 2022] DELETE /identity/v3/projects/26c7101151c04d2bb9b050f3bec9236f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:28.058116 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d73cd-6fd3-4801-a60a-23c80438534a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:28.059821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1f5d73cd-6fd3-4801-a60a-23c80438534a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:28.100359 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03aa91-1d36-4f82-8ad8-1d7973f806c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4502c57e324c31a8bce12770a92371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:28.101037 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03aa91-1d36-4f82-8ad8-1d7973f806c2 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:28.101323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03aa91-1d36-4f82-8ad8-1d7973f806c2 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:28.101601 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03aa91-1d36-4f82-8ad8-1d7973f806c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:28.103918 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9b03aa91-1d36-4f82-8ad8-1d7973f806c2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:28.163746 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d73cd-6fd3-4801-a60a-23c80438534a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:28.172661 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c0a23-ac8f-4c38-a7da-62a57bf7a467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:28.174062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c0a23-ac8f-4c38-a7da-62a57bf7a467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:28.174411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c0a23-ac8f-4c38-a7da-62a57bf7a467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:28.174752 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c0a23-ac8f-4c38-a7da-62a57bf7a467 admin admin] PATH_INFO: `/v3/users/05d19b2a53274c618a77e59b81821edf` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:28.176586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c0a23-ac8f-4c38-a7da-62a57bf7a467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05d19b2a53274c618a77e59b81821edf)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:28.179714 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c0a23-ac8f-4c38-a7da-62a57bf7a467 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:28.196644 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03aa91-1d36-4f82-8ad8-1d7973f806c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:28.198845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03aa91-1d36-4f82-8ad8-1d7973f806c2 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:28.213198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1272/2568] 10.222.0.110 () {60 vars in 1389 bytes} [Thu May 26 16:49:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 16:49:28.250366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-230c0a23-ac8f-4c38-a7da-62a57bf7a467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05d19b2a53274c618a77e59b81821edf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:28.266180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-230c0a23-ac8f-4c38-a7da-62a57bf7a467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05d19b2a53274c618a77e59b81821edf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:28.267379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-230c0a23-ac8f-4c38-a7da-62a57bf7a467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05d19b2a53274c618a77e59b81821edf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:28.278358 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-230c0a23-ac8f-4c38-a7da-62a57bf7a467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05d19b2a53274c618a77e59b81821edf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:28.279132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-230c0a23-ac8f-4c38-a7da-62a57bf7a467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05d19b2a53274c618a77e59b81821edf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:28.290361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:28.298263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1297/2569] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:28 2022] DELETE /identity/v3/users/05d19b2a53274c618a77e59b81821edf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:28.703189 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03aa91-1d36-4f82-8ad8-1d7973f806c2 service swift] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:28.714740 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03aa91-1d36-4f82-8ad8-1d7973f806c2 service swift] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:28.807538 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd799d4-81d6-4788-af96-14398be370f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:28.808547 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd799d4-81d6-4788-af96-14398be370f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:28.808727 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd799d4-81d6-4788-af96-14398be370f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:28.809000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd799d4-81d6-4788-af96-14398be370f5 admin admin] PATH_INFO: `/v3/projects/e8032679b88443e9b51c4670e15a89fc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:28.810186 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd799d4-81d6-4788-af96-14398be370f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8032679b88443e9b51c4670e15a89fc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:28.814698 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd799d4-81d6-4788-af96-14398be370f5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:28.878143 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ddd799d4-81d6-4788-af96-14398be370f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8032679b88443e9b51c4670e15a89fc', 'request_id': 'req-ddd799d4-81d6-4788-af96-14398be370f5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:28.888477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ddd799d4-81d6-4788-af96-14398be370f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8032679b88443e9b51c4670e15a89fc', 'request_id': 'req-ddd799d4-81d6-4788-af96-14398be370f5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:28.897710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ddd799d4-81d6-4788-af96-14398be370f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8032679b88443e9b51c4670e15a89fc', 'request_id': 'req-ddd799d4-81d6-4788-af96-14398be370f5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:28.905070 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:28.913833 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ddd799d4-81d6-4788-af96-14398be370f5 admin admin] The token cache is being invalidate because project e8032679b88443e9b51c4670e15a89fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:28.915403 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ddd799d4-81d6-4788-af96-14398be370f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:28.916287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ddd799d4-81d6-4788-af96-14398be370f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:28.918483 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1273/2570] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:28 2022] DELETE /identity/v3/projects/e8032679b88443e9b51c4670e15a89fc => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:28.924311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945bc02-17ba-4229-8b24-f1d8c8e20dad None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:28.924800 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945bc02-17ba-4229-8b24-f1d8c8e20dad None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:28.925095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945bc02-17ba-4229-8b24-f1d8c8e20dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:28.946240 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2945bc02-17ba-4229-8b24-f1d8c8e20dad None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:28.947496 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2945bc02-17ba-4229-8b24-f1d8c8e20dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:29.023840 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1298/2571] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:29.031745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d40bc-0bb2-42a0-ab83-bf12ef2e03b1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:29.032038 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d40bc-0bb2-42a0-ab83-bf12ef2e03b1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:29.032316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d40bc-0bb2-42a0-ab83-bf12ef2e03b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:29.052579 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8f7d40bc-0bb2-42a0-ab83-bf12ef2e03b1 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:29.053989 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8f7d40bc-0bb2-42a0-ab83-bf12ef2e03b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:29.062846 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1274/2572] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:29.067149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945bc02-17ba-4229-8b24-f1d8c8e20dad None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:29.077174 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945bc02-17ba-4229-8b24-f1d8c8e20dad None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:29.081754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f3ba3-0a74-42a2-9dd8-36096c80e2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:29.082409 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f3ba3-0a74-42a2-9dd8-36096c80e2eb admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:29.082737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f3ba3-0a74-42a2-9dd8-36096c80e2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:29.083018 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f3ba3-0a74-42a2-9dd8-36096c80e2eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:29.083779 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f3ba3-0a74-42a2-9dd8-36096c80e2eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:49:29.084707 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f3ba3-0a74-42a2-9dd8-36096c80e2eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:29.086677 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f3ba3-0a74-42a2-9dd8-36096c80e2eb admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:29.102027 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1299/2573] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:49:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:49:29.103883 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d40bc-0bb2-42a0-ab83-bf12ef2e03b1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:29.113888 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d40bc-0bb2-42a0-ab83-bf12ef2e03b1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:29.118673 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294b89d-17ac-4be6-bf8b-86009c41bfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:29.119333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294b89d-17ac-4be6-bf8b-86009c41bfb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:29.119620 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294b89d-17ac-4be6-bf8b-86009c41bfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:29.119888 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294b89d-17ac-4be6-bf8b-86009c41bfb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:29.120571 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294b89d-17ac-4be6-bf8b-86009c41bfb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:29.122596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294b89d-17ac-4be6-bf8b-86009c41bfb7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:29.153064 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1275/2574] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:29 2022] POST /identity/v3/projects => generated 384 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:29.154320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f3ba3-0a74-42a2-9dd8-36096c80e2eb admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:29.166091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f3ba3-0a74-42a2-9dd8-36096c80e2eb admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:29.226149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2b00b-718a-4c85-99ad-4232dda4fcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:29.226897 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2b00b-718a-4c85-99ad-4232dda4fcd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:29.227206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2b00b-718a-4c85-99ad-4232dda4fcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:29.227484 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2b00b-718a-4c85-99ad-4232dda4fcd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:29.228217 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2b00b-718a-4c85-99ad-4232dda4fcd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:29.230349 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2b00b-718a-4c85-99ad-4232dda4fcd8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:29.251700 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1300/2575] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:29 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:29.256421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294b89d-17ac-4be6-bf8b-86009c41bfb7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:29.268700 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294b89d-17ac-4be6-bf8b-86009c41bfb7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:29.276219 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2471b02-493d-4d45-b0d5-7e1aba2911fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:29.276901 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2471b02-493d-4d45-b0d5-7e1aba2911fc admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:29.277183 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2471b02-493d-4d45-b0d5-7e1aba2911fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:29.278102 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2471b02-493d-4d45-b0d5-7e1aba2911fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:29.278903 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2471b02-493d-4d45-b0d5-7e1aba2911fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:29.280481 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2471b02-493d-4d45-b0d5-7e1aba2911fc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:29.292875 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1276/2576] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:29 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:29.298845 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2b00b-718a-4c85-99ad-4232dda4fcd8 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:29.316103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2b00b-718a-4c85-99ad-4232dda4fcd8 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:29.323459 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63445ed-6b5d-4b64-ae74-8697ca6fed1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:29.324289 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63445ed-6b5d-4b64-ae74-8697ca6fed1b admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:29.324646 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63445ed-6b5d-4b64-ae74-8697ca6fed1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:29.324987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63445ed-6b5d-4b64-ae74-8697ca6fed1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:29.325791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63445ed-6b5d-4b64-ae74-8697ca6fed1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:29.327831 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63445ed-6b5d-4b64-ae74-8697ca6fed1b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:29.342052 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1301/2577] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:29 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:29.343900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2471b02-493d-4d45-b0d5-7e1aba2911fc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:29.360677 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2471b02-493d-4d45-b0d5-7e1aba2911fc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:29.366298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a97c0-899f-4119-8bcc-3931e59d8dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:29.367335 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a97c0-899f-4119-8bcc-3931e59d8dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:29.367694 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a97c0-899f-4119-8bcc-3931e59d8dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:29.368047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a97c0-899f-4119-8bcc-3931e59d8dd0 admin admin] PATH_INFO: `/v3/projects/d5537de662114b5ba9ae57050f0cfaeb/users/aff5a577358240b5a9fc52593793f077/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:29.388740 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a97c0-899f-4119-8bcc-3931e59d8dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5537de662114b5ba9ae57050f0cfaeb, user_id=aff5a577358240b5a9fc52593793f077, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:29.391460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a97c0-899f-4119-8bcc-3931e59d8dd0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:29.407613 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1277/2578] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:29 2022] PUT /identity/v3/projects/d5537de662114b5ba9ae57050f0cfaeb/users/aff5a577358240b5a9fc52593793f077/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:29.418276 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67006133-ee5d-4c1e-8ad9-fe9974798d1e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:29.419187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67006133-ee5d-4c1e-8ad9-fe9974798d1e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:29.419187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67006133-ee5d-4c1e-8ad9-fe9974798d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:29.456319 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-67006133-ee5d-4c1e-8ad9-fe9974798d1e None None] MFA Rules not processed for user `aff5a577358240b5a9fc52593793f077`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:29.457787 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-67006133-ee5d-4c1e-8ad9-fe9974798d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:29.519618 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:29.531788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1302/2579] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:29.536420 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a97c0-899f-4119-8bcc-3931e59d8dd0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:29.604656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a97c0-899f-4119-8bcc-3931e59d8dd0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:29.611000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e07db-54b7-4588-acd6-2e87ae757384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:29.611826 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e07db-54b7-4588-acd6-2e87ae757384 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:29.612333 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e07db-54b7-4588-acd6-2e87ae757384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:29.612843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e07db-54b7-4588-acd6-2e87ae757384 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:29.614130 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e07db-54b7-4588-acd6-2e87ae757384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:29.617296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e07db-54b7-4588-acd6-2e87ae757384 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:29.647268 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1278/2580] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:29 2022] POST /identity/v3/projects => generated 384 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:29.648340 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67006133-ee5d-4c1e-8ad9-fe9974798d1e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:29.662597 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67006133-ee5d-4c1e-8ad9-fe9974798d1e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:29.726182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286a3ff-3b94-4168-b9d5-b1b5c97d503b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:29.726805 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286a3ff-3b94-4168-b9d5-b1b5c97d503b admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:29.727095 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286a3ff-3b94-4168-b9d5-b1b5c97d503b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:29.727385 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286a3ff-3b94-4168-b9d5-b1b5c97d503b admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:29.728516 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286a3ff-3b94-4168-b9d5-b1b5c97d503b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:29.732245 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286a3ff-3b94-4168-b9d5-b1b5c97d503b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:29.756129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1303/2581] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:29 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:29.760134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e07db-54b7-4588-acd6-2e87ae757384 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:29.771266 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e07db-54b7-4588-acd6-2e87ae757384 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:29.776105 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddeb76-c9f3-4583-b8bb-e4294bc2ee89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:29.776780 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddeb76-c9f3-4583-b8bb-e4294bc2ee89 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:29.777069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddeb76-c9f3-4583-b8bb-e4294bc2ee89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:29.777346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddeb76-c9f3-4583-b8bb-e4294bc2ee89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:29.778070 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deddeb76-c9f3-4583-b8bb-e4294bc2ee89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:29.779767 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deddeb76-c9f3-4583-b8bb-e4294bc2ee89 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:29.791047 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1279/2582] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:29 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:29.795426 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286a3ff-3b94-4168-b9d5-b1b5c97d503b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:29.807156 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286a3ff-3b94-4168-b9d5-b1b5c97d503b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:29.812331 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c96317-5e9a-4ef2-b6c6-e4ec905f2527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:29.813213 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c96317-5e9a-4ef2-b6c6-e4ec905f2527 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:29.813497 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c96317-5e9a-4ef2-b6c6-e4ec905f2527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:29.813809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c96317-5e9a-4ef2-b6c6-e4ec905f2527 admin admin] PATH_INFO: `/v3/projects/64580757e3bd4d738f1cc4eb52171b8e/users/d44dcda18e3c448aaefc2979aa9e31ae/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:29.830031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c96317-5e9a-4ef2-b6c6-e4ec905f2527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64580757e3bd4d738f1cc4eb52171b8e, user_id=d44dcda18e3c448aaefc2979aa9e31ae, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:29.832815 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c96317-5e9a-4ef2-b6c6-e4ec905f2527 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:29.849812 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1304/2583] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:29 2022] PUT /identity/v3/projects/64580757e3bd4d738f1cc4eb52171b8e/users/d44dcda18e3c448aaefc2979aa9e31ae/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:29.853895 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddeb76-c9f3-4583-b8bb-e4294bc2ee89 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:29.866820 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddeb76-c9f3-4583-b8bb-e4294bc2ee89 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:29.931878 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921dfb6-b1df-401f-8a65-b8619060c5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:29.932573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921dfb6-b1df-401f-8a65-b8619060c5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:29.932859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921dfb6-b1df-401f-8a65-b8619060c5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:29.933141 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921dfb6-b1df-401f-8a65-b8619060c5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:29.933934 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921dfb6-b1df-401f-8a65-b8619060c5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:29.935558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921dfb6-b1df-401f-8a65-b8619060c5c0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:29.951111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1280/2584] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:29 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:29.951913 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c96317-5e9a-4ef2-b6c6-e4ec905f2527 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:29.964726 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c96317-5e9a-4ef2-b6c6-e4ec905f2527 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:29.969465 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505de45-3bde-4eca-9448-64bd4c2bc51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:29.970356 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505de45-3bde-4eca-9448-64bd4c2bc51c admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:29.970690 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505de45-3bde-4eca-9448-64bd4c2bc51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:29.970961 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505de45-3bde-4eca-9448-64bd4c2bc51c admin admin] PATH_INFO: `/v3/projects/64580757e3bd4d738f1cc4eb52171b8e/users/d44dcda18e3c448aaefc2979aa9e31ae/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:29.973097 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505de45-3bde-4eca-9448-64bd4c2bc51c admin admin] RBAC: Authorizing `identity:create_grant(project_id=64580757e3bd4d738f1cc4eb52171b8e, user_id=d44dcda18e3c448aaefc2979aa9e31ae, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:29.975947 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505de45-3bde-4eca-9448-64bd4c2bc51c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:29.987781 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1305/2585] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:29 2022] PUT /identity/v3/projects/64580757e3bd4d738f1cc4eb52171b8e/users/d44dcda18e3c448aaefc2979aa9e31ae/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:29.998394 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e71e67-0b7e-4904-8347-b46833b2bfca None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:29.998731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e71e67-0b7e-4904-8347-b46833b2bfca None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:29.999605 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e71e67-0b7e-4904-8347-b46833b2bfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:30.007685 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:30.028059 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-88e71e67-0b7e-4904-8347-b46833b2bfca None None] MFA Rules not processed for user `d44dcda18e3c448aaefc2979aa9e31ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:30.029296 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-88e71e67-0b7e-4904-8347-b46833b2bfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:30.103931 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1281/2586] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:30.115844 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505de45-3bde-4eca-9448-64bd4c2bc51c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:30.117651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e505de45-3bde-4eca-9448-64bd4c2bc51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:30.180941 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505de45-3bde-4eca-9448-64bd4c2bc51c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:30.185267 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b495e8d-035d-4b9d-9a8f-e5531f13fea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:30.185931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b495e8d-035d-4b9d-9a8f-e5531f13fea7 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:30.186222 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b495e8d-035d-4b9d-9a8f-e5531f13fea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:30.186836 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b495e8d-035d-4b9d-9a8f-e5531f13fea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:30.255328 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b495e8d-035d-4b9d-9a8f-e5531f13fea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:30.257467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b495e8d-035d-4b9d-9a8f-e5531f13fea7 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:30.262984 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:30.270959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1306/2587] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:33.465461 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e71e67-0b7e-4904-8347-b46833b2bfca None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:33.468349 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-88e71e67-0b7e-4904-8347-b46833b2bfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:33.547117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e71e67-0b7e-4904-8347-b46833b2bfca None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:33.551864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e0779-1fe6-4b45-bc7c-870525b50ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:33.553088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e0779-1fe6-4b45-bc7c-870525b50ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:33.553088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e0779-1fe6-4b45-bc7c-870525b50ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:33.553404 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e0779-1fe6-4b45-bc7c-870525b50ec9 admin admin] PATH_INFO: `/v3/users/3572d07b706047a5a2ffbb01253dc69f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:33.554530 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e0779-1fe6-4b45-bc7c-870525b50ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3572d07b706047a5a2ffbb01253dc69f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:33.556571 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e0779-1fe6-4b45-bc7c-870525b50ec9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:33.607114 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4d9e0779-1fe6-4b45-bc7c-870525b50ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3572d07b706047a5a2ffbb01253dc69f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:33.607845 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4d9e0779-1fe6-4b45-bc7c-870525b50ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3572d07b706047a5a2ffbb01253dc69f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:33.615298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4d9e0779-1fe6-4b45-bc7c-870525b50ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3572d07b706047a5a2ffbb01253dc69f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:33.615994 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4d9e0779-1fe6-4b45-bc7c-870525b50ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3572d07b706047a5a2ffbb01253dc69f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:33.625251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4d9e0779-1fe6-4b45-bc7c-870525b50ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3572d07b706047a5a2ffbb01253dc69f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:33.647037 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1282/2588] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:33 2022] DELETE /identity/v3/users/3572d07b706047a5a2ffbb01253dc69f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:33.652023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a145b5-a185-4607-b8b2-d14c1ff114f9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:33.652933 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a145b5-a185-4607-b8b2-d14c1ff114f9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:33.652933 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a145b5-a185-4607-b8b2-d14c1ff114f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:33.675026 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-87a145b5-a185-4607-b8b2-d14c1ff114f9 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:33.676284 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-87a145b5-a185-4607-b8b2-d14c1ff114f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:33.740090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1307/2589] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:33.750136 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e0779-1fe6-4b45-bc7c-870525b50ec9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:33.751606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4d9e0779-1fe6-4b45-bc7c-870525b50ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:33.764451 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:33.816127 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e0779-1fe6-4b45-bc7c-870525b50ec9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:33.819709 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a0362-d87f-4e95-b0f3-4eb2bfaa2974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:33.821124 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a0362-d87f-4e95-b0f3-4eb2bfaa2974 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:33.821124 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a0362-d87f-4e95-b0f3-4eb2bfaa2974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:33.821331 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a0362-d87f-4e95-b0f3-4eb2bfaa2974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:33.834850 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a0362-d87f-4e95-b0f3-4eb2bfaa2974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:33.836279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a0362-d87f-4e95-b0f3-4eb2bfaa2974 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:33.846857 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1283/2590] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:34.119934 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a145b5-a185-4607-b8b2-d14c1ff114f9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:34.121335 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-87a145b5-a185-4607-b8b2-d14c1ff114f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:34.136917 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a145b5-a185-4607-b8b2-d14c1ff114f9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:34.142446 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56ce64-3198-466d-ae1a-03494d883830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:34.143342 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56ce64-3198-466d-ae1a-03494d883830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:34.143671 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56ce64-3198-466d-ae1a-03494d883830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:34.143971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56ce64-3198-466d-ae1a-03494d883830 admin admin] PATH_INFO: `/v3/projects/0a4bf0eeca8043b6bf75aac174df83e0` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:34.146411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56ce64-3198-466d-ae1a-03494d883830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a4bf0eeca8043b6bf75aac174df83e0)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:34.148554 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56ce64-3198-466d-ae1a-03494d883830 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:34.196438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9e56ce64-3198-466d-ae1a-03494d883830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a4bf0eeca8043b6bf75aac174df83e0', 'request_id': 'req-9e56ce64-3198-466d-ae1a-03494d883830'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:34.203380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9e56ce64-3198-466d-ae1a-03494d883830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a4bf0eeca8043b6bf75aac174df83e0', 'request_id': 'req-9e56ce64-3198-466d-ae1a-03494d883830'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:34.209300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9e56ce64-3198-466d-ae1a-03494d883830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a4bf0eeca8043b6bf75aac174df83e0', 'request_id': 'req-9e56ce64-3198-466d-ae1a-03494d883830'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:34.221960 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9e56ce64-3198-466d-ae1a-03494d883830 admin admin] The token cache is being invalidate because project 0a4bf0eeca8043b6bf75aac174df83e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:34.222249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9e56ce64-3198-466d-ae1a-03494d883830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:34.222892 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9e56ce64-3198-466d-ae1a-03494d883830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:34.224467 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1308/2591] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:34 2022] DELETE /identity/v3/projects/0a4bf0eeca8043b6bf75aac174df83e0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:34.228630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a0362-d87f-4e95-b0f3-4eb2bfaa2974 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:34.238562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a0362-d87f-4e95-b0f3-4eb2bfaa2974 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:34.295770 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17831ce-104b-4b32-8b10-9c3be36fe552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:34.296648 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17831ce-104b-4b32-8b10-9c3be36fe552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:34.296930 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17831ce-104b-4b32-8b10-9c3be36fe552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:34.297206 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17831ce-104b-4b32-8b10-9c3be36fe552 admin admin] PATH_INFO: `/v3/users/54a652c796ab4786bfc4cdcc377a15f4` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:34.298388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17831ce-104b-4b32-8b10-9c3be36fe552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a652c796ab4786bfc4cdcc377a15f4)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:34.300330 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17831ce-104b-4b32-8b10-9c3be36fe552 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:34.348723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d17831ce-104b-4b32-8b10-9c3be36fe552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a652c796ab4786bfc4cdcc377a15f4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:34.349321 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d17831ce-104b-4b32-8b10-9c3be36fe552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a652c796ab4786bfc4cdcc377a15f4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:34.356356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d17831ce-104b-4b32-8b10-9c3be36fe552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a652c796ab4786bfc4cdcc377a15f4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:34.357078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d17831ce-104b-4b32-8b10-9c3be36fe552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a652c796ab4786bfc4cdcc377a15f4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:34.367496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d17831ce-104b-4b32-8b10-9c3be36fe552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a652c796ab4786bfc4cdcc377a15f4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:34.388073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1284/2592] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:34 2022] DELETE /identity/v3/users/54a652c796ab4786bfc4cdcc377a15f4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:34.532100 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56ce64-3198-466d-ae1a-03494d883830 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:34.533483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9e56ce64-3198-466d-ae1a-03494d883830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:34.599007 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56ce64-3198-466d-ae1a-03494d883830 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:34.638768 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:34.655557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a645c6-d0c1-4ff3-8108-d3ea25073512 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:34.656217 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a645c6-d0c1-4ff3-8108-d3ea25073512 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:34.656540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a645c6-d0c1-4ff3-8108-d3ea25073512 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:34.656789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a645c6-d0c1-4ff3-8108-d3ea25073512 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:34.658937 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f5a645c6-d0c1-4ff3-8108-d3ea25073512 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:34.671411 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17831ce-104b-4b32-8b10-9c3be36fe552 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:34.673073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d17831ce-104b-4b32-8b10-9c3be36fe552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:34.721028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:34.735285 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a645c6-d0c1-4ff3-8108-d3ea25073512 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:34.737692 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a645c6-d0c1-4ff3-8108-d3ea25073512 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:34.747760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1309/2593] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:34.757403 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17831ce-104b-4b32-8b10-9c3be36fe552 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:34.762724 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7e51c-89ad-4295-bb3a-234feac216d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:34.763599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7e51c-89ad-4295-bb3a-234feac216d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:34.763936 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7e51c-89ad-4295-bb3a-234feac216d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:34.764215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7e51c-89ad-4295-bb3a-234feac216d8 admin admin] PATH_INFO: `/v3/projects/6b02dd07398a46a4a7a371660220e8cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:34.765510 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7e51c-89ad-4295-bb3a-234feac216d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b02dd07398a46a4a7a371660220e8cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:34.767556 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7e51c-89ad-4295-bb3a-234feac216d8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:34.817450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b2b7e51c-89ad-4295-bb3a-234feac216d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b02dd07398a46a4a7a371660220e8cc', 'request_id': 'req-b2b7e51c-89ad-4295-bb3a-234feac216d8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:34.826495 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b2b7e51c-89ad-4295-bb3a-234feac216d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b02dd07398a46a4a7a371660220e8cc', 'request_id': 'req-b2b7e51c-89ad-4295-bb3a-234feac216d8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:34.833882 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b2b7e51c-89ad-4295-bb3a-234feac216d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b02dd07398a46a4a7a371660220e8cc', 'request_id': 'req-b2b7e51c-89ad-4295-bb3a-234feac216d8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:34.846636 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b2b7e51c-89ad-4295-bb3a-234feac216d8 admin admin] The token cache is being invalidate because project 6b02dd07398a46a4a7a371660220e8cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:34.846929 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b2b7e51c-89ad-4295-bb3a-234feac216d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:34.847609 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b2b7e51c-89ad-4295-bb3a-234feac216d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:34.849212 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1285/2594] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:34 2022] DELETE /identity/v3/projects/6b02dd07398a46a4a7a371660220e8cc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:34.854193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce7635-0ae3-4ff3-9f53-af1214df8c3e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:34.854490 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce7635-0ae3-4ff3-9f53-af1214df8c3e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:34.855889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce7635-0ae3-4ff3-9f53-af1214df8c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:34.873297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c5ce7635-0ae3-4ff3-9f53-af1214df8c3e None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:34.874520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c5ce7635-0ae3-4ff3-9f53-af1214df8c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:34.940226 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1310/2595] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:34.948190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386ae26-1a63-4c09-8f48-b1e1e1a05f72 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:34.948478 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386ae26-1a63-4c09-8f48-b1e1e1a05f72 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:34.949268 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386ae26-1a63-4c09-8f48-b1e1e1a05f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:34.969667 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0386ae26-1a63-4c09-8f48-b1e1e1a05f72 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:34.970897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0386ae26-1a63-4c09-8f48-b1e1e1a05f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:34.979536 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1286/2596] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:34.983865 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce7635-0ae3-4ff3-9f53-af1214df8c3e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:34.994130 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce7635-0ae3-4ff3-9f53-af1214df8c3e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:34.999648 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c01d77-ca7a-4072-bdca-033e734238a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:35.000326 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c01d77-ca7a-4072-bdca-033e734238a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:35.000629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c01d77-ca7a-4072-bdca-033e734238a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:35.000903 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c01d77-ca7a-4072-bdca-033e734238a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:35.001945 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c01d77-ca7a-4072-bdca-033e734238a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:49:35.002285 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c01d77-ca7a-4072-bdca-033e734238a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:35.006699 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c01d77-ca7a-4072-bdca-033e734238a2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:35.020704 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1311/2597] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:49:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:49:35.024618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386ae26-1a63-4c09-8f48-b1e1e1a05f72 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:35.034918 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386ae26-1a63-4c09-8f48-b1e1e1a05f72 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:35.042416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79d602-8f6f-423e-adcf-d1117fe2f14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:35.042416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79d602-8f6f-423e-adcf-d1117fe2f14b admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:35.042416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79d602-8f6f-423e-adcf-d1117fe2f14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:35.042416 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79d602-8f6f-423e-adcf-d1117fe2f14b admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:35.042962 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79d602-8f6f-423e-adcf-d1117fe2f14b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:35.044370 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79d602-8f6f-423e-adcf-d1117fe2f14b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:35.078366 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1287/2598] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:35 2022] POST /identity/v3/projects => generated 384 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:35.083517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c01d77-ca7a-4072-bdca-033e734238a2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:35.101209 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c01d77-ca7a-4072-bdca-033e734238a2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:35.164119 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed124e-984d-4892-9dfc-652ccf66fc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:35.164797 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed124e-984d-4892-9dfc-652ccf66fc6e admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:35.165077 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed124e-984d-4892-9dfc-652ccf66fc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:35.165352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed124e-984d-4892-9dfc-652ccf66fc6e admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:35.166047 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed124e-984d-4892-9dfc-652ccf66fc6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:35.168011 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed124e-984d-4892-9dfc-652ccf66fc6e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:35.195020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1312/2599] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:35 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:35.199315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79d602-8f6f-423e-adcf-d1117fe2f14b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:35.211662 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79d602-8f6f-423e-adcf-d1117fe2f14b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:35.216690 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcaa515-1e46-430e-989b-db882442cb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:35.217366 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaa515-1e46-430e-989b-db882442cb6b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:35.217649 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaa515-1e46-430e-989b-db882442cb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:35.217923 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaa515-1e46-430e-989b-db882442cb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:35.218695 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcaa515-1e46-430e-989b-db882442cb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:35.220290 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcaa515-1e46-430e-989b-db882442cb6b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:35.231395 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1288/2600] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:35 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:35.237798 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed124e-984d-4892-9dfc-652ccf66fc6e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:35.252152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed124e-984d-4892-9dfc-652ccf66fc6e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:35.256980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54a525-793b-4b93-804f-2f93bbc831d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:35.257667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54a525-793b-4b93-804f-2f93bbc831d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:35.257987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54a525-793b-4b93-804f-2f93bbc831d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:35.258303 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54a525-793b-4b93-804f-2f93bbc831d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:35.259089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54a525-793b-4b93-804f-2f93bbc831d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:35.260728 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54a525-793b-4b93-804f-2f93bbc831d4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:35.262186 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:35.273982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1313/2601] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:35 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:35.277935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcaa515-1e46-430e-989b-db882442cb6b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:35.288457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcaa515-1e46-430e-989b-db882442cb6b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:35.293184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ef114-5ebe-4078-a02f-9d9a382260e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:35.294070 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ef114-5ebe-4078-a02f-9d9a382260e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:35.294346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ef114-5ebe-4078-a02f-9d9a382260e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:35.294787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ef114-5ebe-4078-a02f-9d9a382260e1 admin admin] PATH_INFO: `/v3/projects/ef895557462c47f0b160925a3e4c53c5/users/364cef712a214feba29fe293ce02c2e3/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:35.312052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ef114-5ebe-4078-a02f-9d9a382260e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef895557462c47f0b160925a3e4c53c5, user_id=364cef712a214feba29fe293ce02c2e3, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:35.316177 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ef114-5ebe-4078-a02f-9d9a382260e1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:35.336428 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1289/2602] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:35 2022] PUT /identity/v3/projects/ef895557462c47f0b160925a3e4c53c5/users/364cef712a214feba29fe293ce02c2e3/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:35.347824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e6a27-09a2-4171-be51-a5ae72b417dc None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:35.348336 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e6a27-09a2-4171-be51-a5ae72b417dc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:35.348703 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e6a27-09a2-4171-be51-a5ae72b417dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:35.379451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-706e6a27-09a2-4171-be51-a5ae72b417dc None None] MFA Rules not processed for user `364cef712a214feba29fe293ce02c2e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:35.380689 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-706e6a27-09a2-4171-be51-a5ae72b417dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:35.450612 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1314/2603] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:35.458619 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ef114-5ebe-4078-a02f-9d9a382260e1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:35.522678 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:35.527023 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ef114-5ebe-4078-a02f-9d9a382260e1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:35.533969 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea55a8-748d-4bb5-ad14-21b8305f6e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:35.534680 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea55a8-748d-4bb5-ad14-21b8305f6e35 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:35.535083 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea55a8-748d-4bb5-ad14-21b8305f6e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:35.535543 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea55a8-748d-4bb5-ad14-21b8305f6e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:35.536229 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea55a8-748d-4bb5-ad14-21b8305f6e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:35.538398 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea55a8-748d-4bb5-ad14-21b8305f6e35 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:35.564117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1290/2604] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:35 2022] POST /identity/v3/projects => generated 382 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:35.568338 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e6a27-09a2-4171-be51-a5ae72b417dc None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:35.579154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e6a27-09a2-4171-be51-a5ae72b417dc None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:35.635949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eab238-a574-4b83-a52d-1577b5f3cd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:35.636545 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eab238-a574-4b83-a52d-1577b5f3cd82 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:35.636854 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eab238-a574-4b83-a52d-1577b5f3cd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:35.637345 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eab238-a574-4b83-a52d-1577b5f3cd82 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:35.638302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eab238-a574-4b83-a52d-1577b5f3cd82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:35.640754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eab238-a574-4b83-a52d-1577b5f3cd82 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:35.660944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1315/2605] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:35 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:35.665396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea55a8-748d-4bb5-ad14-21b8305f6e35 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:35.676653 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea55a8-748d-4bb5-ad14-21b8305f6e35 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:35.681540 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ff10e-97f5-40e2-ae9e-fb72ad1dd513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:35.682211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ff10e-97f5-40e2-ae9e-fb72ad1dd513 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:35.682499 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ff10e-97f5-40e2-ae9e-fb72ad1dd513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:35.682912 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ff10e-97f5-40e2-ae9e-fb72ad1dd513 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:35.683656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ff10e-97f5-40e2-ae9e-fb72ad1dd513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:35.685253 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ff10e-97f5-40e2-ae9e-fb72ad1dd513 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:35.695944 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1291/2606] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:35 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:35.700274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eab238-a574-4b83-a52d-1577b5f3cd82 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:35.710895 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eab238-a574-4b83-a52d-1577b5f3cd82 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:35.715625 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5ed13-2799-4dba-beba-0473a6d6956f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:35.716543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5ed13-2799-4dba-beba-0473a6d6956f admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:35.717334 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5ed13-2799-4dba-beba-0473a6d6956f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:35.717629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5ed13-2799-4dba-beba-0473a6d6956f admin admin] PATH_INFO: `/v3/projects/04e7ce83cce14fb6b80d60e0e95d50c9/users/541e3ee39ec744fcb2d3d71437ca91e7/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:35.734094 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5ed13-2799-4dba-beba-0473a6d6956f admin admin] RBAC: Authorizing `identity:create_grant(project_id=04e7ce83cce14fb6b80d60e0e95d50c9, user_id=541e3ee39ec744fcb2d3d71437ca91e7, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:35.736885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5ed13-2799-4dba-beba-0473a6d6956f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:35.749375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1316/2607] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:35 2022] PUT /identity/v3/projects/04e7ce83cce14fb6b80d60e0e95d50c9/users/541e3ee39ec744fcb2d3d71437ca91e7/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:35.753405 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ff10e-97f5-40e2-ae9e-fb72ad1dd513 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:35.763352 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ff10e-97f5-40e2-ae9e-fb72ad1dd513 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:35.824142 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e35441-6636-4612-b2a1-5c85691a977f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:35.824816 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e35441-6636-4612-b2a1-5c85691a977f admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:35.825098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e35441-6636-4612-b2a1-5c85691a977f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:35.825372 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e35441-6636-4612-b2a1-5c85691a977f admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:35.826090 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e35441-6636-4612-b2a1-5c85691a977f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:35.828209 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e35441-6636-4612-b2a1-5c85691a977f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:35.837913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1292/2608] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:35 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:35.842963 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5ed13-2799-4dba-beba-0473a6d6956f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:35.853368 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5ed13-2799-4dba-beba-0473a6d6956f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:35.858028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5e905-167e-4fbe-aaad-57c0a3b9ee9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:35.858938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5e905-167e-4fbe-aaad-57c0a3b9ee9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:35.859232 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5e905-167e-4fbe-aaad-57c0a3b9ee9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:35.859514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5e905-167e-4fbe-aaad-57c0a3b9ee9f admin admin] PATH_INFO: `/v3/projects/04e7ce83cce14fb6b80d60e0e95d50c9/users/541e3ee39ec744fcb2d3d71437ca91e7/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:35.861485 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5e905-167e-4fbe-aaad-57c0a3b9ee9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=04e7ce83cce14fb6b80d60e0e95d50c9, user_id=541e3ee39ec744fcb2d3d71437ca91e7, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:35.864184 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5e905-167e-4fbe-aaad-57c0a3b9ee9f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:35.874748 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1317/2609] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:35 2022] PUT /identity/v3/projects/04e7ce83cce14fb6b80d60e0e95d50c9/users/541e3ee39ec744fcb2d3d71437ca91e7/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:35.887263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d59f6-94b1-4ff0-b235-cb4c41c54d31 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:35.887599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d59f6-94b1-4ff0-b235-cb4c41c54d31 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:35.887889 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d59f6-94b1-4ff0-b235-cb4c41c54d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:35.916046 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-967d59f6-94b1-4ff0-b235-cb4c41c54d31 None None] MFA Rules not processed for user `541e3ee39ec744fcb2d3d71437ca91e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:35.917264 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-967d59f6-94b1-4ff0-b235-cb4c41c54d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:35.986656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1293/2610] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:35.996075 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5e905-167e-4fbe-aaad-57c0a3b9ee9f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:35.997802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1bd5e905-167e-4fbe-aaad-57c0a3b9ee9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:36.040068 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:36.055728 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5e905-167e-4fbe-aaad-57c0a3b9ee9f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:36.059344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360cad5-f7a4-469b-8ba0-81266cf66c43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:36.059990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360cad5-f7a4-469b-8ba0-81266cf66c43 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:36.060291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360cad5-f7a4-469b-8ba0-81266cf66c43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:36.060569 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360cad5-f7a4-469b-8ba0-81266cf66c43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:36.070111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360cad5-f7a4-469b-8ba0-81266cf66c43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:36.071571 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360cad5-f7a4-469b-8ba0-81266cf66c43 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:36.081652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1318/2611] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:36.179709 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d59f6-94b1-4ff0-b235-cb4c41c54d31 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:36.195490 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d59f6-94b1-4ff0-b235-cb4c41c54d31 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:36.200102 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d2c49-65e7-4c59-b590-7da55200599f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:36.200877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d2c49-65e7-4c59-b590-7da55200599f service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:36.201212 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d2c49-65e7-4c59-b590-7da55200599f service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:36.201991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d2c49-65e7-4c59-b590-7da55200599f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:36.253258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:36.267430 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d2c49-65e7-4c59-b590-7da55200599f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:36.267430 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d2c49-65e7-4c59-b590-7da55200599f service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:36.282127 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1294/2612] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:38.960238 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360cad5-f7a4-469b-8ba0-81266cf66c43 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:39.025753 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360cad5-f7a4-469b-8ba0-81266cf66c43 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:39.031054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16bb40-0099-4d71-b969-fc96a40193f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:39.031926 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16bb40-0099-4d71-b969-fc96a40193f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:39.032209 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16bb40-0099-4d71-b969-fc96a40193f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:39.032483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16bb40-0099-4d71-b969-fc96a40193f5 admin admin] PATH_INFO: `/v3/users/364cef712a214feba29fe293ce02c2e3` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:39.033667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16bb40-0099-4d71-b969-fc96a40193f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=364cef712a214feba29fe293ce02c2e3)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:39.035629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16bb40-0099-4d71-b969-fc96a40193f5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:39.082766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7d16bb40-0099-4d71-b969-fc96a40193f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '364cef712a214feba29fe293ce02c2e3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.096070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7d16bb40-0099-4d71-b969-fc96a40193f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '364cef712a214feba29fe293ce02c2e3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.096761 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7d16bb40-0099-4d71-b969-fc96a40193f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '364cef712a214feba29fe293ce02c2e3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.104188 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7d16bb40-0099-4d71-b969-fc96a40193f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '364cef712a214feba29fe293ce02c2e3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.104902 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7d16bb40-0099-4d71-b969-fc96a40193f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '364cef712a214feba29fe293ce02c2e3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.117659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1319/2613] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:38 2022] DELETE /identity/v3/users/364cef712a214feba29fe293ce02c2e3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:39.122492 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dbe04-22f6-45af-a2d3-161c3f88e67e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:39.123491 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dbe04-22f6-45af-a2d3-161c3f88e67e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:39.123656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dbe04-22f6-45af-a2d3-161c3f88e67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:39.142484 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-607dbe04-22f6-45af-a2d3-161c3f88e67e None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:39.143729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-607dbe04-22f6-45af-a2d3-161c3f88e67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:39.206307 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1295/2614] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:39.216781 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16bb40-0099-4d71-b969-fc96a40193f5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:39.218280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7d16bb40-0099-4d71-b969-fc96a40193f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:39.281821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16bb40-0099-4d71-b969-fc96a40193f5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:39.285445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273b343-85c3-4ac5-8ddd-e40143f85dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:39.286103 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273b343-85c3-4ac5-8ddd-e40143f85dcb service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:39.286390 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273b343-85c3-4ac5-8ddd-e40143f85dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:39.286702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273b343-85c3-4ac5-8ddd-e40143f85dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:39.296022 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273b343-85c3-4ac5-8ddd-e40143f85dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:39.297451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273b343-85c3-4ac5-8ddd-e40143f85dcb service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:39.307050 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1320/2615] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:39.573355 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dbe04-22f6-45af-a2d3-161c3f88e67e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:39.574854 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-607dbe04-22f6-45af-a2d3-161c3f88e67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:39.589083 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dbe04-22f6-45af-a2d3-161c3f88e67e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:39.594945 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6db212-b4d4-4f05-a867-651f153ad814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:39.596069 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6db212-b4d4-4f05-a867-651f153ad814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:39.596415 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6db212-b4d4-4f05-a867-651f153ad814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:39.596844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6db212-b4d4-4f05-a867-651f153ad814 admin admin] PATH_INFO: `/v3/projects/ef895557462c47f0b160925a3e4c53c5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:39.598438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6db212-b4d4-4f05-a867-651f153ad814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef895557462c47f0b160925a3e4c53c5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:39.600681 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6db212-b4d4-4f05-a867-651f153ad814 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:39.658744 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7e6db212-b4d4-4f05-a867-651f153ad814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef895557462c47f0b160925a3e4c53c5', 'request_id': 'req-7e6db212-b4d4-4f05-a867-651f153ad814'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.670962 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7e6db212-b4d4-4f05-a867-651f153ad814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef895557462c47f0b160925a3e4c53c5', 'request_id': 'req-7e6db212-b4d4-4f05-a867-651f153ad814'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.677207 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273b343-85c3-4ac5-8ddd-e40143f85dcb service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:39.678817 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a273b343-85c3-4ac5-8ddd-e40143f85dcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:39.679670 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7e6db212-b4d4-4f05-a867-651f153ad814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef895557462c47f0b160925a3e4c53c5', 'request_id': 'req-7e6db212-b4d4-4f05-a867-651f153ad814'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.687629 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:39.693193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273b343-85c3-4ac5-8ddd-e40143f85dcb service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:39.695913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7e6db212-b4d4-4f05-a867-651f153ad814 admin admin] The token cache is being invalidate because project ef895557462c47f0b160925a3e4c53c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:39.696378 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7e6db212-b4d4-4f05-a867-651f153ad814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.697396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7e6db212-b4d4-4f05-a867-651f153ad814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.699750 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1296/2616] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:39 2022] DELETE /identity/v3/projects/ef895557462c47f0b160925a3e4c53c5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:39.704667 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6db212-b4d4-4f05-a867-651f153ad814 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:39.706268 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7e6db212-b4d4-4f05-a867-651f153ad814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:39.766683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a08b6-77ca-45f1-811b-d9eee5578d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:39.767592 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a08b6-77ca-45f1-811b-d9eee5578d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:39.767876 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a08b6-77ca-45f1-811b-d9eee5578d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:39.768157 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a08b6-77ca-45f1-811b-d9eee5578d79 admin admin] PATH_INFO: `/v3/users/aff5a577358240b5a9fc52593793f077` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:39.769378 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a08b6-77ca-45f1-811b-d9eee5578d79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff5a577358240b5a9fc52593793f077)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:39.771360 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a08b6-77ca-45f1-811b-d9eee5578d79 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:39.779315 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6db212-b4d4-4f05-a867-651f153ad814 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:39.784944 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48448dd-d192-409b-b450-d1e83ee69e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:39.785854 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48448dd-d192-409b-b450-d1e83ee69e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:39.786124 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48448dd-d192-409b-b450-d1e83ee69e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:39.786403 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48448dd-d192-409b-b450-d1e83ee69e61 admin admin] PATH_INFO: `/v3/users/541e3ee39ec744fcb2d3d71437ca91e7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:39.787945 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48448dd-d192-409b-b450-d1e83ee69e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=541e3ee39ec744fcb2d3d71437ca91e7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:39.789869 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48448dd-d192-409b-b450-d1e83ee69e61 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:39.817600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:39.823588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b30a08b6-77ca-45f1-811b-d9eee5578d79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff5a577358240b5a9fc52593793f077'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.837379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b30a08b6-77ca-45f1-811b-d9eee5578d79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff5a577358240b5a9fc52593793f077'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.838171 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b30a08b6-77ca-45f1-811b-d9eee5578d79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff5a577358240b5a9fc52593793f077'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.851044 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b30a08b6-77ca-45f1-811b-d9eee5578d79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff5a577358240b5a9fc52593793f077'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.851884 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b30a08b6-77ca-45f1-811b-d9eee5578d79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff5a577358240b5a9fc52593793f077'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.859153 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f48448dd-d192-409b-b450-d1e83ee69e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '541e3ee39ec744fcb2d3d71437ca91e7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.859986 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f48448dd-d192-409b-b450-d1e83ee69e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '541e3ee39ec744fcb2d3d71437ca91e7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.865252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1321/2617] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:39 2022] DELETE /identity/v3/users/aff5a577358240b5a9fc52593793f077 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:39.869842 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f48448dd-d192-409b-b450-d1e83ee69e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '541e3ee39ec744fcb2d3d71437ca91e7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.870459 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f48448dd-d192-409b-b450-d1e83ee69e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '541e3ee39ec744fcb2d3d71437ca91e7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.871102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcd9af-fbdf-48a1-b487-7b1b9b084a90 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:39.871398 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcd9af-fbdf-48a1-b487-7b1b9b084a90 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:39.871682 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcd9af-fbdf-48a1-b487-7b1b9b084a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:39.880879 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f48448dd-d192-409b-b450-d1e83ee69e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '541e3ee39ec744fcb2d3d71437ca91e7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:39.889959 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d7bcd9af-fbdf-48a1-b487-7b1b9b084a90 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:39.891204 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d7bcd9af-fbdf-48a1-b487-7b1b9b084a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:39.902336 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1297/2618] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:39 2022] DELETE /identity/v3/users/541e3ee39ec744fcb2d3d71437ca91e7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:39.961347 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1322/2619] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:39.972226 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48448dd-d192-409b-b450-d1e83ee69e61 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:39.973785 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f48448dd-d192-409b-b450-d1e83ee69e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:40.038220 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48448dd-d192-409b-b450-d1e83ee69e61 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:40.041818 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d9d22-89ce-4df1-be7b-a8e9d2b092e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:40.042477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d9d22-89ce-4df1-be7b-a8e9d2b092e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:40.042781 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d9d22-89ce-4df1-be7b-a8e9d2b092e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:40.043059 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d9d22-89ce-4df1-be7b-a8e9d2b092e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:40.114767 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d9d22-89ce-4df1-be7b-a8e9d2b092e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:40.116366 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d9d22-89ce-4df1-be7b-a8e9d2b092e0 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:40.126466 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1298/2620] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:40.243084 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcd9af-fbdf-48a1-b487-7b1b9b084a90 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:40.244587 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d7bcd9af-fbdf-48a1-b487-7b1b9b084a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:40.260477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcd9af-fbdf-48a1-b487-7b1b9b084a90 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:40.280168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c0a51-114b-44bf-91c7-94cb6a017801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:40.281227 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c0a51-114b-44bf-91c7-94cb6a017801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:40.281584 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c0a51-114b-44bf-91c7-94cb6a017801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:40.281893 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c0a51-114b-44bf-91c7-94cb6a017801 admin admin] PATH_INFO: `/v3/projects/04e7ce83cce14fb6b80d60e0e95d50c9` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:40.283062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c0a51-114b-44bf-91c7-94cb6a017801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04e7ce83cce14fb6b80d60e0e95d50c9)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:40.284939 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c0a51-114b-44bf-91c7-94cb6a017801 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:40.307351 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:40.346462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c75c0a51-114b-44bf-91c7-94cb6a017801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04e7ce83cce14fb6b80d60e0e95d50c9', 'request_id': 'req-c75c0a51-114b-44bf-91c7-94cb6a017801'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:40.353163 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c75c0a51-114b-44bf-91c7-94cb6a017801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04e7ce83cce14fb6b80d60e0e95d50c9', 'request_id': 'req-c75c0a51-114b-44bf-91c7-94cb6a017801'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:40.361876 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c75c0a51-114b-44bf-91c7-94cb6a017801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04e7ce83cce14fb6b80d60e0e95d50c9', 'request_id': 'req-c75c0a51-114b-44bf-91c7-94cb6a017801'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:40.379409 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c75c0a51-114b-44bf-91c7-94cb6a017801 admin admin] The token cache is being invalidate because project 04e7ce83cce14fb6b80d60e0e95d50c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:40.379698 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c75c0a51-114b-44bf-91c7-94cb6a017801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:40.380327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c75c0a51-114b-44bf-91c7-94cb6a017801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:40.381874 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1323/2621] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:40 2022] DELETE /identity/v3/projects/04e7ce83cce14fb6b80d60e0e95d50c9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:40.386880 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e1573-fe24-492a-879b-6a6249263ed0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:40.387182 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e1573-fe24-492a-879b-6a6249263ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:40.387499 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e1573-fe24-492a-879b-6a6249263ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:40.412876 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8a6e1573-fe24-492a-879b-6a6249263ed0 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:40.414133 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8a6e1573-fe24-492a-879b-6a6249263ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:40.463304 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:40.490284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1299/2622] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:40.500023 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e1573-fe24-492a-879b-6a6249263ed0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:40.501049 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec401a65-c2a5-4f26-9f84-d9297f5e422b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:40.501342 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec401a65-c2a5-4f26-9f84-d9297f5e422b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:40.501528 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8a6e1573-fe24-492a-879b-6a6249263ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:40.501658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec401a65-c2a5-4f26-9f84-d9297f5e422b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:40.515246 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e1573-fe24-492a-879b-6a6249263ed0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:40.520112 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1f6ff-84b4-4003-a158-2357bd12972c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:40.521097 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1f6ff-84b4-4003-a158-2357bd12972c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:40.521385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1f6ff-84b4-4003-a158-2357bd12972c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:40.521666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1f6ff-84b4-4003-a158-2357bd12972c admin admin] PATH_INFO: `/v3/projects/d5537de662114b5ba9ae57050f0cfaeb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:40.522909 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1f6ff-84b4-4003-a158-2357bd12972c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5537de662114b5ba9ae57050f0cfaeb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:40.524835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1f6ff-84b4-4003-a158-2357bd12972c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:40.540165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ec401a65-c2a5-4f26-9f84-d9297f5e422b None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:40.541537 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ec401a65-c2a5-4f26-9f84-d9297f5e422b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:40.550307 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1324/2623] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:40.554671 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec401a65-c2a5-4f26-9f84-d9297f5e422b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:40.565432 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec401a65-c2a5-4f26-9f84-d9297f5e422b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:40.579823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-23e1f6ff-84b4-4003-a158-2357bd12972c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5537de662114b5ba9ae57050f0cfaeb', 'request_id': 'req-23e1f6ff-84b4-4003-a158-2357bd12972c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:40.588281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-23e1f6ff-84b4-4003-a158-2357bd12972c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5537de662114b5ba9ae57050f0cfaeb', 'request_id': 'req-23e1f6ff-84b4-4003-a158-2357bd12972c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:40.596618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-23e1f6ff-84b4-4003-a158-2357bd12972c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5537de662114b5ba9ae57050f0cfaeb', 'request_id': 'req-23e1f6ff-84b4-4003-a158-2357bd12972c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:40.607658 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-23e1f6ff-84b4-4003-a158-2357bd12972c admin admin] The token cache is being invalidate because project d5537de662114b5ba9ae57050f0cfaeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:40.607942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-23e1f6ff-84b4-4003-a158-2357bd12972c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:40.608755 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-23e1f6ff-84b4-4003-a158-2357bd12972c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:40.610938 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1300/2624] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:40 2022] DELETE /identity/v3/projects/d5537de662114b5ba9ae57050f0cfaeb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:40.614941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1f6ff-84b4-4003-a158-2357bd12972c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:40.616630 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-23e1f6ff-84b4-4003-a158-2357bd12972c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:40.628582 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c87a49-fe24-4c5c-a8ac-5484864d2401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:40.629256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c87a49-fe24-4c5c-a8ac-5484864d2401 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:40.629661 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c87a49-fe24-4c5c-a8ac-5484864d2401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:40.629952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c87a49-fe24-4c5c-a8ac-5484864d2401 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:40.630728 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c87a49-fe24-4c5c-a8ac-5484864d2401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:49:40.631051 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c87a49-fe24-4c5c-a8ac-5484864d2401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:40.632683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c87a49-fe24-4c5c-a8ac-5484864d2401 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:40.650815 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1325/2625] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:49:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:49:40.652002 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c87a49-fe24-4c5c-a8ac-5484864d2401 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:40.653702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f9c87a49-fe24-4c5c-a8ac-5484864d2401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:40.666984 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c87a49-fe24-4c5c-a8ac-5484864d2401 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:40.672891 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9412d-13f6-43ee-aba7-ca9d9f6b61a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:40.673561 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9412d-13f6-43ee-aba7-ca9d9f6b61a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:40.673909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9412d-13f6-43ee-aba7-ca9d9f6b61a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:40.674190 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9412d-13f6-43ee-aba7-ca9d9f6b61a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:40.674929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9412d-13f6-43ee-aba7-ca9d9f6b61a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:40.677932 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9412d-13f6-43ee-aba7-ca9d9f6b61a8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:40.689430 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1f6ff-84b4-4003-a158-2357bd12972c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:40.695101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80139703-75aa-4a49-959e-fe96efb7a0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:40.696139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80139703-75aa-4a49-959e-fe96efb7a0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:40.696422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80139703-75aa-4a49-959e-fe96efb7a0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:40.696697 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80139703-75aa-4a49-959e-fe96efb7a0ee admin admin] PATH_INFO: `/v3/users/d44dcda18e3c448aaefc2979aa9e31ae` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:40.697970 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80139703-75aa-4a49-959e-fe96efb7a0ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d44dcda18e3c448aaefc2979aa9e31ae)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:40.702389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80139703-75aa-4a49-959e-fe96efb7a0ee admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:40.711199 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1326/2626] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:40 2022] POST /identity/v3/projects => generated 378 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:40.715468 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9412d-13f6-43ee-aba7-ca9d9f6b61a8 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:40.757567 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80139703-75aa-4a49-959e-fe96efb7a0ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd44dcda18e3c448aaefc2979aa9e31ae'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:40.759142 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80139703-75aa-4a49-959e-fe96efb7a0ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd44dcda18e3c448aaefc2979aa9e31ae'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:40.766977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80139703-75aa-4a49-959e-fe96efb7a0ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd44dcda18e3c448aaefc2979aa9e31ae'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:40.767691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80139703-75aa-4a49-959e-fe96efb7a0ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd44dcda18e3c448aaefc2979aa9e31ae'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:40.782122 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80139703-75aa-4a49-959e-fe96efb7a0ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd44dcda18e3c448aaefc2979aa9e31ae'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:40.796043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:40.800473 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9412d-13f6-43ee-aba7-ca9d9f6b61a8 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:40.806173 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f08de-693b-40d5-9881-b3792633beeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:40.806982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f08de-693b-40d5-9881-b3792633beeb admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:40.807271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f08de-693b-40d5-9881-b3792633beeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:40.807556 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f08de-693b-40d5-9881-b3792633beeb admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:40.808416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f08de-693b-40d5-9881-b3792633beeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:40.810931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f08de-693b-40d5-9881-b3792633beeb admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:40.814463 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1301/2627] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:40 2022] DELETE /identity/v3/users/d44dcda18e3c448aaefc2979aa9e31ae => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:40.829208 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:40.838902 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1327/2628] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:40 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:40.839115 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80139703-75aa-4a49-959e-fe96efb7a0ee admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:40.841094 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-80139703-75aa-4a49-959e-fe96efb7a0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:40.913817 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80139703-75aa-4a49-959e-fe96efb7a0ee admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:40.918741 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb853342-b856-48ce-abeb-151e9b4d7a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:40.919560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb853342-b856-48ce-abeb-151e9b4d7a2a admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:40.919905 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb853342-b856-48ce-abeb-151e9b4d7a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:40.920225 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb853342-b856-48ce-abeb-151e9b4d7a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:40.921025 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb853342-b856-48ce-abeb-151e9b4d7a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:40.922797 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb853342-b856-48ce-abeb-151e9b4d7a2a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:40.937345 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1302/2629] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:40 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:40.938826 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f08de-693b-40d5-9881-b3792633beeb admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:40.949564 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f08de-693b-40d5-9881-b3792633beeb admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:40.955071 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8154014-e895-4355-a838-df05733465e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:40.955744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8154014-e895-4355-a838-df05733465e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:40.956034 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8154014-e895-4355-a838-df05733465e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:40.956315 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8154014-e895-4355-a838-df05733465e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:40.957041 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8154014-e895-4355-a838-df05733465e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:40.958726 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8154014-e895-4355-a838-df05733465e5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:40.976307 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1328/2630] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:40 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:40.980765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb853342-b856-48ce-abeb-151e9b4d7a2a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:40.991172 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb853342-b856-48ce-abeb-151e9b4d7a2a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:40.995870 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af899a1-51de-41c8-abd3-c4a034f5e105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:40.996854 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af899a1-51de-41c8-abd3-c4a034f5e105 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:40.997226 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af899a1-51de-41c8-abd3-c4a034f5e105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:40.998034 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af899a1-51de-41c8-abd3-c4a034f5e105 admin admin] PATH_INFO: `/v3/projects/20df9b491a274663bacb596e1c8959f5/users/9ada4a4e96c2461c9d96a550689c9f24/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.014298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af899a1-51de-41c8-abd3-c4a034f5e105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20df9b491a274663bacb596e1c8959f5, user_id=9ada4a4e96c2461c9d96a550689c9f24, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:41.017014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af899a1-51de-41c8-abd3-c4a034f5e105 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:41.030167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1303/2631] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:40 2022] PUT /identity/v3/projects/20df9b491a274663bacb596e1c8959f5/users/9ada4a4e96c2461c9d96a550689c9f24/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:41.042214 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c6a59-3115-4c89-8fd5-b251a0b31261 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.042504 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c6a59-3115-4c89-8fd5-b251a0b31261 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.042824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c6a59-3115-4c89-8fd5-b251a0b31261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.070942 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9a1c6a59-3115-4c89-8fd5-b251a0b31261 None None] MFA Rules not processed for user `9ada4a4e96c2461c9d96a550689c9f24`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:41.072249 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9a1c6a59-3115-4c89-8fd5-b251a0b31261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:41.116759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af899a1-51de-41c8-abd3-c4a034f5e105 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:41.118851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5af899a1-51de-41c8-abd3-c4a034f5e105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:41.159950 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1329/2632] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:41.164631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c6a59-3115-4c89-8fd5-b251a0b31261 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:41.201971 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af899a1-51de-41c8-abd3-c4a034f5e105 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:41.206995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c3849-9eae-42fc-81ac-f0aad17398a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:41.207894 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c3849-9eae-42fc-81ac-f0aad17398a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.208208 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c3849-9eae-42fc-81ac-f0aad17398a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.208485 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c3849-9eae-42fc-81ac-f0aad17398a2 admin admin] PATH_INFO: `/v3/projects/64580757e3bd4d738f1cc4eb52171b8e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.209720 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c3849-9eae-42fc-81ac-f0aad17398a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64580757e3bd4d738f1cc4eb52171b8e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:41.211769 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c3849-9eae-42fc-81ac-f0aad17398a2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:41.234036 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c6a59-3115-4c89-8fd5-b251a0b31261 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:41.238923 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530edf75-6e1b-4d34-95fa-1aa029968715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:41.239607 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530edf75-6e1b-4d34-95fa-1aa029968715 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.239889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530edf75-6e1b-4d34-95fa-1aa029968715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.240142 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530edf75-6e1b-4d34-95fa-1aa029968715 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.240954 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530edf75-6e1b-4d34-95fa-1aa029968715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:41.243048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530edf75-6e1b-4d34-95fa-1aa029968715 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:41.260596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-805c3849-9eae-42fc-81ac-f0aad17398a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64580757e3bd4d738f1cc4eb52171b8e', 'request_id': 'req-805c3849-9eae-42fc-81ac-f0aad17398a2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:41.268184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-805c3849-9eae-42fc-81ac-f0aad17398a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64580757e3bd4d738f1cc4eb52171b8e', 'request_id': 'req-805c3849-9eae-42fc-81ac-f0aad17398a2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:41.276094 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1330/2633] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:41 2022] POST /identity/v3/projects => generated 376 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:41.276271 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-805c3849-9eae-42fc-81ac-f0aad17398a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64580757e3bd4d738f1cc4eb52171b8e', 'request_id': 'req-805c3849-9eae-42fc-81ac-f0aad17398a2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:41.277107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:41.278636 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530edf75-6e1b-4d34-95fa-1aa029968715 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:41.290152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-805c3849-9eae-42fc-81ac-f0aad17398a2 admin admin] The token cache is being invalidate because project 64580757e3bd4d738f1cc4eb52171b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:41.290444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-805c3849-9eae-42fc-81ac-f0aad17398a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:41.291143 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-805c3849-9eae-42fc-81ac-f0aad17398a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:41.292837 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1304/2634] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:41 2022] DELETE /identity/v3/projects/64580757e3bd4d738f1cc4eb52171b8e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:41.299316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0873fea-a91b-4e00-80f7-05f76206e2c4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.299611 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0873fea-a91b-4e00-80f7-05f76206e2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.299899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0873fea-a91b-4e00-80f7-05f76206e2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.320953 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c0873fea-a91b-4e00-80f7-05f76206e2c4 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:41.322066 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c0873fea-a91b-4e00-80f7-05f76206e2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:41.348989 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530edf75-6e1b-4d34-95fa-1aa029968715 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:41.355543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115134ab-54bd-4188-acd5-78c4108bfb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:41.356659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115134ab-54bd-4188-acd5-78c4108bfb8c admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.357664 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115134ab-54bd-4188-acd5-78c4108bfb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.358235 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115134ab-54bd-4188-acd5-78c4108bfb8c admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.359252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115134ab-54bd-4188-acd5-78c4108bfb8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:41.361512 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115134ab-54bd-4188-acd5-78c4108bfb8c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:41.370683 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:41.385477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1331/2635] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:41 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:41.389496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1305/2636] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:41.390164 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115134ab-54bd-4188-acd5-78c4108bfb8c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:41.391885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-115134ab-54bd-4188-acd5-78c4108bfb8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:41.398881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c09b31-a728-4350-bf02-306c7e5f9366 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.399313 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c09b31-a728-4350-bf02-306c7e5f9366 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.399626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c09b31-a728-4350-bf02-306c7e5f9366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.405438 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115134ab-54bd-4188-acd5-78c4108bfb8c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:41.411446 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042671f-a2c8-4850-a081-225fa82823cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:41.412445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042671f-a2c8-4850-a081-225fa82823cc admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.413088 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042671f-a2c8-4850-a081-225fa82823cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.413565 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042671f-a2c8-4850-a081-225fa82823cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.414308 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042671f-a2c8-4850-a081-225fa82823cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:41.415967 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042671f-a2c8-4850-a081-225fa82823cc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:41.418856 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-65c09b31-a728-4350-bf02-306c7e5f9366 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:41.420679 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-65c09b31-a728-4350-bf02-306c7e5f9366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:41.427063 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1332/2637] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:41 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:41.428809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1306/2638] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:41.432292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042671f-a2c8-4850-a081-225fa82823cc admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:41.433407 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c09b31-a728-4350-bf02-306c7e5f9366 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:41.441639 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042671f-a2c8-4850-a081-225fa82823cc admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:41.445982 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c09b31-a728-4350-bf02-306c7e5f9366 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:41.447093 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5712c-3ea4-4b9d-b6a3-71f0a281ef5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:41.447093 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5712c-3ea4-4b9d-b6a3-71f0a281ef5c admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.447314 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5712c-3ea4-4b9d-b6a3-71f0a281ef5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.447602 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5712c-3ea4-4b9d-b6a3-71f0a281ef5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.448350 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5712c-3ea4-4b9d-b6a3-71f0a281ef5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:41.449947 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5712c-3ea4-4b9d-b6a3-71f0a281ef5c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:41.450718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a5f94-3f58-4dfe-b51c-40eec77db0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:41.451560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a5f94-3f58-4dfe-b51c-40eec77db0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.451846 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a5f94-3f58-4dfe-b51c-40eec77db0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.452123 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a5f94-3f58-4dfe-b51c-40eec77db0f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.452841 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a5f94-3f58-4dfe-b51c-40eec77db0f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:49:41.453152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a5f94-3f58-4dfe-b51c-40eec77db0f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:41.454769 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a5f94-3f58-4dfe-b51c-40eec77db0f0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:41.461298 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1333/2639] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:41 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:41.465562 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5712c-3ea4-4b9d-b6a3-71f0a281ef5c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:41.467741 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1307/2640] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:49:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:49:41.472098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a5f94-3f58-4dfe-b51c-40eec77db0f0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:41.476191 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5712c-3ea4-4b9d-b6a3-71f0a281ef5c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:41.480917 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2024d-cca1-45ac-b6f7-5ed0b7011739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:41.481759 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a5f94-3f58-4dfe-b51c-40eec77db0f0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:41.481929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2024d-cca1-45ac-b6f7-5ed0b7011739 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.482886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2024d-cca1-45ac-b6f7-5ed0b7011739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.483298 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2024d-cca1-45ac-b6f7-5ed0b7011739 admin admin] PATH_INFO: `/v3/projects/bff495ce36ae4580951effb86ea648c7/users/c6a54c9dbfda4632a31ee7049dfdea05/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.487336 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3a20c-5d97-482e-83dd-da8210b68c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:41.487986 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3a20c-5d97-482e-83dd-da8210b68c58 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.488299 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3a20c-5d97-482e-83dd-da8210b68c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.488573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3a20c-5d97-482e-83dd-da8210b68c58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.489254 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3a20c-5d97-482e-83dd-da8210b68c58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:41.491383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3a20c-5d97-482e-83dd-da8210b68c58 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:41.498557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2024d-cca1-45ac-b6f7-5ed0b7011739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bff495ce36ae4580951effb86ea648c7, user_id=c6a54c9dbfda4632a31ee7049dfdea05, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:41.501614 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2024d-cca1-45ac-b6f7-5ed0b7011739 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:41.516077 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1334/2641] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:41 2022] PUT /identity/v3/projects/bff495ce36ae4580951effb86ea648c7/users/c6a54c9dbfda4632a31ee7049dfdea05/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:41.519297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1308/2642] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:41 2022] POST /identity/v3/projects => generated 360 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:41.523599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2024d-cca1-45ac-b6f7-5ed0b7011739 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:41.527007 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d6093-f069-4563-b03e-a79b123391ed None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.527007 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d6093-f069-4563-b03e-a79b123391ed None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.527223 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d6093-f069-4563-b03e-a79b123391ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.559025 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-060d6093-f069-4563-b03e-a79b123391ed None None] MFA Rules not processed for user `c6a54c9dbfda4632a31ee7049dfdea05`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:41.559025 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-060d6093-f069-4563-b03e-a79b123391ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:41.602490 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2024d-cca1-45ac-b6f7-5ed0b7011739 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:41.638875 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1309/2643] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:41.643276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d6093-f069-4563-b03e-a79b123391ed None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:41.668306 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3fcfd-0b9f-48ca-b127-1008402e8e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:41.668983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3fcfd-0b9f-48ca-b127-1008402e8e05 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.669282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3fcfd-0b9f-48ca-b127-1008402e8e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.670215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3fcfd-0b9f-48ca-b127-1008402e8e05 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.671047 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3fcfd-0b9f-48ca-b127-1008402e8e05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:41.673017 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3fcfd-0b9f-48ca-b127-1008402e8e05 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:41.686742 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:41.697389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1335/2644] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:41 2022] POST /identity/v3/users => generated 281 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:41.703488 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3fcfd-0b9f-48ca-b127-1008402e8e05 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:41.710619 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d6093-f069-4563-b03e-a79b123391ed None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:41.714280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3fcfd-0b9f-48ca-b127-1008402e8e05 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:41.715362 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ba82e-63fb-4f73-b835-057ff20c09c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:41.716110 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba82e-63fb-4f73-b835-057ff20c09c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.716861 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba82e-63fb-4f73-b835-057ff20c09c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.717139 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba82e-63fb-4f73-b835-057ff20c09c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.717826 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ba82e-63fb-4f73-b835-057ff20c09c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:41.719763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ba82e-63fb-4f73-b835-057ff20c09c7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:41.720270 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bd9d2-b92f-43f5-b53b-b5a69849e374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:41.720987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bd9d2-b92f-43f5-b53b-b5a69849e374 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.721275 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bd9d2-b92f-43f5-b53b-b5a69849e374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.721562 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bd9d2-b92f-43f5-b53b-b5a69849e374 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.722285 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bd9d2-b92f-43f5-b53b-b5a69849e374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:41.723948 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bd9d2-b92f-43f5-b53b-b5a69849e374 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:41.735952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1336/2645] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:41 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:41.740381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bd9d2-b92f-43f5-b53b-b5a69849e374 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:41.748809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1310/2646] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:41 2022] POST /identity/v3/projects => generated 378 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:41.749730 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ba82e-63fb-4f73-b835-057ff20c09c7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:41.750478 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bd9d2-b92f-43f5-b53b-b5a69849e374 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:41.782289 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:41.811110 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231f38b-0ab8-410d-980c-787d717786f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:41.811788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231f38b-0ab8-410d-980c-787d717786f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.812085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231f38b-0ab8-410d-980c-787d717786f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.812397 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231f38b-0ab8-410d-980c-787d717786f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.813128 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231f38b-0ab8-410d-980c-787d717786f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:41.814158 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ba82e-63fb-4f73-b835-057ff20c09c7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:41.814764 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231f38b-0ab8-410d-980c-787d717786f5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:41.819221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cddf62-0bb6-473c-8101-466e9dc878d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:41.819894 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cddf62-0bb6-473c-8101-466e9dc878d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.820178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cddf62-0bb6-473c-8101-466e9dc878d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.820456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cddf62-0bb6-473c-8101-466e9dc878d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.821141 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cddf62-0bb6-473c-8101-466e9dc878d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:41.823209 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cddf62-0bb6-473c-8101-466e9dc878d1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:41.829449 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1337/2647] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:41 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:41.830696 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231f38b-0ab8-410d-980c-787d717786f5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:41.841308 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231f38b-0ab8-410d-980c-787d717786f5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:41.844712 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1311/2648] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:41 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:41.848666 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cddf62-0bb6-473c-8101-466e9dc878d1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:41.848975 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa36f25-b41a-44eb-8be6-8f81dde1f791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:41.849859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa36f25-b41a-44eb-8be6-8f81dde1f791 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.850145 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa36f25-b41a-44eb-8be6-8f81dde1f791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.850423 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa36f25-b41a-44eb-8be6-8f81dde1f791 admin admin] PATH_INFO: `/v3/projects/b4de50ebd2b149ebb18c401b956f9a60/users/79d442fc3f2047b29086c57c1940c2e9/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.859734 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cddf62-0bb6-473c-8101-466e9dc878d1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:41.864610 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b3937-a255-46a2-bbc9-106867056045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:41.865272 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b3937-a255-46a2-bbc9-106867056045 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.865563 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b3937-a255-46a2-bbc9-106867056045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.865851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b3937-a255-46a2-bbc9-106867056045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.866035 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa36f25-b41a-44eb-8be6-8f81dde1f791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4de50ebd2b149ebb18c401b956f9a60, user_id=79d442fc3f2047b29086c57c1940c2e9, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:41.866592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b3937-a255-46a2-bbc9-106867056045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:41.868193 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b3937-a255-46a2-bbc9-106867056045 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:41.868808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa36f25-b41a-44eb-8be6-8f81dde1f791 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:41.879885 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1312/2649] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:41 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:41.883790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b3937-a255-46a2-bbc9-106867056045 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:41.887655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1338/2650] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:41 2022] PUT /identity/v3/projects/b4de50ebd2b149ebb18c401b956f9a60/users/79d442fc3f2047b29086c57c1940c2e9/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:41.895642 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b3937-a255-46a2-bbc9-106867056045 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:41.899176 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d462f7b-73b6-4856-a935-eacc0ef896a7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.899469 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d462f7b-73b6-4856-a935-eacc0ef896a7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.899752 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d462f7b-73b6-4856-a935-eacc0ef896a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.927215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9d462f7b-73b6-4856-a935-eacc0ef896a7 None None] MFA Rules not processed for user `79d442fc3f2047b29086c57c1940c2e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:41.928424 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9d462f7b-73b6-4856-a935-eacc0ef896a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:41.957849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6739b-6987-4043-8d0a-5c4fd765412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:41.959081 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6739b-6987-4043-8d0a-5c4fd765412e admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.959369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6739b-6987-4043-8d0a-5c4fd765412e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.959649 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6739b-6987-4043-8d0a-5c4fd765412e admin admin] PATH_INFO: `/v3/projects/79d4d2fc0d1444aa8ff10285648bd489/users/662273fd7db145e3b97a035d80e1ccf7/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.975308 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6739b-6987-4043-8d0a-5c4fd765412e admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d4d2fc0d1444aa8ff10285648bd489, user_id=662273fd7db145e3b97a035d80e1ccf7, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:41.977931 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6739b-6987-4043-8d0a-5c4fd765412e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:41.991613 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1313/2651] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:41 2022] PUT /identity/v3/projects/79d4d2fc0d1444aa8ff10285648bd489/users/662273fd7db145e3b97a035d80e1ccf7/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:41.995478 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6739b-6987-4043-8d0a-5c4fd765412e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:41.998560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1339/2652] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:42.026787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:42.032483 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d462f7b-73b6-4856-a935-eacc0ef896a7 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:42.034064 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9d462f7b-73b6-4856-a935-eacc0ef896a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:42.064568 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6739b-6987-4043-8d0a-5c4fd765412e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:42.069291 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce2a9f-c434-4940-87d3-9b310d7ea13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:42.069991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2a9f-c434-4940-87d3-9b310d7ea13b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:42.070276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2a9f-c434-4940-87d3-9b310d7ea13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:42.070556 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2a9f-c434-4940-87d3-9b310d7ea13b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:42.071310 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce2a9f-c434-4940-87d3-9b310d7ea13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:42.072903 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce2a9f-c434-4940-87d3-9b310d7ea13b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:42.084085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1314/2653] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:41 2022] GET /identity/v3/roles => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:42.088005 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce2a9f-c434-4940-87d3-9b310d7ea13b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:42.093277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d462f7b-73b6-4856-a935-eacc0ef896a7 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:42.098779 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce2a9f-c434-4940-87d3-9b310d7ea13b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:42.103881 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33ba03-decd-4ce2-afdf-47ff54dda011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:42.104842 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33ba03-decd-4ce2-afdf-47ff54dda011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:42.105206 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33ba03-decd-4ce2-afdf-47ff54dda011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:42.105502 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33ba03-decd-4ce2-afdf-47ff54dda011 admin admin] PATH_INFO: `/v3/projects/79d4d2fc0d1444aa8ff10285648bd489/users/662273fd7db145e3b97a035d80e1ccf7/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:42.107686 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33ba03-decd-4ce2-afdf-47ff54dda011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d4d2fc0d1444aa8ff10285648bd489, user_id=662273fd7db145e3b97a035d80e1ccf7, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:42.110390 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33ba03-decd-4ce2-afdf-47ff54dda011 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:42.120830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1315/2654] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:42 2022] PUT /identity/v3/projects/79d4d2fc0d1444aa8ff10285648bd489/users/662273fd7db145e3b97a035d80e1ccf7/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:42.137965 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035317e0-2071-42d2-b3ff-c0944482f87d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:42.138893 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035317e0-2071-42d2-b3ff-c0944482f87d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:42.139195 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035317e0-2071-42d2-b3ff-c0944482f87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:42.145343 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd7720-2d55-4c97-85b2-560c026e93ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:42.145993 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd7720-2d55-4c97-85b2-560c026e93ad service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:42.146282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd7720-2d55-4c97-85b2-560c026e93ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:42.146595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd7720-2d55-4c97-85b2-560c026e93ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:42.150740 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:42.166077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-035317e0-2071-42d2-b3ff-c0944482f87d None None] MFA Rules not processed for user `662273fd7db145e3b97a035d80e1ccf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:42.167335 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-035317e0-2071-42d2-b3ff-c0944482f87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:42.205809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd7720-2d55-4c97-85b2-560c026e93ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:42.207293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd7720-2d55-4c97-85b2-560c026e93ad service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:42.216372 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1340/2655] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:42.230652 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd7720-2d55-4c97-85b2-560c026e93ad service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:42.239593 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1316/2656] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:42.241621 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd7720-2d55-4c97-85b2-560c026e93ad service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:42.251395 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035317e0-2071-42d2-b3ff-c0944482f87d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:42.252824 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-035317e0-2071-42d2-b3ff-c0944482f87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:42.300387 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80cf0f-4312-49b9-ad42-35806cb48a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:42.301268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80cf0f-4312-49b9-ad42-35806cb48a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:42.301558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80cf0f-4312-49b9-ad42-35806cb48a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:42.301834 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80cf0f-4312-49b9-ad42-35806cb48a63 admin admin] PATH_INFO: `/v3/users/79d442fc3f2047b29086c57c1940c2e9` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:42.303062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80cf0f-4312-49b9-ad42-35806cb48a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d442fc3f2047b29086c57c1940c2e9)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:42.305079 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80cf0f-4312-49b9-ad42-35806cb48a63 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:42.311643 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035317e0-2071-42d2-b3ff-c0944482f87d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:42.315606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe553480-b23c-468e-89f8-46d0d2a94eba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:42.316264 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe553480-b23c-468e-89f8-46d0d2a94eba service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:42.316553 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe553480-b23c-468e-89f8-46d0d2a94eba service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:42.316835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe553480-b23c-468e-89f8-46d0d2a94eba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:42.318672 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fe553480-b23c-468e-89f8-46d0d2a94eba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:42.353765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-cf80cf0f-4312-49b9-ad42-35806cb48a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d442fc3f2047b29086c57c1940c2e9'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:42.365854 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-cf80cf0f-4312-49b9-ad42-35806cb48a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d442fc3f2047b29086c57c1940c2e9'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:42.366408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:42.366545 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-cf80cf0f-4312-49b9-ad42-35806cb48a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d442fc3f2047b29086c57c1940c2e9'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:42.377632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-cf80cf0f-4312-49b9-ad42-35806cb48a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d442fc3f2047b29086c57c1940c2e9'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:42.378270 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-cf80cf0f-4312-49b9-ad42-35806cb48a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d442fc3f2047b29086c57c1940c2e9'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:42.382541 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe553480-b23c-468e-89f8-46d0d2a94eba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:42.384080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe553480-b23c-468e-89f8-46d0d2a94eba service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:42.393150 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1341/2657] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:42 2022] DELETE /identity/v3/users/79d442fc3f2047b29086c57c1940c2e9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:42.394398 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1317/2658] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:42.397542 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bdc53-47d9-4802-ac85-6b51705aa8f5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:42.397846 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bdc53-47d9-4802-ac85-6b51705aa8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:42.398133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bdc53-47d9-4802-ac85-6b51705aa8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:42.417396 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a20bdc53-47d9-4802-ac85-6b51705aa8f5 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:42.418653 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a20bdc53-47d9-4802-ac85-6b51705aa8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:42.439886 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:42.486465 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1342/2659] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:42.496052 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe553480-b23c-468e-89f8-46d0d2a94eba service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:42.498147 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fe553480-b23c-468e-89f8-46d0d2a94eba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:42.562746 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe553480-b23c-468e-89f8-46d0d2a94eba service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:42.618140 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb0fa3-2fef-413c-be62-e3de02dc2774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:42.618892 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb0fa3-2fef-413c-be62-e3de02dc2774 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:42.619271 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb0fa3-2fef-413c-be62-e3de02dc2774 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:42.619653 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb0fa3-2fef-413c-be62-e3de02dc2774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:42.633720 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb0fa3-2fef-413c-be62-e3de02dc2774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:42.635158 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb0fa3-2fef-413c-be62-e3de02dc2774 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:42.646037 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1318/2660] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:42.944278 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bdc53-47d9-4802-ac85-6b51705aa8f5 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:42.946578 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a20bdc53-47d9-4802-ac85-6b51705aa8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:42.962930 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bdc53-47d9-4802-ac85-6b51705aa8f5 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:42.967737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9121147-86fe-4186-9e19-24a4875d8336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:42.968933 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9121147-86fe-4186-9e19-24a4875d8336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:42.969415 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9121147-86fe-4186-9e19-24a4875d8336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:42.969795 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9121147-86fe-4186-9e19-24a4875d8336 admin admin] PATH_INFO: `/v3/projects/b4de50ebd2b149ebb18c401b956f9a60` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:42.971496 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9121147-86fe-4186-9e19-24a4875d8336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4de50ebd2b149ebb18c401b956f9a60)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:42.974189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9121147-86fe-4186-9e19-24a4875d8336 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:43.031737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c9121147-86fe-4186-9e19-24a4875d8336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4de50ebd2b149ebb18c401b956f9a60', 'request_id': 'req-c9121147-86fe-4186-9e19-24a4875d8336'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:43.040466 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c9121147-86fe-4186-9e19-24a4875d8336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4de50ebd2b149ebb18c401b956f9a60', 'request_id': 'req-c9121147-86fe-4186-9e19-24a4875d8336'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:43.046720 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c9121147-86fe-4186-9e19-24a4875d8336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4de50ebd2b149ebb18c401b956f9a60', 'request_id': 'req-c9121147-86fe-4186-9e19-24a4875d8336'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:43.061168 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c9121147-86fe-4186-9e19-24a4875d8336 admin admin] The token cache is being invalidate because project b4de50ebd2b149ebb18c401b956f9a60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:43.061435 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c9121147-86fe-4186-9e19-24a4875d8336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:43.061971 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c9121147-86fe-4186-9e19-24a4875d8336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:43.063638 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1343/2661] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:42 2022] DELETE /identity/v3/projects/b4de50ebd2b149ebb18c401b956f9a60 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:43.069374 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ebc06-6328-4ba8-bbf5-228a93db4438 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:43.069664 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ebc06-6328-4ba8-bbf5-228a93db4438 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:43.069948 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ebc06-6328-4ba8-bbf5-228a93db4438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:43.089020 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c63ebc06-6328-4ba8-bbf5-228a93db4438 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:43.090265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c63ebc06-6328-4ba8-bbf5-228a93db4438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:43.175127 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1319/2662] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:43.183320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28759b9-1836-4bf1-8e47-410d3369c327 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:43.183621 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28759b9-1836-4bf1-8e47-410d3369c327 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:43.183894 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28759b9-1836-4bf1-8e47-410d3369c327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:43.202852 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a28759b9-1836-4bf1-8e47-410d3369c327 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:43.204084 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a28759b9-1836-4bf1-8e47-410d3369c327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:43.212190 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1344/2663] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:43.216634 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ebc06-6328-4ba8-bbf5-228a93db4438 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:43.226556 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ebc06-6328-4ba8-bbf5-228a93db4438 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:43.231186 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1dbb67-95a2-464d-b039-89ee864a805f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:43.232381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1dbb67-95a2-464d-b039-89ee864a805f admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:43.232667 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1dbb67-95a2-464d-b039-89ee864a805f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:43.232946 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1dbb67-95a2-464d-b039-89ee864a805f admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:43.233672 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1dbb67-95a2-464d-b039-89ee864a805f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:49:43.233985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1dbb67-95a2-464d-b039-89ee864a805f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:43.235647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1dbb67-95a2-464d-b039-89ee864a805f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:43.248369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1320/2664] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:49:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:49:43.252749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28759b9-1836-4bf1-8e47-410d3369c327 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:43.262020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28759b9-1836-4bf1-8e47-410d3369c327 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:43.267031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ffe22-9baf-45bd-86cd-56f25bdd155d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:43.267680 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ffe22-9baf-45bd-86cd-56f25bdd155d admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:43.267964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ffe22-9baf-45bd-86cd-56f25bdd155d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:43.268242 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ffe22-9baf-45bd-86cd-56f25bdd155d admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:43.268927 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ffe22-9baf-45bd-86cd-56f25bdd155d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:43.270831 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ffe22-9baf-45bd-86cd-56f25bdd155d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:43.297358 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1345/2665] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:43 2022] POST /identity/v3/projects => generated 384 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:43.301547 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1dbb67-95a2-464d-b039-89ee864a805f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:43.311936 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1dbb67-95a2-464d-b039-89ee864a805f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:43.344893 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:43.372492 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20488db-1d30-41a7-8211-a905b9932231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:43.373186 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20488db-1d30-41a7-8211-a905b9932231 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:43.373471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20488db-1d30-41a7-8211-a905b9932231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:43.373753 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20488db-1d30-41a7-8211-a905b9932231 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:43.374443 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20488db-1d30-41a7-8211-a905b9932231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:43.376502 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20488db-1d30-41a7-8211-a905b9932231 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:43.397615 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1321/2666] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:43 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:43.405184 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ffe22-9baf-45bd-86cd-56f25bdd155d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:43.416206 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ffe22-9baf-45bd-86cd-56f25bdd155d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:43.421806 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea62cc-d436-49ff-965c-a0228531d9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:43.422861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea62cc-d436-49ff-965c-a0228531d9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:43.422861 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea62cc-d436-49ff-965c-a0228531d9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:43.423081 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea62cc-d436-49ff-965c-a0228531d9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:43.423795 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea62cc-d436-49ff-965c-a0228531d9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:43.425441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea62cc-d436-49ff-965c-a0228531d9d1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:43.436135 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1346/2667] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:43 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:43.440356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20488db-1d30-41a7-8211-a905b9932231 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:43.450785 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20488db-1d30-41a7-8211-a905b9932231 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:43.455388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e905e5f-0992-4d2c-ae1a-1388604388d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:43.456049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e905e5f-0992-4d2c-ae1a-1388604388d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:43.456361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e905e5f-0992-4d2c-ae1a-1388604388d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:43.456640 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e905e5f-0992-4d2c-ae1a-1388604388d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:43.457364 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e905e5f-0992-4d2c-ae1a-1388604388d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:43.458981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e905e5f-0992-4d2c-ae1a-1388604388d3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:43.470612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1322/2668] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:43 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:43.474617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea62cc-d436-49ff-965c-a0228531d9d1 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:43.485559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea62cc-d436-49ff-965c-a0228531d9d1 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:43.490367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17eab5-063e-44d5-8d70-a1376cbbe696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:43.491333 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17eab5-063e-44d5-8d70-a1376cbbe696 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:43.491624 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17eab5-063e-44d5-8d70-a1376cbbe696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:43.491902 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17eab5-063e-44d5-8d70-a1376cbbe696 admin admin] PATH_INFO: `/v3/projects/807306998ab04eed81227e6d6198b71e/users/366b03f6276d4fbe96f054d471d28187/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:43.508125 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17eab5-063e-44d5-8d70-a1376cbbe696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=807306998ab04eed81227e6d6198b71e, user_id=366b03f6276d4fbe96f054d471d28187, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:43.510827 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17eab5-063e-44d5-8d70-a1376cbbe696 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:43.524111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1347/2669] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:43 2022] PUT /identity/v3/projects/807306998ab04eed81227e6d6198b71e/users/366b03f6276d4fbe96f054d471d28187/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:43.529725 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55727f8-be3c-476b-ab1e-447a163c1ac8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:43.530022 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55727f8-be3c-476b-ab1e-447a163c1ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:43.530301 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55727f8-be3c-476b-ab1e-447a163c1ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:43.548600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a55727f8-be3c-476b-ab1e-447a163c1ac8 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:43.549844 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a55727f8-be3c-476b-ab1e-447a163c1ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:43.611276 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1323/2670] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:43.621176 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17eab5-063e-44d5-8d70-a1376cbbe696 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:43.622900 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5a17eab5-063e-44d5-8d70-a1376cbbe696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:43.669749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:43.682951 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17eab5-063e-44d5-8d70-a1376cbbe696 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:43.686769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5b2da-c481-40be-a6c4-22d9a70f068e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:43.687428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5b2da-c481-40be-a6c4-22d9a70f068e service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:43.687719 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5b2da-c481-40be-a6c4-22d9a70f068e service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:43.688003 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5b2da-c481-40be-a6c4-22d9a70f068e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:43.697430 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5b2da-c481-40be-a6c4-22d9a70f068e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:43.698929 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5b2da-c481-40be-a6c4-22d9a70f068e service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:43.710419 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1348/2671] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:43.924974 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55727f8-be3c-476b-ab1e-447a163c1ac8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:43.926405 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a55727f8-be3c-476b-ab1e-447a163c1ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:44.001956 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55727f8-be3c-476b-ab1e-447a163c1ac8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:44.006013 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205de36-2d1a-46fe-b8b1-144d62c1a514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:44.006699 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205de36-2d1a-46fe-b8b1-144d62c1a514 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:44.006984 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205de36-2d1a-46fe-b8b1-144d62c1a514 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:44.007267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205de36-2d1a-46fe-b8b1-144d62c1a514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:44.009407 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9205de36-2d1a-46fe-b8b1-144d62c1a514 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:44.076197 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205de36-2d1a-46fe-b8b1-144d62c1a514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:44.077766 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205de36-2d1a-46fe-b8b1-144d62c1a514 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:44.089474 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1324/2672] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:44.464369 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a57a7b-f0f4-461e-bb60-daddd2d5a102 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:44.464909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a57a7b-f0f4-461e-bb60-daddd2d5a102 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:44.464909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a57a7b-f0f4-461e-bb60-daddd2d5a102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:44.498081 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-24a57a7b-f0f4-461e-bb60-daddd2d5a102 None None] MFA Rules not processed for user `366b03f6276d4fbe96f054d471d28187`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:44.499380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-24a57a7b-f0f4-461e-bb60-daddd2d5a102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:44.584964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1349/2673] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:44.597409 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205de36-2d1a-46fe-b8b1-144d62c1a514 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:44.599701 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9205de36-2d1a-46fe-b8b1-144d62c1a514 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:44.617008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205de36-2d1a-46fe-b8b1-144d62c1a514 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:44.621421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa4123-b062-4b8c-bc5c-80afc23d4662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:44.622753 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa4123-b062-4b8c-bc5c-80afc23d4662 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:44.623230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa4123-b062-4b8c-bc5c-80afc23d4662 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:44.623496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa4123-b062-4b8c-bc5c-80afc23d4662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:44.629631 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:44.636316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa4123-b062-4b8c-bc5c-80afc23d4662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:44.639747 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa4123-b062-4b8c-bc5c-80afc23d4662 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:44.655186 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1325/2674] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:44.766924 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a57a7b-f0f4-461e-bb60-daddd2d5a102 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:44.777815 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a57a7b-f0f4-461e-bb60-daddd2d5a102 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:44.783703 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60f03c-a229-4de0-9e52-647f5264fa10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:44.784545 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60f03c-a229-4de0-9e52-647f5264fa10 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:44.784938 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60f03c-a229-4de0-9e52-647f5264fa10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:44.785327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60f03c-a229-4de0-9e52-647f5264fa10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:44.788944 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ed60f03c-a229-4de0-9e52-647f5264fa10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:44.864432 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60f03c-a229-4de0-9e52-647f5264fa10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:44.865882 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60f03c-a229-4de0-9e52-647f5264fa10 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:44.876157 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1350/2675] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:46.085226 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87575cd-34ff-4eb2-a6f4-df2aa7de7e23 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:46.085827 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87575cd-34ff-4eb2-a6f4-df2aa7de7e23 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:46.085827 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87575cd-34ff-4eb2-a6f4-df2aa7de7e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:46.104675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c87575cd-34ff-4eb2-a6f4-df2aa7de7e23 None None] MFA Rules not processed for user `366b03f6276d4fbe96f054d471d28187`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:46.105939 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c87575cd-34ff-4eb2-a6f4-df2aa7de7e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:46.114082 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1326/2676] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:46.555858 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60f03c-a229-4de0-9e52-647f5264fa10 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:46.557618 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ed60f03c-a229-4de0-9e52-647f5264fa10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:46.569643 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60f03c-a229-4de0-9e52-647f5264fa10 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:46.574459 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec58397-4a51-4051-894d-c56059f1c89d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:46.575315 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec58397-4a51-4051-894d-c56059f1c89d service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:46.575603 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec58397-4a51-4051-894d-c56059f1c89d service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:46.575931 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec58397-4a51-4051-894d-c56059f1c89d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:46.577795 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cec58397-4a51-4051-894d-c56059f1c89d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:46.588370 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec58397-4a51-4051-894d-c56059f1c89d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:46.589985 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec58397-4a51-4051-894d-c56059f1c89d service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:46.600740 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1351/2677] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:48.972386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87575cd-34ff-4eb2-a6f4-df2aa7de7e23 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:48.974190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c87575cd-34ff-4eb2-a6f4-df2aa7de7e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:48.995460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87575cd-34ff-4eb2-a6f4-df2aa7de7e23 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:49.000700 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda46c17-fe89-4dbc-8817-0a7116d8efac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:49.001763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda46c17-fe89-4dbc-8817-0a7116d8efac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:49.002066 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda46c17-fe89-4dbc-8817-0a7116d8efac admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:49.002320 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda46c17-fe89-4dbc-8817-0a7116d8efac admin admin] PATH_INFO: `/v3/users/9ada4a4e96c2461c9d96a550689c9f24` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:49.004158 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda46c17-fe89-4dbc-8817-0a7116d8efac admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ada4a4e96c2461c9d96a550689c9f24)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:49.005672 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda46c17-fe89-4dbc-8817-0a7116d8efac admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:49.088614 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bda46c17-fe89-4dbc-8817-0a7116d8efac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ada4a4e96c2461c9d96a550689c9f24'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:49.089731 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bda46c17-fe89-4dbc-8817-0a7116d8efac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ada4a4e96c2461c9d96a550689c9f24'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:49.101977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bda46c17-fe89-4dbc-8817-0a7116d8efac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ada4a4e96c2461c9d96a550689c9f24'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:49.103149 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bda46c17-fe89-4dbc-8817-0a7116d8efac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ada4a4e96c2461c9d96a550689c9f24'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:49.114544 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bda46c17-fe89-4dbc-8817-0a7116d8efac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ada4a4e96c2461c9d96a550689c9f24'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:49.142206 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1327/2678] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:48 2022] DELETE /identity/v3/users/9ada4a4e96c2461c9d96a550689c9f24 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:49.147088 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54119b-c18d-4320-aded-23a3cc051066 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:49.147627 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54119b-c18d-4320-aded-23a3cc051066 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:49.147753 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54119b-c18d-4320-aded-23a3cc051066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:49.168111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6e54119b-c18d-4320-aded-23a3cc051066 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:49.169594 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6e54119b-c18d-4320-aded-23a3cc051066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:49.229170 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:49.240611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1352/2679] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:49.250603 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda46c17-fe89-4dbc-8817-0a7116d8efac admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:49.252211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bda46c17-fe89-4dbc-8817-0a7116d8efac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:49.351423 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda46c17-fe89-4dbc-8817-0a7116d8efac admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:49.360104 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d2930-e529-4da4-b317-aa5b798d9aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:49.361074 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d2930-e529-4da4-b317-aa5b798d9aae service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:49.361443 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d2930-e529-4da4-b317-aa5b798d9aae service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:49.364582 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d2930-e529-4da4-b317-aa5b798d9aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:49.379474 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d2930-e529-4da4-b317-aa5b798d9aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:49.381248 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d2930-e529-4da4-b317-aa5b798d9aae service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:49.395671 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1328/2680] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:49.999367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54119b-c18d-4320-aded-23a3cc051066 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:50.001067 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6e54119b-c18d-4320-aded-23a3cc051066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:50.016321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54119b-c18d-4320-aded-23a3cc051066 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:50.021824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c458a-bad3-4519-a338-744b9c4aa60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:50.033337 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c458a-bad3-4519-a338-744b9c4aa60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:50.033673 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c458a-bad3-4519-a338-744b9c4aa60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:50.033925 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c458a-bad3-4519-a338-744b9c4aa60f admin admin] PATH_INFO: `/v3/projects/20df9b491a274663bacb596e1c8959f5` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:50.037697 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c458a-bad3-4519-a338-744b9c4aa60f admin admin] RBAC: Authorizing `identity:delete_project(project_id=20df9b491a274663bacb596e1c8959f5)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:50.039871 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c458a-bad3-4519-a338-744b9c4aa60f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:50.125126 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0f2c458a-bad3-4519-a338-744b9c4aa60f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20df9b491a274663bacb596e1c8959f5', 'request_id': 'req-0f2c458a-bad3-4519-a338-744b9c4aa60f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:50.137487 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0f2c458a-bad3-4519-a338-744b9c4aa60f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20df9b491a274663bacb596e1c8959f5', 'request_id': 'req-0f2c458a-bad3-4519-a338-744b9c4aa60f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:50.148252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0f2c458a-bad3-4519-a338-744b9c4aa60f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20df9b491a274663bacb596e1c8959f5', 'request_id': 'req-0f2c458a-bad3-4519-a338-744b9c4aa60f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:50.166366 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0f2c458a-bad3-4519-a338-744b9c4aa60f admin admin] The token cache is being invalidate because project 20df9b491a274663bacb596e1c8959f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:50.166747 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0f2c458a-bad3-4519-a338-744b9c4aa60f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:50.167546 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0f2c458a-bad3-4519-a338-744b9c4aa60f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:50.169943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1353/2681] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:49 2022] DELETE /identity/v3/projects/20df9b491a274663bacb596e1c8959f5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:50.174728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d2930-e529-4da4-b317-aa5b798d9aae service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:50.187871 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d2930-e529-4da4-b317-aa5b798d9aae service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:50.283991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d690184-df3b-4c07-8c00-218a14e33895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:50.284910 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d690184-df3b-4c07-8c00-218a14e33895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:50.285195 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d690184-df3b-4c07-8c00-218a14e33895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:50.285477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d690184-df3b-4c07-8c00-218a14e33895 admin admin] PATH_INFO: `/v3/users/c6a54c9dbfda4632a31ee7049dfdea05` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:50.287236 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d690184-df3b-4c07-8c00-218a14e33895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a54c9dbfda4632a31ee7049dfdea05)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:50.306320 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d690184-df3b-4c07-8c00-218a14e33895 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:50.310833 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:50.389020 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7d690184-df3b-4c07-8c00-218a14e33895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a54c9dbfda4632a31ee7049dfdea05'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:50.390429 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7d690184-df3b-4c07-8c00-218a14e33895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a54c9dbfda4632a31ee7049dfdea05'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:50.399749 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7d690184-df3b-4c07-8c00-218a14e33895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a54c9dbfda4632a31ee7049dfdea05'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:50.400910 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7d690184-df3b-4c07-8c00-218a14e33895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a54c9dbfda4632a31ee7049dfdea05'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:50.412679 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7d690184-df3b-4c07-8c00-218a14e33895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a54c9dbfda4632a31ee7049dfdea05'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:50.438489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1329/2682] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:50 2022] DELETE /identity/v3/users/c6a54c9dbfda4632a31ee7049dfdea05 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:50.830826 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c458a-bad3-4519-a338-744b9c4aa60f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:50.832338 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0f2c458a-bad3-4519-a338-744b9c4aa60f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:50.846142 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c458a-bad3-4519-a338-744b9c4aa60f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:50.953035 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddc3bb-3ef0-4933-a4fc-dab691f01fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:50.954242 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddc3bb-3ef0-4933-a4fc-dab691f01fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:50.954530 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddc3bb-3ef0-4933-a4fc-dab691f01fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:50.954856 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddc3bb-3ef0-4933-a4fc-dab691f01fcc admin admin] PATH_INFO: `/v3/projects/bff495ce36ae4580951effb86ea648c7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:50.956269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddc3bb-3ef0-4933-a4fc-dab691f01fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bff495ce36ae4580951effb86ea648c7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:50.958704 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddc3bb-3ef0-4933-a4fc-dab691f01fcc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:51.033763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d690184-df3b-4c07-8c00-218a14e33895 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:51.035647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7d690184-df3b-4c07-8c00-218a14e33895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:51.056076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-00ddc3bb-3ef0-4933-a4fc-dab691f01fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bff495ce36ae4580951effb86ea648c7', 'request_id': 'req-00ddc3bb-3ef0-4933-a4fc-dab691f01fcc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:51.063780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-00ddc3bb-3ef0-4933-a4fc-dab691f01fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bff495ce36ae4580951effb86ea648c7', 'request_id': 'req-00ddc3bb-3ef0-4933-a4fc-dab691f01fcc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:51.071502 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-00ddc3bb-3ef0-4933-a4fc-dab691f01fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bff495ce36ae4580951effb86ea648c7', 'request_id': 'req-00ddc3bb-3ef0-4933-a4fc-dab691f01fcc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:51.093788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-00ddc3bb-3ef0-4933-a4fc-dab691f01fcc admin admin] The token cache is being invalidate because project bff495ce36ae4580951effb86ea648c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:51.094087 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-00ddc3bb-3ef0-4933-a4fc-dab691f01fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:51.094773 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-00ddc3bb-3ef0-4933-a4fc-dab691f01fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:51.096927 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1354/2683] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:50 2022] DELETE /identity/v3/projects/bff495ce36ae4580951effb86ea648c7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:51.109352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddc3bb-3ef0-4933-a4fc-dab691f01fcc admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:51.110933 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-00ddc3bb-3ef0-4933-a4fc-dab691f01fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:51.112135 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d690184-df3b-4c07-8c00-218a14e33895 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:51.127559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:51.181134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5285de-a986-4f34-85b0-faae49a83146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:51.181134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5285de-a986-4f34-85b0-faae49a83146 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:51.181872 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5285de-a986-4f34-85b0-faae49a83146 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:51.181872 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5285de-a986-4f34-85b0-faae49a83146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:51.184799 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2e5285de-a986-4f34-85b0-faae49a83146 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:51.197670 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5285de-a986-4f34-85b0-faae49a83146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:51.199157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5285de-a986-4f34-85b0-faae49a83146 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:51.202712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddc3bb-3ef0-4933-a4fc-dab691f01fcc admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:51.211080 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87d8e5-3914-4351-91fa-78e8e4f9e9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:51.212283 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1330/2684] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:51.215330 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87d8e5-3914-4351-91fa-78e8e4f9e9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:51.215656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87d8e5-3914-4351-91fa-78e8e4f9e9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:51.215950 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87d8e5-3914-4351-91fa-78e8e4f9e9dc admin admin] PATH_INFO: `/v3/users/662273fd7db145e3b97a035d80e1ccf7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:51.217291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87d8e5-3914-4351-91fa-78e8e4f9e9dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=662273fd7db145e3b97a035d80e1ccf7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:51.219472 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87d8e5-3914-4351-91fa-78e8e4f9e9dc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:51.282098 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fe87d8e5-3914-4351-91fa-78e8e4f9e9dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '662273fd7db145e3b97a035d80e1ccf7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:51.305982 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fe87d8e5-3914-4351-91fa-78e8e4f9e9dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '662273fd7db145e3b97a035d80e1ccf7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:51.306956 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fe87d8e5-3914-4351-91fa-78e8e4f9e9dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '662273fd7db145e3b97a035d80e1ccf7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:51.319182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fe87d8e5-3914-4351-91fa-78e8e4f9e9dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '662273fd7db145e3b97a035d80e1ccf7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:51.319945 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fe87d8e5-3914-4351-91fa-78e8e4f9e9dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '662273fd7db145e3b97a035d80e1ccf7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:51.342755 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1355/2685] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:51 2022] DELETE /identity/v3/users/662273fd7db145e3b97a035d80e1ccf7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:52.186107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5285de-a986-4f34-85b0-faae49a83146 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:52.196403 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5285de-a986-4f34-85b0-faae49a83146 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:52.260685 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:52.273646 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44783576-d3ec-4aff-87f0-6552d11576bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:52.274691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44783576-d3ec-4aff-87f0-6552d11576bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:52.275079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44783576-d3ec-4aff-87f0-6552d11576bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:52.275964 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44783576-d3ec-4aff-87f0-6552d11576bf admin admin] PATH_INFO: `/v3/projects/79d4d2fc0d1444aa8ff10285648bd489` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:52.278719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44783576-d3ec-4aff-87f0-6552d11576bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=79d4d2fc0d1444aa8ff10285648bd489)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:52.282111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44783576-d3ec-4aff-87f0-6552d11576bf admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:52.353049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-44783576-d3ec-4aff-87f0-6552d11576bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d4d2fc0d1444aa8ff10285648bd489', 'request_id': 'req-44783576-d3ec-4aff-87f0-6552d11576bf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:52.365159 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-44783576-d3ec-4aff-87f0-6552d11576bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d4d2fc0d1444aa8ff10285648bd489', 'request_id': 'req-44783576-d3ec-4aff-87f0-6552d11576bf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:52.374217 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-44783576-d3ec-4aff-87f0-6552d11576bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d4d2fc0d1444aa8ff10285648bd489', 'request_id': 'req-44783576-d3ec-4aff-87f0-6552d11576bf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:52.386814 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-44783576-d3ec-4aff-87f0-6552d11576bf admin admin] The token cache is being invalidate because project 79d4d2fc0d1444aa8ff10285648bd489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:52.388043 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-44783576-d3ec-4aff-87f0-6552d11576bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:52.388683 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-44783576-d3ec-4aff-87f0-6552d11576bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:52.390279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1331/2686] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:49:52 2022] DELETE /identity/v3/projects/79d4d2fc0d1444aa8ff10285648bd489 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:52.395405 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a27728-c932-4ffa-a4d0-78df4c9e4578 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:52.395935 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a27728-c932-4ffa-a4d0-78df4c9e4578 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:52.396045 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a27728-c932-4ffa-a4d0-78df4c9e4578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:52.417834 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-41a27728-c932-4ffa-a4d0-78df4c9e4578 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:52.419682 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-41a27728-c932-4ffa-a4d0-78df4c9e4578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:52.495068 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1356/2687] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:52.507779 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a61cf-04ab-45bd-873e-afd1cadac0d4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:52.508075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a61cf-04ab-45bd-873e-afd1cadac0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:52.508395 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a61cf-04ab-45bd-873e-afd1cadac0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:52.530560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6a0a61cf-04ab-45bd-873e-afd1cadac0d4 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:52.531851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6a0a61cf-04ab-45bd-873e-afd1cadac0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:52.552784 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1332/2688] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:52.559690 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a27728-c932-4ffa-a4d0-78df4c9e4578 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:52.571997 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a27728-c932-4ffa-a4d0-78df4c9e4578 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:52.578753 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cc8f5-f04a-4d82-8bc2-e24c68d8df48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:52.579717 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cc8f5-f04a-4d82-8bc2-e24c68d8df48 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:52.580200 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cc8f5-f04a-4d82-8bc2-e24c68d8df48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:52.580655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cc8f5-f04a-4d82-8bc2-e24c68d8df48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:52.581587 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cc8f5-f04a-4d82-8bc2-e24c68d8df48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:49:52.582133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cc8f5-f04a-4d82-8bc2-e24c68d8df48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:52.584062 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cc8f5-f04a-4d82-8bc2-e24c68d8df48 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:52.599029 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1357/2689] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:49:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:49:52.603088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a61cf-04ab-45bd-873e-afd1cadac0d4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:52.613308 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a61cf-04ab-45bd-873e-afd1cadac0d4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:52.618438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a355b59-2fd8-44ab-ba6a-78cd207ab171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:52.619169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a355b59-2fd8-44ab-ba6a-78cd207ab171 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:52.619452 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a355b59-2fd8-44ab-ba6a-78cd207ab171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:52.619723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a355b59-2fd8-44ab-ba6a-78cd207ab171 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:52.620812 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a355b59-2fd8-44ab-ba6a-78cd207ab171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:52.624941 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a355b59-2fd8-44ab-ba6a-78cd207ab171 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:52.664966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1333/2690] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:49:52 2022] POST /identity/v3/projects => generated 370 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:52.667520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cc8f5-f04a-4d82-8bc2-e24c68d8df48 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:52.681246 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cc8f5-f04a-4d82-8bc2-e24c68d8df48 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:52.703540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:52.769596 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dde47a-fac1-4204-a247-e322463ff45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:52.770284 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dde47a-fac1-4204-a247-e322463ff45d admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:52.770587 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dde47a-fac1-4204-a247-e322463ff45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:52.770888 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dde47a-fac1-4204-a247-e322463ff45d admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:52.771620 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dde47a-fac1-4204-a247-e322463ff45d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:52.773586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dde47a-fac1-4204-a247-e322463ff45d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:52.799750 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1358/2691] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:49:52 2022] POST /identity/v3/users => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:52.804101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a355b59-2fd8-44ab-ba6a-78cd207ab171 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:52.815079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a355b59-2fd8-44ab-ba6a-78cd207ab171 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:52.820126 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21ce0b-d1f7-4338-b7ec-e9b9cc331bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:52.820896 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21ce0b-d1f7-4338-b7ec-e9b9cc331bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:52.821258 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21ce0b-d1f7-4338-b7ec-e9b9cc331bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:52.821809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21ce0b-d1f7-4338-b7ec-e9b9cc331bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:52.822663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21ce0b-d1f7-4338-b7ec-e9b9cc331bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:52.825026 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21ce0b-d1f7-4338-b7ec-e9b9cc331bfa admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:52.838626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1334/2692] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:52 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:52.843547 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dde47a-fac1-4204-a247-e322463ff45d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:52.855345 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dde47a-fac1-4204-a247-e322463ff45d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:52.861080 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f2e2d-948e-40e9-b191-9105f767771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:52.861989 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f2e2d-948e-40e9-b191-9105f767771e admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:52.862471 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f2e2d-948e-40e9-b191-9105f767771e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:52.862838 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f2e2d-948e-40e9-b191-9105f767771e admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:52.863653 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f2e2d-948e-40e9-b191-9105f767771e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:52.865347 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f2e2d-948e-40e9-b191-9105f767771e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:52.878218 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1359/2693] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:49:52 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:52.885086 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21ce0b-d1f7-4338-b7ec-e9b9cc331bfa admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:52.901660 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21ce0b-d1f7-4338-b7ec-e9b9cc331bfa admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:52.907126 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485143f-9767-4eab-b700-81192520da70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:52.908034 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485143f-9767-4eab-b700-81192520da70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:52.908317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485143f-9767-4eab-b700-81192520da70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:52.908596 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485143f-9767-4eab-b700-81192520da70 admin admin] PATH_INFO: `/v3/projects/29ca2deb64244b39b95bc6621e50ff9d/users/520e7af4d11b4f02a63b897687dc6bb1/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:52.928466 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485143f-9767-4eab-b700-81192520da70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ca2deb64244b39b95bc6621e50ff9d, user_id=520e7af4d11b4f02a63b897687dc6bb1, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:52.931194 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485143f-9767-4eab-b700-81192520da70 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:52.956379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1335/2694] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:49:52 2022] PUT /identity/v3/projects/29ca2deb64244b39b95bc6621e50ff9d/users/520e7af4d11b4f02a63b897687dc6bb1/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:52.969251 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71b5a-a199-4513-88a1-37b14c0ee4b4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:52.969544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71b5a-a199-4513-88a1-37b14c0ee4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:52.969814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71b5a-a199-4513-88a1-37b14c0ee4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:52.999707 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-84f71b5a-a199-4513-88a1-37b14c0ee4b4 None None] MFA Rules not processed for user `520e7af4d11b4f02a63b897687dc6bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:53.000950 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-84f71b5a-a199-4513-88a1-37b14c0ee4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:53.080176 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1360/2695] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:49:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:53.092894 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485143f-9767-4eab-b700-81192520da70 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:53.097396 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b485143f-9767-4eab-b700-81192520da70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:53.187560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485143f-9767-4eab-b700-81192520da70 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:53.193196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a08b99-7718-4635-8e35-967abbba4c10 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '363d16eebb3f40a1be71506961cc3c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:53.193196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a08b99-7718-4635-8e35-967abbba4c10 service glance] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:53.193196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a08b99-7718-4635-8e35-967abbba4c10 service glance] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:53.193196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a08b99-7718-4635-8e35-967abbba4c10 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:53.203450 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a08b99-7718-4635-8e35-967abbba4c10 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:53.205168 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a08b99-7718-4635-8e35-967abbba4c10 service glance] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:53.222767 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1336/2696] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:55.067635 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f71b5a-a199-4513-88a1-37b14c0ee4b4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:55.069190 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-84f71b5a-a199-4513-88a1-37b14c0ee4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:55.197512 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f71b5a-a199-4513-88a1-37b14c0ee4b4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:55.206376 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8bd22-bd3b-4668-809b-ecddee790e49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ffef7640dd1487ab2ea91fc0f4be9e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:55.207647 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8bd22-bd3b-4668-809b-ecddee790e49 service placement] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:55.208262 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8bd22-bd3b-4668-809b-ecddee790e49 service placement] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:55.208769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8bd22-bd3b-4668-809b-ecddee790e49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:55.211754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fdc8bd22-bd3b-4668-809b-ecddee790e49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:55.230246 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8bd22-bd3b-4668-809b-ecddee790e49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:55.231957 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8bd22-bd3b-4668-809b-ecddee790e49 service placement] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:55.243069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1361/2697] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:49:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:59.525996 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a08b99-7718-4635-8e35-967abbba4c10 service glance] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:59.529065 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d1a08b99-7718-4635-8e35-967abbba4c10 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:59.547660 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:59.618643 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a08b99-7718-4635-8e35-967abbba4c10 service glance] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:59.623362 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c682efc-7b92-4fcf-814b-cafcdf205b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:59.624256 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c682efc-7b92-4fcf-814b-cafcdf205b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:59.624541 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c682efc-7b92-4fcf-814b-cafcdf205b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:59.624823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c682efc-7b92-4fcf-814b-cafcdf205b1d admin admin] PATH_INFO: `/v3/users/bdd6bcaef051419b93f1623d3eccac84` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:59.626403 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c682efc-7b92-4fcf-814b-cafcdf205b1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd6bcaef051419b93f1623d3eccac84)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:59.628570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c682efc-7b92-4fcf-814b-cafcdf205b1d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:59.687916 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0c682efc-7b92-4fcf-814b-cafcdf205b1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd6bcaef051419b93f1623d3eccac84'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:59.688581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0c682efc-7b92-4fcf-814b-cafcdf205b1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd6bcaef051419b93f1623d3eccac84'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:59.696656 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0c682efc-7b92-4fcf-814b-cafcdf205b1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd6bcaef051419b93f1623d3eccac84'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:59.697780 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0c682efc-7b92-4fcf-814b-cafcdf205b1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd6bcaef051419b93f1623d3eccac84'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:59.709447 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0c682efc-7b92-4fcf-814b-cafcdf205b1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd6bcaef051419b93f1623d3eccac84'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:59.735913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1337/2698] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:49:59 2022] DELETE /identity/v3/users/bdd6bcaef051419b93f1623d3eccac84 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:50:00.020126 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8bd22-bd3b-4668-809b-ecddee790e49 service placement] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:00.038605 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8bd22-bd3b-4668-809b-ecddee790e49 service placement] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:00.055491 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:00.136909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c2ece-7169-474d-8a29-65833ea5821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:00.137794 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c2ece-7169-474d-8a29-65833ea5821c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:00.138086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c2ece-7169-474d-8a29-65833ea5821c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:00.138361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c2ece-7169-474d-8a29-65833ea5821c admin admin] PATH_INFO: `/v3/projects/a882a7528f4646e59e816954167de6d2` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:00.139752 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c2ece-7169-474d-8a29-65833ea5821c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a882a7528f4646e59e816954167de6d2)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:00.141721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c2ece-7169-474d-8a29-65833ea5821c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:00.207712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d49c2ece-7169-474d-8a29-65833ea5821c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a882a7528f4646e59e816954167de6d2', 'request_id': 'req-d49c2ece-7169-474d-8a29-65833ea5821c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:00.215066 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d49c2ece-7169-474d-8a29-65833ea5821c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a882a7528f4646e59e816954167de6d2', 'request_id': 'req-d49c2ece-7169-474d-8a29-65833ea5821c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:00.223586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d49c2ece-7169-474d-8a29-65833ea5821c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a882a7528f4646e59e816954167de6d2', 'request_id': 'req-d49c2ece-7169-474d-8a29-65833ea5821c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:00.243743 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d49c2ece-7169-474d-8a29-65833ea5821c admin admin] The token cache is being invalidate because project a882a7528f4646e59e816954167de6d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:50:00.244201 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d49c2ece-7169-474d-8a29-65833ea5821c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:00.245065 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d49c2ece-7169-474d-8a29-65833ea5821c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:00.250367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1362/2699] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:50:00 2022] DELETE /identity/v3/projects/a882a7528f4646e59e816954167de6d2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:50:00.254418 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c682efc-7b92-4fcf-814b-cafcdf205b1d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:00.255959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0c682efc-7b92-4fcf-814b-cafcdf205b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:00.277505 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c682efc-7b92-4fcf-814b-cafcdf205b1d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:00.374603 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04900490-7c84-448b-af48-cd5ae808de3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:00.375985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04900490-7c84-448b-af48-cd5ae808de3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:00.376275 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04900490-7c84-448b-af48-cd5ae808de3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:00.376555 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04900490-7c84-448b-af48-cd5ae808de3f admin admin] PATH_INFO: `/v3/users/41ccca62014f4c978dd4ab5ca4e1d33a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:00.378402 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04900490-7c84-448b-af48-cd5ae808de3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ccca62014f4c978dd4ab5ca4e1d33a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:00.381073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04900490-7c84-448b-af48-cd5ae808de3f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:00.424729 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:00.447624 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-04900490-7c84-448b-af48-cd5ae808de3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ccca62014f4c978dd4ab5ca4e1d33a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:00.448631 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-04900490-7c84-448b-af48-cd5ae808de3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ccca62014f4c978dd4ab5ca4e1d33a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:00.459354 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-04900490-7c84-448b-af48-cd5ae808de3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ccca62014f4c978dd4ab5ca4e1d33a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:00.460205 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-04900490-7c84-448b-af48-cd5ae808de3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ccca62014f4c978dd4ab5ca4e1d33a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:00.470098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-04900490-7c84-448b-af48-cd5ae808de3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ccca62014f4c978dd4ab5ca4e1d33a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:00.500600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1338/2700] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:50:00 2022] DELETE /identity/v3/users/41ccca62014f4c978dd4ab5ca4e1d33a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:50:00.734187 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c2ece-7169-474d-8a29-65833ea5821c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:00.735743 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d49c2ece-7169-474d-8a29-65833ea5821c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:00.754288 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c2ece-7169-474d-8a29-65833ea5821c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:00.822987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fb6c9-5840-418c-a438-2e74f20ca164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:00.824059 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fb6c9-5840-418c-a438-2e74f20ca164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:00.824937 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fb6c9-5840-418c-a438-2e74f20ca164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:00.825272 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fb6c9-5840-418c-a438-2e74f20ca164 admin admin] PATH_INFO: `/v3/projects/8e0809c853864790820ebf5ddbb2fb6b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:00.827671 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fb6c9-5840-418c-a438-2e74f20ca164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e0809c853864790820ebf5ddbb2fb6b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:00.831318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fb6c9-5840-418c-a438-2e74f20ca164 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:00.894465 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:00.896089 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ec8fb6c9-5840-418c-a438-2e74f20ca164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e0809c853864790820ebf5ddbb2fb6b', 'request_id': 'req-ec8fb6c9-5840-418c-a438-2e74f20ca164'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:00.903697 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ec8fb6c9-5840-418c-a438-2e74f20ca164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e0809c853864790820ebf5ddbb2fb6b', 'request_id': 'req-ec8fb6c9-5840-418c-a438-2e74f20ca164'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:00.912520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ec8fb6c9-5840-418c-a438-2e74f20ca164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e0809c853864790820ebf5ddbb2fb6b', 'request_id': 'req-ec8fb6c9-5840-418c-a438-2e74f20ca164'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:00.927513 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ec8fb6c9-5840-418c-a438-2e74f20ca164 admin admin] The token cache is being invalidate because project 8e0809c853864790820ebf5ddbb2fb6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:50:00.927889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ec8fb6c9-5840-418c-a438-2e74f20ca164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:00.928967 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ec8fb6c9-5840-418c-a438-2e74f20ca164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:00.931668 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1363/2701] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:50:00 2022] DELETE /identity/v3/projects/8e0809c853864790820ebf5ddbb2fb6b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:50:10.493117 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=18,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:10.923753 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=7,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:16.092151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04900490-7c84-448b-af48-cd5ae808de3f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:16.095591 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-04900490-7c84-448b-af48-cd5ae808de3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:16.173554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04900490-7c84-448b-af48-cd5ae808de3f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:16.265600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6d3e1-9217-476b-ada7-1ef7fdcf581d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:16.266382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6d3e1-9217-476b-ada7-1ef7fdcf581d service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:16.266867 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6d3e1-9217-476b-ada7-1ef7fdcf581d service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:16.267314 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6d3e1-9217-476b-ada7-1ef7fdcf581d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:16.269657 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-24f6d3e1-9217-476b-ada7-1ef7fdcf581d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:16.360160 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6d3e1-9217-476b-ada7-1ef7fdcf581d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:16.361954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6d3e1-9217-476b-ada7-1ef7fdcf581d service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:16.374954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1339/2702] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:20.094556 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fb6c9-5840-418c-a438-2e74f20ca164 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:20.097299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ec8fb6c9-5840-418c-a438-2e74f20ca164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:20.113094 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fb6c9-5840-418c-a438-2e74f20ca164 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:20.120813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a6b35-34bd-4cb6-a4e8-9dd6090a2155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:20.122122 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6b35-34bd-4cb6-a4e8-9dd6090a2155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:20.122425 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6b35-34bd-4cb6-a4e8-9dd6090a2155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:20.122858 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6b35-34bd-4cb6-a4e8-9dd6090a2155 admin admin] PATH_INFO: `/v3/users/7535a906d3884263b6f031080c72cc6d` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:20.124752 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a6b35-34bd-4cb6-a4e8-9dd6090a2155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7535a906d3884263b6f031080c72cc6d)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:20.127478 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a6b35-34bd-4cb6-a4e8-9dd6090a2155 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:20.203964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ab7a6b35-34bd-4cb6-a4e8-9dd6090a2155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7535a906d3884263b6f031080c72cc6d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:20.221325 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ab7a6b35-34bd-4cb6-a4e8-9dd6090a2155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7535a906d3884263b6f031080c72cc6d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:20.222099 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ab7a6b35-34bd-4cb6-a4e8-9dd6090a2155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7535a906d3884263b6f031080c72cc6d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:20.230527 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ab7a6b35-34bd-4cb6-a4e8-9dd6090a2155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7535a906d3884263b6f031080c72cc6d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:20.231198 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ab7a6b35-34bd-4cb6-a4e8-9dd6090a2155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7535a906d3884263b6f031080c72cc6d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:20.245001 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1364/2703] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:50:20 2022] DELETE /identity/v3/users/7535a906d3884263b6f031080c72cc6d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:50:20.464197 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6d3e1-9217-476b-ada7-1ef7fdcf581d service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:20.476768 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6d3e1-9217-476b-ada7-1ef7fdcf581d service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:20.586987 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7458c70-185d-4762-84fc-0c11e31896ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:20.588570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7458c70-185d-4762-84fc-0c11e31896ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:20.589093 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7458c70-185d-4762-84fc-0c11e31896ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:20.589573 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7458c70-185d-4762-84fc-0c11e31896ee admin admin] PATH_INFO: `/v3/projects/a9bb773d106e46aba0ee89c9f798de59` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:20.592194 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7458c70-185d-4762-84fc-0c11e31896ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9bb773d106e46aba0ee89c9f798de59)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:20.596621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7458c70-185d-4762-84fc-0c11e31896ee admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:20.612438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:20.671430 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a7458c70-185d-4762-84fc-0c11e31896ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9bb773d106e46aba0ee89c9f798de59', 'request_id': 'req-a7458c70-185d-4762-84fc-0c11e31896ee'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:20.679477 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a7458c70-185d-4762-84fc-0c11e31896ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9bb773d106e46aba0ee89c9f798de59', 'request_id': 'req-a7458c70-185d-4762-84fc-0c11e31896ee'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:20.689287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a7458c70-185d-4762-84fc-0c11e31896ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9bb773d106e46aba0ee89c9f798de59', 'request_id': 'req-a7458c70-185d-4762-84fc-0c11e31896ee'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:20.700177 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a7458c70-185d-4762-84fc-0c11e31896ee admin admin] The token cache is being invalidate because project a9bb773d106e46aba0ee89c9f798de59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:50:20.700501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a7458c70-185d-4762-84fc-0c11e31896ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:20.701140 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a7458c70-185d-4762-84fc-0c11e31896ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:20.703297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1340/2704] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:50:20 2022] DELETE /identity/v3/projects/a9bb773d106e46aba0ee89c9f798de59 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:50:20.708342 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7db963-6bb1-4b96-a4ac-2bd35c9f6582 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:20.708643 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7db963-6bb1-4b96-a4ac-2bd35c9f6582 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:20.708923 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7db963-6bb1-4b96-a4ac-2bd35c9f6582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:20.727535 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ca7db963-6bb1-4b96-a4ac-2bd35c9f6582 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:20.728766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ca7db963-6bb1-4b96-a4ac-2bd35c9f6582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:20.795685 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1365/2705] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:50:20.803701 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb40d28-d14d-437d-93c3-8f3391ad1117 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:20.804016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb40d28-d14d-437d-93c3-8f3391ad1117 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:20.804329 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb40d28-d14d-437d-93c3-8f3391ad1117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:20.824856 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bfb40d28-d14d-437d-93c3-8f3391ad1117 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:20.826074 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bfb40d28-d14d-437d-93c3-8f3391ad1117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:20.835428 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1341/2706] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:20.840074 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7db963-6bb1-4b96-a4ac-2bd35c9f6582 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:20.849587 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7db963-6bb1-4b96-a4ac-2bd35c9f6582 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:20.854329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e059e-1ea1-4587-9eff-7b987d4ba67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:20.855015 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e059e-1ea1-4587-9eff-7b987d4ba67a admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:20.855313 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e059e-1ea1-4587-9eff-7b987d4ba67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:20.855633 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e059e-1ea1-4587-9eff-7b987d4ba67a admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:20.856358 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e059e-1ea1-4587-9eff-7b987d4ba67a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:50:20.856670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e059e-1ea1-4587-9eff-7b987d4ba67a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:20.858299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e059e-1ea1-4587-9eff-7b987d4ba67a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:20.870648 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1366/2707] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:50:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:50:20.875779 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb40d28-d14d-437d-93c3-8f3391ad1117 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:20.885680 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb40d28-d14d-437d-93c3-8f3391ad1117 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:20.892499 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d01161-d666-48a7-9fcb-79f1a21d1f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:20.893061 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d01161-d666-48a7-9fcb-79f1a21d1f76 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:20.893350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d01161-d666-48a7-9fcb-79f1a21d1f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:20.893631 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d01161-d666-48a7-9fcb-79f1a21d1f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:20.894338 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d01161-d666-48a7-9fcb-79f1a21d1f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:20.896309 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d01161-d666-48a7-9fcb-79f1a21d1f76 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:20.934865 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1342/2708] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:50:20 2022] POST /identity/v3/projects => generated 378 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:50:20.939807 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e059e-1ea1-4587-9eff-7b987d4ba67a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:20.950963 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e059e-1ea1-4587-9eff-7b987d4ba67a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:21.025365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f7db7-4ba4-44c3-9e2a-62c0502e1482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:21.026774 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f7db7-4ba4-44c3-9e2a-62c0502e1482 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:21.027251 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f7db7-4ba4-44c3-9e2a-62c0502e1482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:21.027657 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f7db7-4ba4-44c3-9e2a-62c0502e1482 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:21.028791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f7db7-4ba4-44c3-9e2a-62c0502e1482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:21.031837 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f7db7-4ba4-44c3-9e2a-62c0502e1482 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:21.041655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:21.059604 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1367/2709] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:50:20 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:50:21.064198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d01161-d666-48a7-9fcb-79f1a21d1f76 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:21.074848 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d01161-d666-48a7-9fcb-79f1a21d1f76 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:21.080653 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1b844-3bda-4f81-9a8c-e491125755c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:21.081365 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1b844-3bda-4f81-9a8c-e491125755c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:21.081652 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1b844-3bda-4f81-9a8c-e491125755c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:21.081932 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1b844-3bda-4f81-9a8c-e491125755c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:21.082703 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1b844-3bda-4f81-9a8c-e491125755c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:21.084343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1b844-3bda-4f81-9a8c-e491125755c4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:21.095772 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1343/2710] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:50:21 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:50:21.100406 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f7db7-4ba4-44c3-9e2a-62c0502e1482 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:21.111608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f7db7-4ba4-44c3-9e2a-62c0502e1482 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:21.116217 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0f7a9-5c05-48e2-a8b4-6d9a4a7b92bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:21.116891 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0f7a9-5c05-48e2-a8b4-6d9a4a7b92bb admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:21.117180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0f7a9-5c05-48e2-a8b4-6d9a4a7b92bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:21.117461 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0f7a9-5c05-48e2-a8b4-6d9a4a7b92bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:21.118194 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0f7a9-5c05-48e2-a8b4-6d9a4a7b92bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:21.119837 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0f7a9-5c05-48e2-a8b4-6d9a4a7b92bb admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:21.130872 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1368/2711] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:50:21 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:50:21.134987 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1b844-3bda-4f81-9a8c-e491125755c4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:21.146347 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1b844-3bda-4f81-9a8c-e491125755c4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:21.151663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f78fd0-356d-448b-af22-0a1635869483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:21.152584 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f78fd0-356d-448b-af22-0a1635869483 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:21.152897 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f78fd0-356d-448b-af22-0a1635869483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:21.153200 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f78fd0-356d-448b-af22-0a1635869483 admin admin] PATH_INFO: `/v3/projects/4cb9553124384391a6d901dc791071ea/users/2d4104cb17d645a5bc766a15f863fbdd/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:21.170639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f78fd0-356d-448b-af22-0a1635869483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb9553124384391a6d901dc791071ea, user_id=2d4104cb17d645a5bc766a15f863fbdd, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:21.174038 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f78fd0-356d-448b-af22-0a1635869483 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:21.189785 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1344/2712] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:50:21 2022] PUT /identity/v3/projects/4cb9553124384391a6d901dc791071ea/users/2d4104cb17d645a5bc766a15f863fbdd/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:50:21.195200 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b3877-b010-4a28-bcf7-9c6f19f69a8f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:21.195497 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b3877-b010-4a28-bcf7-9c6f19f69a8f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:21.195796 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b3877-b010-4a28-bcf7-9c6f19f69a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:21.215126 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0a4b3877-b010-4a28-bcf7-9c6f19f69a8f None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:21.215977 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0a4b3877-b010-4a28-bcf7-9c6f19f69a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:21.285943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1369/2713] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:21.297279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f78fd0-356d-448b-af22-0a1635869483 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:21.298969 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-25f78fd0-356d-448b-af22-0a1635869483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:21.391932 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f78fd0-356d-448b-af22-0a1635869483 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:21.396940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ee625-6d48-40c1-99ff-ba0e4847bcae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:21.397617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ee625-6d48-40c1-99ff-ba0e4847bcae service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:21.397902 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ee625-6d48-40c1-99ff-ba0e4847bcae service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:21.398184 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ee625-6d48-40c1-99ff-ba0e4847bcae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:21.409285 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ee625-6d48-40c1-99ff-ba0e4847bcae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:21.411002 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ee625-6d48-40c1-99ff-ba0e4847bcae service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:21.423342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1345/2714] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:50:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:50:22.381905 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b3877-b010-4a28-bcf7-9c6f19f69a8f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:22.384481 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0a4b3877-b010-4a28-bcf7-9c6f19f69a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:22.406601 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b3877-b010-4a28-bcf7-9c6f19f69a8f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:22.414818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70972f-6cc0-4138-9c2a-0065c25bea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:22.416504 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70972f-6cc0-4138-9c2a-0065c25bea11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:22.419774 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70972f-6cc0-4138-9c2a-0065c25bea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:22.422533 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70972f-6cc0-4138-9c2a-0065c25bea11 admin admin] PATH_INFO: `/v3/users/520e7af4d11b4f02a63b897687dc6bb1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:22.425900 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70972f-6cc0-4138-9c2a-0065c25bea11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=520e7af4d11b4f02a63b897687dc6bb1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:22.429442 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70972f-6cc0-4138-9c2a-0065c25bea11 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:22.510871 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-bf70972f-6cc0-4138-9c2a-0065c25bea11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '520e7af4d11b4f02a63b897687dc6bb1'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:22.529431 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-bf70972f-6cc0-4138-9c2a-0065c25bea11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '520e7af4d11b4f02a63b897687dc6bb1'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:22.530911 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-bf70972f-6cc0-4138-9c2a-0065c25bea11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '520e7af4d11b4f02a63b897687dc6bb1'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:22.541563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-bf70972f-6cc0-4138-9c2a-0065c25bea11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '520e7af4d11b4f02a63b897687dc6bb1'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:22.542665 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-bf70972f-6cc0-4138-9c2a-0065c25bea11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '520e7af4d11b4f02a63b897687dc6bb1'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:22.567186 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1370/2715] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:50:22 2022] DELETE /identity/v3/users/520e7af4d11b4f02a63b897687dc6bb1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:50:22.572335 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e483a-b83d-42d4-89f8-65741d82744e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:22.573338 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e483a-b83d-42d4-89f8-65741d82744e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:22.573834 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e483a-b83d-42d4-89f8-65741d82744e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:22.598152 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-af2e483a-b83d-42d4-89f8-65741d82744e None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:22.599700 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-af2e483a-b83d-42d4-89f8-65741d82744e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:22.644857 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:22.713405 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1346/2716] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:22.722880 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70972f-6cc0-4138-9c2a-0065c25bea11 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:22.724520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bf70972f-6cc0-4138-9c2a-0065c25bea11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:22.815780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70972f-6cc0-4138-9c2a-0065c25bea11 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:22.821565 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34192b1-6e37-48e9-b1cf-d128685d4004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:22.822597 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34192b1-6e37-48e9-b1cf-d128685d4004 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:22.822887 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34192b1-6e37-48e9-b1cf-d128685d4004 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:22.823415 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34192b1-6e37-48e9-b1cf-d128685d4004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:22.840719 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:22.849008 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34192b1-6e37-48e9-b1cf-d128685d4004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:22.852159 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34192b1-6e37-48e9-b1cf-d128685d4004 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:22.868574 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1371/2717] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:50:23.291204 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e483a-b83d-42d4-89f8-65741d82744e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:23.293032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-af2e483a-b83d-42d4-89f8-65741d82744e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:23.311370 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e483a-b83d-42d4-89f8-65741d82744e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:23.318584 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b631903-c1fb-41c3-a79b-4aa15484f550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:23.319820 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b631903-c1fb-41c3-a79b-4aa15484f550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:23.320409 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b631903-c1fb-41c3-a79b-4aa15484f550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:23.320603 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b631903-c1fb-41c3-a79b-4aa15484f550 admin admin] PATH_INFO: `/v3/projects/29ca2deb64244b39b95bc6621e50ff9d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:23.322190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b631903-c1fb-41c3-a79b-4aa15484f550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29ca2deb64244b39b95bc6621e50ff9d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:23.325368 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b631903-c1fb-41c3-a79b-4aa15484f550 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:23.390101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1b631903-c1fb-41c3-a79b-4aa15484f550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29ca2deb64244b39b95bc6621e50ff9d', 'request_id': 'req-1b631903-c1fb-41c3-a79b-4aa15484f550'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:23.406810 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1b631903-c1fb-41c3-a79b-4aa15484f550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29ca2deb64244b39b95bc6621e50ff9d', 'request_id': 'req-1b631903-c1fb-41c3-a79b-4aa15484f550'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:23.415471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1b631903-c1fb-41c3-a79b-4aa15484f550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29ca2deb64244b39b95bc6621e50ff9d', 'request_id': 'req-1b631903-c1fb-41c3-a79b-4aa15484f550'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:23.431008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1b631903-c1fb-41c3-a79b-4aa15484f550 admin admin] The token cache is being invalidate because project 29ca2deb64244b39b95bc6621e50ff9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:50:23.431008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1b631903-c1fb-41c3-a79b-4aa15484f550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:23.431568 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1b631903-c1fb-41c3-a79b-4aa15484f550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:23.434625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1347/2718] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:50:23 2022] DELETE /identity/v3/projects/29ca2deb64244b39b95bc6621e50ff9d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:50:23.439451 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c22ed-07aa-49e9-9579-4dfecb21f661 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:23.439984 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c22ed-07aa-49e9-9579-4dfecb21f661 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:23.440189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c22ed-07aa-49e9-9579-4dfecb21f661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:23.467654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-bd7c22ed-07aa-49e9-9579-4dfecb21f661 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:23.470197 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bd7c22ed-07aa-49e9-9579-4dfecb21f661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:23.547888 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1372/2719] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:23.560949 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c306f3-9b19-47fb-8304-823af86c9d09 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:23.561334 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c306f3-9b19-47fb-8304-823af86c9d09 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:23.561790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c306f3-9b19-47fb-8304-823af86c9d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:23.584476 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e1c306f3-9b19-47fb-8304-823af86c9d09 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:23.585706 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e1c306f3-9b19-47fb-8304-823af86c9d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:23.594551 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1348/2720] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:23.598879 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c22ed-07aa-49e9-9579-4dfecb21f661 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:23.612057 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c22ed-07aa-49e9-9579-4dfecb21f661 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:23.624719 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74f469-4a03-4de9-bf8e-78c0dfcd0cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:23.625417 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74f469-4a03-4de9-bf8e-78c0dfcd0cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:23.625752 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74f469-4a03-4de9-bf8e-78c0dfcd0cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:23.625990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74f469-4a03-4de9-bf8e-78c0dfcd0cd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:23.626880 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74f469-4a03-4de9-bf8e-78c0dfcd0cd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:50:23.627160 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74f469-4a03-4de9-bf8e-78c0dfcd0cd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:23.628760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74f469-4a03-4de9-bf8e-78c0dfcd0cd9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:23.644353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1373/2721] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:50:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:50:23.648937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c306f3-9b19-47fb-8304-823af86c9d09 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:23.663086 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c306f3-9b19-47fb-8304-823af86c9d09 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:23.669169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc06b5-dab0-4d5e-86d9-581d65853731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:23.670029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc06b5-dab0-4d5e-86d9-581d65853731 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:23.670302 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc06b5-dab0-4d5e-86d9-581d65853731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:23.670420 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc06b5-dab0-4d5e-86d9-581d65853731 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:23.671140 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc06b5-dab0-4d5e-86d9-581d65853731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:23.673467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc06b5-dab0-4d5e-86d9-581d65853731 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:23.705513 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1349/2722] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:50:23 2022] POST /identity/v3/projects => generated 370 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:50:23.709479 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74f469-4a03-4de9-bf8e-78c0dfcd0cd9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:23.722780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74f469-4a03-4de9-bf8e-78c0dfcd0cd9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:23.821842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab971bb-df38-42a8-9468-68cb18b8b4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:23.822280 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab971bb-df38-42a8-9468-68cb18b8b4c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:23.822603 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab971bb-df38-42a8-9468-68cb18b8b4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:23.823560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab971bb-df38-42a8-9468-68cb18b8b4c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:23.823744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab971bb-df38-42a8-9468-68cb18b8b4c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:23.825703 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab971bb-df38-42a8-9468-68cb18b8b4c9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:23.853376 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1374/2723] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:50:23 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:50:23.857342 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc06b5-dab0-4d5e-86d9-581d65853731 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:23.868584 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc06b5-dab0-4d5e-86d9-581d65853731 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:23.874216 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cd677-c428-4601-b699-945487b804bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:23.875923 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cd677-c428-4601-b699-945487b804bf admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:23.876402 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cd677-c428-4601-b699-945487b804bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:23.876864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cd677-c428-4601-b699-945487b804bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:23.877763 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65cd677-c428-4601-b699-945487b804bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:23.879589 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65cd677-c428-4601-b699-945487b804bf admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:23.895531 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1350/2724] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:50:23 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:50:23.896830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab971bb-df38-42a8-9468-68cb18b8b4c9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:23.909975 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab971bb-df38-42a8-9468-68cb18b8b4c9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:23.915419 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68d9f6-57b3-4228-bbe6-7b6e7f5e5219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:23.916114 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68d9f6-57b3-4228-bbe6-7b6e7f5e5219 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:23.916667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68d9f6-57b3-4228-bbe6-7b6e7f5e5219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:23.916943 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68d9f6-57b3-4228-bbe6-7b6e7f5e5219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:23.917674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68d9f6-57b3-4228-bbe6-7b6e7f5e5219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:23.919484 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68d9f6-57b3-4228-bbe6-7b6e7f5e5219 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:23.939200 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1375/2725] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:50:23 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:50:23.943711 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cd677-c428-4601-b699-945487b804bf admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:23.955585 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cd677-c428-4601-b699-945487b804bf admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:23.962028 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9399e-2bfe-4d89-8b40-a10e06f359b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:23.963238 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9399e-2bfe-4d89-8b40-a10e06f359b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:23.963576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9399e-2bfe-4d89-8b40-a10e06f359b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:23.963920 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9399e-2bfe-4d89-8b40-a10e06f359b8 admin admin] PATH_INFO: `/v3/projects/b84800b4961e4002814a000e6d1e4c71/users/bd790ec710d74014aba0804cd8ed252b/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:23.981975 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9399e-2bfe-4d89-8b40-a10e06f359b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84800b4961e4002814a000e6d1e4c71, user_id=bd790ec710d74014aba0804cd8ed252b, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:23.986764 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9399e-2bfe-4d89-8b40-a10e06f359b8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:24.006369 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1351/2726] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:50:23 2022] PUT /identity/v3/projects/b84800b4961e4002814a000e6d1e4c71/users/bd790ec710d74014aba0804cd8ed252b/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:50:24.019593 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64754b99-abd8-404b-8104-bfc31a5c73d4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:24.019995 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64754b99-abd8-404b-8104-bfc31a5c73d4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:24.020296 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64754b99-abd8-404b-8104-bfc31a5c73d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:24.073892 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-64754b99-abd8-404b-8104-bfc31a5c73d4 None None] MFA Rules not processed for user `bd790ec710d74014aba0804cd8ed252b`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:24.074144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-64754b99-abd8-404b-8104-bfc31a5c73d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:24.149464 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:24.172922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1376/2727] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:50:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:24.184552 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9399e-2bfe-4d89-8b40-a10e06f359b8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:24.186349 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8bb9399e-2bfe-4d89-8b40-a10e06f359b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:24.266719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9399e-2bfe-4d89-8b40-a10e06f359b8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:24.273574 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea1025-c248-4d93-b3ca-b3bef6e38ec7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '363d16eebb3f40a1be71506961cc3c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:24.274267 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea1025-c248-4d93-b3ca-b3bef6e38ec7 service glance] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:24.274557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea1025-c248-4d93-b3ca-b3bef6e38ec7 service glance] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:24.274875 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea1025-c248-4d93-b3ca-b3bef6e38ec7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:24.285702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea1025-c248-4d93-b3ca-b3bef6e38ec7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:24.288231 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea1025-c248-4d93-b3ca-b3bef6e38ec7 service glance] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:24.292575 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:24.309280 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1352/2728] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:50:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:25.673215 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd78376-08ff-490e-ab7b-55fd21d822a0 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:25.673770 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd78376-08ff-490e-ab7b-55fd21d822a0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:25.673857 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd78376-08ff-490e-ab7b-55fd21d822a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:25.710747 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fbd78376-08ff-490e-ab7b-55fd21d822a0 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:25.713932 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fbd78376-08ff-490e-ab7b-55fd21d822a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:25.815860 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1377/2729] 10.222.0.117 () {58 vars in 1021 bytes} [Thu May 26 16:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:25.853906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea1025-c248-4d93-b3ca-b3bef6e38ec7 service glance] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:25.856073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-eaea1025-c248-4d93-b3ca-b3bef6e38ec7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:25.999137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea1025-c248-4d93-b3ca-b3bef6e38ec7 service glance] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:26.008942 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db3fa9-271a-40ae-b5b6-302c28117b03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:26.010038 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db3fa9-271a-40ae-b5b6-302c28117b03 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:26.010543 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db3fa9-271a-40ae-b5b6-302c28117b03 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:26.011937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db3fa9-271a-40ae-b5b6-302c28117b03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:26.031350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db3fa9-271a-40ae-b5b6-302c28117b03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:26.035456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db3fa9-271a-40ae-b5b6-302c28117b03 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:26.059193 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1353/2730] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:50:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:26.545684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa053df-ecfc-4e87-9558-ce1981c116fa None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:26.546183 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa053df-ecfc-4e87-9558-ce1981c116fa None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:26.546836 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa053df-ecfc-4e87-9558-ce1981c116fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:26.589811 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7fa053df-ecfc-4e87-9558-ce1981c116fa None None] MFA Rules not processed for user `2d4104cb17d645a5bc766a15f863fbdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:26.591432 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7fa053df-ecfc-4e87-9558-ce1981c116fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:26.712712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1378/2731] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:50:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:50:26.733083 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db3fa9-271a-40ae-b5b6-302c28117b03 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:26.734584 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-34db3fa9-271a-40ae-b5b6-302c28117b03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:26.752977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db3fa9-271a-40ae-b5b6-302c28117b03 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:26.760632 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae2a0a-ef8a-419e-911a-e5455305c5b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:26.761300 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae2a0a-ef8a-419e-911a-e5455305c5b3 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:26.761581 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae2a0a-ef8a-419e-911a-e5455305c5b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:26.761860 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae2a0a-ef8a-419e-911a-e5455305c5b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:26.772124 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae2a0a-ef8a-419e-911a-e5455305c5b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:26.774358 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae2a0a-ef8a-419e-911a-e5455305c5b3 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:26.786857 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1354/2732] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:50:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:28.410060 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904869c-893f-46f5-a610-cb865b27bbbb None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:28.411559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904869c-893f-46f5-a610-cb865b27bbbb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:28.411559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904869c-893f-46f5-a610-cb865b27bbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:28.434389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e904869c-893f-46f5-a610-cb865b27bbbb None None] MFA Rules not processed for user `2d4104cb17d645a5bc766a15f863fbdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:28.435802 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e904869c-893f-46f5-a610-cb865b27bbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:28.446271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1379/2733] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:50:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:28.825583 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae2a0a-ef8a-419e-911a-e5455305c5b3 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:28.827588 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-85ae2a0a-ef8a-419e-911a-e5455305c5b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:28.905566 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae2a0a-ef8a-419e-911a-e5455305c5b3 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:28.909847 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff7df5-69b0-4148-8a6e-72eb9317819c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:28.910516 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff7df5-69b0-4148-8a6e-72eb9317819c service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:28.910835 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff7df5-69b0-4148-8a6e-72eb9317819c service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:28.911118 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff7df5-69b0-4148-8a6e-72eb9317819c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:28.913046 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7fff7df5-69b0-4148-8a6e-72eb9317819c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:28.925758 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff7df5-69b0-4148-8a6e-72eb9317819c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:28.927106 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff7df5-69b0-4148-8a6e-72eb9317819c service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:28.939291 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1355/2734] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:50:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:31.793972 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd1291-83dd-40f8-bb4e-d0e603036acb None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:31.795035 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd1291-83dd-40f8-bb4e-d0e603036acb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:31.795035 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd1291-83dd-40f8-bb4e-d0e603036acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:31.816750 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-48dd1291-83dd-40f8-bb4e-d0e603036acb None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:31.818085 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-48dd1291-83dd-40f8-bb4e-d0e603036acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:31.828543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1380/2735] 10.222.0.117 () {58 vars in 1021 bytes} [Thu May 26 16:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:31.857155 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff7df5-69b0-4148-8a6e-72eb9317819c service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:31.874544 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff7df5-69b0-4148-8a6e-72eb9317819c service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:31.884708 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da010e18-c7ef-4556-9031-bc21e9107ea0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:31.885395 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da010e18-c7ef-4556-9031-bc21e9107ea0 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:31.885842 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da010e18-c7ef-4556-9031-bc21e9107ea0 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:31.886101 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da010e18-c7ef-4556-9031-bc21e9107ea0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:31.898135 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da010e18-c7ef-4556-9031-bc21e9107ea0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:31.901157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da010e18-c7ef-4556-9031-bc21e9107ea0 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:31.917858 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1356/2736] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:35.141070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46781cae-d0cb-43e3-9e33-0694e687f2c4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:35.141666 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46781cae-d0cb-43e3-9e33-0694e687f2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:35.141924 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46781cae-d0cb-43e3-9e33-0694e687f2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:35.175205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-46781cae-d0cb-43e3-9e33-0694e687f2c4 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:35.179385 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-46781cae-d0cb-43e3-9e33-0694e687f2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:35.196505 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1381/2737] 10.222.0.117 () {58 vars in 1021 bytes} [Thu May 26 16:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:35.221501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da010e18-c7ef-4556-9031-bc21e9107ea0 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:35.234952 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da010e18-c7ef-4556-9031-bc21e9107ea0 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:35.241063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a9d01-ae4b-403e-916b-721992def886 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:35.241890 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a9d01-ae4b-403e-916b-721992def886 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:35.242178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a9d01-ae4b-403e-916b-721992def886 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:35.242547 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a9d01-ae4b-403e-916b-721992def886 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:35.253635 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a9d01-ae4b-403e-916b-721992def886 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:35.255037 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a9d01-ae4b-403e-916b-721992def886 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:35.268071 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1357/2738] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:38.233207 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfb8c8-c09c-4db5-a5da-ae7b7bf86d3d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:38.234064 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfb8c8-c09c-4db5-a5da-ae7b7bf86d3d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:38.234064 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfb8c8-c09c-4db5-a5da-ae7b7bf86d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:38.254803 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1abfb8c8-c09c-4db5-a5da-ae7b7bf86d3d None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:38.256388 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1abfb8c8-c09c-4db5-a5da-ae7b7bf86d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:38.272178 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1382/2739] 10.222.0.117 () {58 vars in 1021 bytes} [Thu May 26 16:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:38.306181 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a9d01-ae4b-403e-916b-721992def886 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:38.319239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a9d01-ae4b-403e-916b-721992def886 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:38.326257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6d446-83e1-4a38-a502-f8440c3c1d3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:38.326970 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6d446-83e1-4a38-a502-f8440c3c1d3d service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:38.327265 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6d446-83e1-4a38-a502-f8440c3c1d3d service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:38.327552 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6d446-83e1-4a38-a502-f8440c3c1d3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:38.337555 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6d446-83e1-4a38-a502-f8440c3c1d3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:38.339227 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6d446-83e1-4a38-a502-f8440c3c1d3d service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:38.356678 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1358/2740] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:41.458278 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba4d09-2d12-4e2f-b5f5-142dfe46dbe3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:41.459036 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba4d09-2d12-4e2f-b5f5-142dfe46dbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:41.459268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba4d09-2d12-4e2f-b5f5-142dfe46dbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:41.486987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-88ba4d09-2d12-4e2f-b5f5-142dfe46dbe3 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:41.489744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-88ba4d09-2d12-4e2f-b5f5-142dfe46dbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:41.502794 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1383/2741] 10.222.0.117 () {58 vars in 1021 bytes} [Thu May 26 16:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:41.547183 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6d446-83e1-4a38-a502-f8440c3c1d3d service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:41.564650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6d446-83e1-4a38-a502-f8440c3c1d3d service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:41.572042 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56212f4c-259f-4d4f-9a3f-3933ef70e731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:41.572788 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56212f4c-259f-4d4f-9a3f-3933ef70e731 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:41.573079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56212f4c-259f-4d4f-9a3f-3933ef70e731 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:41.573373 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56212f4c-259f-4d4f-9a3f-3933ef70e731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:41.582391 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56212f4c-259f-4d4f-9a3f-3933ef70e731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:41.584020 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56212f4c-259f-4d4f-9a3f-3933ef70e731 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:41.593926 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1359/2742] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:45.657913 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96975eee-0c40-4ffd-9979-34ad949a9c63 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:45.658465 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96975eee-0c40-4ffd-9979-34ad949a9c63 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:45.658594 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96975eee-0c40-4ffd-9979-34ad949a9c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:45.677780 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-96975eee-0c40-4ffd-9979-34ad949a9c63 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:45.679040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-96975eee-0c40-4ffd-9979-34ad949a9c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:45.687320 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1384/2743] 10.222.0.117 () {58 vars in 1021 bytes} [Thu May 26 16:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:50:45.709192 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56212f4c-259f-4d4f-9a3f-3933ef70e731 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:45.721426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56212f4c-259f-4d4f-9a3f-3933ef70e731 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:45.727174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0a685-3df5-4f52-85de-5737068c92bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:45.727821 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0a685-3df5-4f52-85de-5737068c92bf service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:45.728109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0a685-3df5-4f52-85de-5737068c92bf service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:45.728391 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0a685-3df5-4f52-85de-5737068c92bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:45.736711 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0a685-3df5-4f52-85de-5737068c92bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:45.738281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0a685-3df5-4f52-85de-5737068c92bf service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:45.747959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1360/2744] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:50.966379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96975eee-0c40-4ffd-9979-34ad949a9c63 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:50.976429 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96975eee-0c40-4ffd-9979-34ad949a9c63 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:50.981823 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea474d-01ef-4a66-902d-ba2b61d5077e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:50.982752 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea474d-01ef-4a66-902d-ba2b61d5077e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:50.983042 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea474d-01ef-4a66-902d-ba2b61d5077e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:50.983343 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea474d-01ef-4a66-902d-ba2b61d5077e admin admin] PATH_INFO: `/v3/users/bd790ec710d74014aba0804cd8ed252b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:50.984563 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea474d-01ef-4a66-902d-ba2b61d5077e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd790ec710d74014aba0804cd8ed252b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:50.986505 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea474d-01ef-4a66-902d-ba2b61d5077e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:51.034640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:51.047080 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e4ea474d-01ef-4a66-902d-ba2b61d5077e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd790ec710d74014aba0804cd8ed252b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:51.062333 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e4ea474d-01ef-4a66-902d-ba2b61d5077e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd790ec710d74014aba0804cd8ed252b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:51.063499 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e4ea474d-01ef-4a66-902d-ba2b61d5077e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd790ec710d74014aba0804cd8ed252b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:51.071265 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e4ea474d-01ef-4a66-902d-ba2b61d5077e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd790ec710d74014aba0804cd8ed252b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:51.071889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e4ea474d-01ef-4a66-902d-ba2b61d5077e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd790ec710d74014aba0804cd8ed252b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:51.084749 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1385/2745] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:50:50 2022] DELETE /identity/v3/users/bd790ec710d74014aba0804cd8ed252b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:50:51.089617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82460fd-ca50-4960-ae88-5740af2ab646 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:51.090104 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82460fd-ca50-4960-ae88-5740af2ab646 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:51.090205 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82460fd-ca50-4960-ae88-5740af2ab646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:51.102214 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:51.109215 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f82460fd-ca50-4960-ae88-5740af2ab646 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:51.110447 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f82460fd-ca50-4960-ae88-5740af2ab646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:51.183703 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1361/2746] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:51.193702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea474d-01ef-4a66-902d-ba2b61d5077e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:51.195205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e4ea474d-01ef-4a66-902d-ba2b61d5077e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:51.259894 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea474d-01ef-4a66-902d-ba2b61d5077e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:51.263673 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce206c84-8bd7-4014-88ea-3483f1428a64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:51.264325 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce206c84-8bd7-4014-88ea-3483f1428a64 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:51.264611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce206c84-8bd7-4014-88ea-3483f1428a64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:51.264888 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce206c84-8bd7-4014-88ea-3483f1428a64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:51.274416 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce206c84-8bd7-4014-88ea-3483f1428a64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:51.276437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce206c84-8bd7-4014-88ea-3483f1428a64 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:51.286492 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1386/2747] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:50:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:51.584575 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82460fd-ca50-4960-ae88-5740af2ab646 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:51.586820 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f82460fd-ca50-4960-ae88-5740af2ab646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:51.601786 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82460fd-ca50-4960-ae88-5740af2ab646 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:51.607064 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fd075-1d63-4451-a43a-e77c8d22464c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:51.607954 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fd075-1d63-4451-a43a-e77c8d22464c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:51.608270 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fd075-1d63-4451-a43a-e77c8d22464c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:51.608547 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fd075-1d63-4451-a43a-e77c8d22464c admin admin] PATH_INFO: `/v3/projects/b84800b4961e4002814a000e6d1e4c71` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:51.610922 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fd075-1d63-4451-a43a-e77c8d22464c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b84800b4961e4002814a000e6d1e4c71)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:51.612900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fd075-1d63-4451-a43a-e77c8d22464c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:51.668110 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-248fd075-1d63-4451-a43a-e77c8d22464c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b84800b4961e4002814a000e6d1e4c71', 'request_id': 'req-248fd075-1d63-4451-a43a-e77c8d22464c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:51.676606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-248fd075-1d63-4451-a43a-e77c8d22464c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b84800b4961e4002814a000e6d1e4c71', 'request_id': 'req-248fd075-1d63-4451-a43a-e77c8d22464c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:51.683725 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-248fd075-1d63-4451-a43a-e77c8d22464c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b84800b4961e4002814a000e6d1e4c71', 'request_id': 'req-248fd075-1d63-4451-a43a-e77c8d22464c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:51.694063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-248fd075-1d63-4451-a43a-e77c8d22464c admin admin] The token cache is being invalidate because project b84800b4961e4002814a000e6d1e4c71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:50:51.694350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-248fd075-1d63-4451-a43a-e77c8d22464c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:51.695218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-248fd075-1d63-4451-a43a-e77c8d22464c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:51.696723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1362/2748] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:50:51 2022] DELETE /identity/v3/projects/b84800b4961e4002814a000e6d1e4c71 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:50:51.702256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab910e1-c1cc-442b-9fe0-71453cc2f413 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:51.702548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab910e1-c1cc-442b-9fe0-71453cc2f413 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:51.702901 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab910e1-c1cc-442b-9fe0-71453cc2f413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:51.721272 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8ab910e1-c1cc-442b-9fe0-71453cc2f413 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:51.722489 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8ab910e1-c1cc-442b-9fe0-71453cc2f413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:51.791685 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1387/2749] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:51.799773 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dd6b1-1dbd-46ae-a02a-d56b0aca00ef None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:51.800088 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dd6b1-1dbd-46ae-a02a-d56b0aca00ef None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:51.800339 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dd6b1-1dbd-46ae-a02a-d56b0aca00ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:51.819864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9c2dd6b1-1dbd-46ae-a02a-d56b0aca00ef None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:51.821134 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9c2dd6b1-1dbd-46ae-a02a-d56b0aca00ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:51.830058 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1363/2750] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:51.834341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab910e1-c1cc-442b-9fe0-71453cc2f413 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:51.845509 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab910e1-c1cc-442b-9fe0-71453cc2f413 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:51.850456 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5dfce-d325-4057-a2ac-5721b5c944d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:51.851234 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5dfce-d325-4057-a2ac-5721b5c944d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:51.851522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5dfce-d325-4057-a2ac-5721b5c944d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:51.851805 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5dfce-d325-4057-a2ac-5721b5c944d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:51.852540 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5dfce-d325-4057-a2ac-5721b5c944d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:50:51.852858 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5dfce-d325-4057-a2ac-5721b5c944d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:51.854478 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5dfce-d325-4057-a2ac-5721b5c944d7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:51.867288 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1388/2751] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:50:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:50:51.871534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dd6b1-1dbd-46ae-a02a-d56b0aca00ef None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:51.881137 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dd6b1-1dbd-46ae-a02a-d56b0aca00ef None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:51.886719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17526ab1-2d24-42c6-8bd3-dfdeb49a468a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:51.889361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17526ab1-2d24-42c6-8bd3-dfdeb49a468a admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:51.889361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17526ab1-2d24-42c6-8bd3-dfdeb49a468a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:51.889361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17526ab1-2d24-42c6-8bd3-dfdeb49a468a admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:51.889361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17526ab1-2d24-42c6-8bd3-dfdeb49a468a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:51.890487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17526ab1-2d24-42c6-8bd3-dfdeb49a468a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:51.919521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1364/2752] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:50:51 2022] POST /identity/v3/projects => generated 392 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:50:51.923814 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5dfce-d325-4057-a2ac-5721b5c944d7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:51.934905 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5dfce-d325-4057-a2ac-5721b5c944d7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:51.978905 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:51.999988 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8298729-e3f6-49a5-86da-3fe77bf25903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:52.000671 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8298729-e3f6-49a5-86da-3fe77bf25903 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:52.000953 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8298729-e3f6-49a5-86da-3fe77bf25903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:52.001232 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8298729-e3f6-49a5-86da-3fe77bf25903 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:52.001950 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8298729-e3f6-49a5-86da-3fe77bf25903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:52.003901 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8298729-e3f6-49a5-86da-3fe77bf25903 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:52.026639 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1389/2753] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:50:51 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:50:52.032189 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17526ab1-2d24-42c6-8bd3-dfdeb49a468a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:52.043317 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17526ab1-2d24-42c6-8bd3-dfdeb49a468a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:52.049469 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60844e-6e89-42c5-ad16-46b0b1889ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:52.050151 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60844e-6e89-42c5-ad16-46b0b1889ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:52.050438 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60844e-6e89-42c5-ad16-46b0b1889ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:52.050757 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60844e-6e89-42c5-ad16-46b0b1889ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:52.051524 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60844e-6e89-42c5-ad16-46b0b1889ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:52.053418 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60844e-6e89-42c5-ad16-46b0b1889ab0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:52.066435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1365/2754] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:50:52 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:50:52.070450 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8298729-e3f6-49a5-86da-3fe77bf25903 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:52.083679 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8298729-e3f6-49a5-86da-3fe77bf25903 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:52.089321 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2e37e-144a-403d-95b5-e0a4641ea6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:52.089992 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2e37e-144a-403d-95b5-e0a4641ea6df admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:52.090271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2e37e-144a-403d-95b5-e0a4641ea6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:52.090548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2e37e-144a-403d-95b5-e0a4641ea6df admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:52.091300 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2e37e-144a-403d-95b5-e0a4641ea6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:52.092892 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2e37e-144a-403d-95b5-e0a4641ea6df admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:52.103549 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1390/2755] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:50:52 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:50:52.108029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60844e-6e89-42c5-ad16-46b0b1889ab0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:52.118548 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60844e-6e89-42c5-ad16-46b0b1889ab0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:52.123913 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299efdd4-7f0f-4e43-95d6-cb1c3fc24bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:52.124831 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299efdd4-7f0f-4e43-95d6-cb1c3fc24bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:52.125113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299efdd4-7f0f-4e43-95d6-cb1c3fc24bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:52.125389 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299efdd4-7f0f-4e43-95d6-cb1c3fc24bc0 admin admin] PATH_INFO: `/v3/projects/e46c528f43f24059a493296e1947e844/users/9cf94f3582264e0ebb49c58932b56450/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:52.141478 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299efdd4-7f0f-4e43-95d6-cb1c3fc24bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e46c528f43f24059a493296e1947e844, user_id=9cf94f3582264e0ebb49c58932b56450, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:52.144195 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299efdd4-7f0f-4e43-95d6-cb1c3fc24bc0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:52.164098 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1366/2756] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:50:52 2022] PUT /identity/v3/projects/e46c528f43f24059a493296e1947e844/users/9cf94f3582264e0ebb49c58932b56450/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:50:52.229573 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b259d7-9275-4e29-b11d-edf9537dfb81 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:52.229835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b259d7-9275-4e29-b11d-edf9537dfb81 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:52.230055 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b259d7-9275-4e29-b11d-edf9537dfb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:52.264539 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-79b259d7-9275-4e29-b11d-edf9537dfb81 None None] MFA Rules not processed for user `9cf94f3582264e0ebb49c58932b56450`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:52.265784 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-79b259d7-9275-4e29-b11d-edf9537dfb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:52.335964 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1391/2757] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:50:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:52.347115 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299efdd4-7f0f-4e43-95d6-cb1c3fc24bc0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:52.349284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-299efdd4-7f0f-4e43-95d6-cb1c3fc24bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:52.385171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:52.422956 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299efdd4-7f0f-4e43-95d6-cb1c3fc24bc0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:52.429119 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c197e6e-42c6-47f4-b553-d44008c73932 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:52.429841 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c197e6e-42c6-47f4-b553-d44008c73932 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:52.430122 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c197e6e-42c6-47f4-b553-d44008c73932 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:52.430404 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c197e6e-42c6-47f4-b553-d44008c73932 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:52.439946 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c197e6e-42c6-47f4-b553-d44008c73932 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:52.441400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c197e6e-42c6-47f4-b553-d44008c73932 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:52.450636 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1367/2758] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:50:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:56.294117 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b259d7-9275-4e29-b11d-edf9537dfb81 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:56.295721 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-79b259d7-9275-4e29-b11d-edf9537dfb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:56.379729 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b259d7-9275-4e29-b11d-edf9537dfb81 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:56.384876 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827a4e2-9504-4488-acb2-04e96a1e682c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ffef7640dd1487ab2ea91fc0f4be9e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:56.386153 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827a4e2-9504-4488-acb2-04e96a1e682c service placement] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:56.386153 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827a4e2-9504-4488-acb2-04e96a1e682c service placement] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:56.386153 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827a4e2-9504-4488-acb2-04e96a1e682c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:56.388462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0827a4e2-9504-4488-acb2-04e96a1e682c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:56.401303 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827a4e2-9504-4488-acb2-04e96a1e682c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:56.405211 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827a4e2-9504-4488-acb2-04e96a1e682c service placement] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:56.419919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1392/2759] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:50:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:01.011892 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13bc55-9208-4ad8-a4e7-494c20d53abe None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:01.012422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13bc55-9208-4ad8-a4e7-494c20d53abe None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:01.012540 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13bc55-9208-4ad8-a4e7-494c20d53abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:01.030887 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0f13bc55-9208-4ad8-a4e7-494c20d53abe None None] MFA Rules not processed for user `366b03f6276d4fbe96f054d471d28187`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:01.032123 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0f13bc55-9208-4ad8-a4e7-494c20d53abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:01.096166 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1368/2760] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:51:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:02.749543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827a4e2-9504-4488-acb2-04e96a1e682c service placement] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:02.802672 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:02.825408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827a4e2-9504-4488-acb2-04e96a1e682c service placement] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:02.834290 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9260f97-fa6b-40c5-984c-de215a60f626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:02.835423 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9260f97-fa6b-40c5-984c-de215a60f626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:02.835712 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9260f97-fa6b-40c5-984c-de215a60f626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:02.835994 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9260f97-fa6b-40c5-984c-de215a60f626 admin admin] PATH_INFO: `/v3/users/9cf94f3582264e0ebb49c58932b56450` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:02.837316 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9260f97-fa6b-40c5-984c-de215a60f626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cf94f3582264e0ebb49c58932b56450)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:02.840509 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9260f97-fa6b-40c5-984c-de215a60f626 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:02.918140 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e9260f97-fa6b-40c5-984c-de215a60f626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cf94f3582264e0ebb49c58932b56450'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:02.937873 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e9260f97-fa6b-40c5-984c-de215a60f626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cf94f3582264e0ebb49c58932b56450'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:02.938778 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e9260f97-fa6b-40c5-984c-de215a60f626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cf94f3582264e0ebb49c58932b56450'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:02.947782 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e9260f97-fa6b-40c5-984c-de215a60f626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cf94f3582264e0ebb49c58932b56450'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:02.948488 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e9260f97-fa6b-40c5-984c-de215a60f626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cf94f3582264e0ebb49c58932b56450'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:02.963487 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1393/2761] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:51:02 2022] DELETE /identity/v3/users/9cf94f3582264e0ebb49c58932b56450 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:51:02.970343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d73d6-3f58-4770-ab73-213b7bc0ee0a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:02.970940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d73d6-3f58-4770-ab73-213b7bc0ee0a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:02.971057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d73d6-3f58-4770-ab73-213b7bc0ee0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:02.989707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-832d73d6-3f58-4770-ab73-213b7bc0ee0a None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:02.990984 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-832d73d6-3f58-4770-ab73-213b7bc0ee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:03.061410 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1369/2762] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:03.072016 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9260f97-fa6b-40c5-984c-de215a60f626 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:03.073576 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e9260f97-fa6b-40c5-984c-de215a60f626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:03.157339 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9260f97-fa6b-40c5-984c-de215a60f626 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:03.161027 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e0a82-d325-4a59-b06e-293f48f18c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:03.161688 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e0a82-d325-4a59-b06e-293f48f18c39 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:03.161981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e0a82-d325-4a59-b06e-293f48f18c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:03.162509 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e0a82-d325-4a59-b06e-293f48f18c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:03.173220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e0a82-d325-4a59-b06e-293f48f18c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:03.174716 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e0a82-d325-4a59-b06e-293f48f18c39 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:03.187422 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1394/2763] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:51:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:03.500058 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d73d6-3f58-4770-ab73-213b7bc0ee0a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:03.501939 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-832d73d6-3f58-4770-ab73-213b7bc0ee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:03.522594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d73d6-3f58-4770-ab73-213b7bc0ee0a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:03.532393 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80798adf-acf6-4b19-8325-fc47632b437b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:03.535006 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80798adf-acf6-4b19-8325-fc47632b437b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:03.535754 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80798adf-acf6-4b19-8325-fc47632b437b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:03.536576 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80798adf-acf6-4b19-8325-fc47632b437b admin admin] PATH_INFO: `/v3/projects/e46c528f43f24059a493296e1947e844` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:03.539514 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80798adf-acf6-4b19-8325-fc47632b437b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e46c528f43f24059a493296e1947e844)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:03.544179 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80798adf-acf6-4b19-8325-fc47632b437b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:03.594850 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80798adf-acf6-4b19-8325-fc47632b437b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e46c528f43f24059a493296e1947e844', 'request_id': 'req-80798adf-acf6-4b19-8325-fc47632b437b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:03.603699 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80798adf-acf6-4b19-8325-fc47632b437b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e46c528f43f24059a493296e1947e844', 'request_id': 'req-80798adf-acf6-4b19-8325-fc47632b437b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:03.611120 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80798adf-acf6-4b19-8325-fc47632b437b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e46c528f43f24059a493296e1947e844', 'request_id': 'req-80798adf-acf6-4b19-8325-fc47632b437b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:03.617719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:03.622609 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80798adf-acf6-4b19-8325-fc47632b437b admin admin] The token cache is being invalidate because project e46c528f43f24059a493296e1947e844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:51:03.623076 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80798adf-acf6-4b19-8325-fc47632b437b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:03.624398 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80798adf-acf6-4b19-8325-fc47632b437b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:03.638688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1370/2764] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:51:03 2022] DELETE /identity/v3/projects/e46c528f43f24059a493296e1947e844 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:51:13.181630 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=61,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:13.630096 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:14.092834 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a3428-2b32-4ab0-8506-f7e65f19889c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:14.093135 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a3428-2b32-4ab0-8506-f7e65f19889c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:14.093414 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a3428-2b32-4ab0-8506-f7e65f19889c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:14.113498 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-278a3428-2b32-4ab0-8506-f7e65f19889c None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:14.114788 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-278a3428-2b32-4ab0-8506-f7e65f19889c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:14.177765 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1395/2765] 10.222.0.117 () {58 vars in 1021 bytes} [Thu May 26 16:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:14.200191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80798adf-acf6-4b19-8325-fc47632b437b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:14.201617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-80798adf-acf6-4b19-8325-fc47632b437b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:14.277156 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80798adf-acf6-4b19-8325-fc47632b437b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:14.282803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce5beb-2840-4594-a9cb-a8e61586cbc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:14.283462 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce5beb-2840-4594-a9cb-a8e61586cbc0 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:14.283751 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce5beb-2840-4594-a9cb-a8e61586cbc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:14.284548 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce5beb-2840-4594-a9cb-a8e61586cbc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:14.292843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce5beb-2840-4594-a9cb-a8e61586cbc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:14.294437 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce5beb-2840-4594-a9cb-a8e61586cbc0 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:14.304906 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1371/2766] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:51:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:17.359404 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3e4df-ffbc-4de0-a6a4-a8ab6fd66e3c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:17.359947 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3e4df-ffbc-4de0-a6a4-a8ab6fd66e3c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:17.359947 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3e4df-ffbc-4de0-a6a4-a8ab6fd66e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:17.378616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-11c3e4df-ffbc-4de0-a6a4-a8ab6fd66e3c None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:17.380375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-11c3e4df-ffbc-4de0-a6a4-a8ab6fd66e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:17.388299 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1396/2767] 10.222.0.117 () {58 vars in 1021 bytes} [Thu May 26 16:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:17.411368 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce5beb-2840-4594-a9cb-a8e61586cbc0 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:17.413015 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-94ce5beb-2840-4594-a9cb-a8e61586cbc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:17.429169 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce5beb-2840-4594-a9cb-a8e61586cbc0 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:17.434955 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbcdad-3685-4271-ba75-0f80950eb8e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:17.435608 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbcdad-3685-4271-ba75-0f80950eb8e6 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:17.435898 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbcdad-3685-4271-ba75-0f80950eb8e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:17.436183 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbcdad-3685-4271-ba75-0f80950eb8e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:17.445608 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbcdad-3685-4271-ba75-0f80950eb8e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:17.447236 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbcdad-3685-4271-ba75-0f80950eb8e6 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:17.457406 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1372/2768] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:51:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:20.444949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5130bd3-1e4a-4da0-962c-40e5292c2d30 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:20.445838 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5130bd3-1e4a-4da0-962c-40e5292c2d30 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:20.445838 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5130bd3-1e4a-4da0-962c-40e5292c2d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:20.465327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e5130bd3-1e4a-4da0-962c-40e5292c2d30 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:20.467427 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e5130bd3-1e4a-4da0-962c-40e5292c2d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:20.479715 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1397/2769] 10.222.0.117 () {58 vars in 1021 bytes} [Thu May 26 16:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:20.507791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbcdad-3685-4271-ba75-0f80950eb8e6 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:20.519250 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbcdad-3685-4271-ba75-0f80950eb8e6 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:20.525287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27571547-3e0e-46d1-a162-b5071ca40465 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:20.525972 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27571547-3e0e-46d1-a162-b5071ca40465 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:20.526255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27571547-3e0e-46d1-a162-b5071ca40465 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:20.526600 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27571547-3e0e-46d1-a162-b5071ca40465 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:20.535903 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27571547-3e0e-46d1-a162-b5071ca40465 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:20.537541 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27571547-3e0e-46d1-a162-b5071ca40465 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:20.547932 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1373/2770] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:51:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:23.647472 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5dcf8-bad2-41f7-8332-15ce790704b8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:23.648069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5dcf8-bad2-41f7-8332-15ce790704b8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:23.648069 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5dcf8-bad2-41f7-8332-15ce790704b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:23.667081 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-90b5dcf8-bad2-41f7-8332-15ce790704b8 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:23.668287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-90b5dcf8-bad2-41f7-8332-15ce790704b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:23.679291 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1398/2771] 10.222.0.117 () {58 vars in 1021 bytes} [Thu May 26 16:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:23.712995 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27571547-3e0e-46d1-a162-b5071ca40465 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:23.724973 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27571547-3e0e-46d1-a162-b5071ca40465 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:23.730846 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f6c0f-9ccd-4c97-95e5-688c480aece4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:23.731868 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f6c0f-9ccd-4c97-95e5-688c480aece4 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:23.731868 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f6c0f-9ccd-4c97-95e5-688c480aece4 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:23.732212 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f6c0f-9ccd-4c97-95e5-688c480aece4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:23.742487 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f6c0f-9ccd-4c97-95e5-688c480aece4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:23.744108 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f6c0f-9ccd-4c97-95e5-688c480aece4 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:23.755546 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1374/2772] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:51:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:26.810048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd889414-7e28-445d-8231-9147afe7665f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:26.810541 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd889414-7e28-445d-8231-9147afe7665f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:26.810680 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd889414-7e28-445d-8231-9147afe7665f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:26.829558 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-cd889414-7e28-445d-8231-9147afe7665f None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:26.830797 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cd889414-7e28-445d-8231-9147afe7665f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:26.839460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1399/2773] 10.222.0.117 () {58 vars in 1021 bytes} [Thu May 26 16:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:26.862177 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f6c0f-9ccd-4c97-95e5-688c480aece4 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:26.873963 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f6c0f-9ccd-4c97-95e5-688c480aece4 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:26.879853 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcdbc4-0801-4cb5-b7a1-23a8f1f8c670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:26.880513 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcdbc4-0801-4cb5-b7a1-23a8f1f8c670 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:26.880800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcdbc4-0801-4cb5-b7a1-23a8f1f8c670 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:26.881082 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcdbc4-0801-4cb5-b7a1-23a8f1f8c670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:26.890791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bcdbc4-0801-4cb5-b7a1-23a8f1f8c670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:26.892384 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bcdbc4-0801-4cb5-b7a1-23a8f1f8c670 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:26.902650 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1375/2774] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:51:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:36.824650 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=39 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:36.898411 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=58 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:56.117328 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd889414-7e28-445d-8231-9147afe7665f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:56.119219 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cd889414-7e28-445d-8231-9147afe7665f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:56.133977 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd889414-7e28-445d-8231-9147afe7665f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:56.139115 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b534d-6c77-440f-9fc8-bb3203793b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:56.140002 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b534d-6c77-440f-9fc8-bb3203793b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:56.140289 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b534d-6c77-440f-9fc8-bb3203793b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:56.140575 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b534d-6c77-440f-9fc8-bb3203793b9c admin admin] PATH_INFO: `/v3/users/366b03f6276d4fbe96f054d471d28187` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:56.141779 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b534d-6c77-440f-9fc8-bb3203793b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=366b03f6276d4fbe96f054d471d28187)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:56.143770 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b534d-6c77-440f-9fc8-bb3203793b9c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:56.193163 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ab4b534d-6c77-440f-9fc8-bb3203793b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366b03f6276d4fbe96f054d471d28187'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:56.209454 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ab4b534d-6c77-440f-9fc8-bb3203793b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366b03f6276d4fbe96f054d471d28187'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:56.210208 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ab4b534d-6c77-440f-9fc8-bb3203793b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366b03f6276d4fbe96f054d471d28187'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:56.217915 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ab4b534d-6c77-440f-9fc8-bb3203793b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366b03f6276d4fbe96f054d471d28187'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:56.218783 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ab4b534d-6c77-440f-9fc8-bb3203793b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366b03f6276d4fbe96f054d471d28187'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:56.232487 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1400/2775] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:51:56 2022] DELETE /identity/v3/users/366b03f6276d4fbe96f054d471d28187 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:51:56.417688 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcdbc4-0801-4cb5-b7a1-23a8f1f8c670 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:56.436198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcdbc4-0801-4cb5-b7a1-23a8f1f8c670 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:56.496672 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9e979-7649-4354-8442-8d625ca876d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:56.497473 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9e979-7649-4354-8442-8d625ca876d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:56.497823 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9e979-7649-4354-8442-8d625ca876d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:56.498109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9e979-7649-4354-8442-8d625ca876d6 admin admin] PATH_INFO: `/v3/projects/807306998ab04eed81227e6d6198b71e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:56.499360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9e979-7649-4354-8442-8d625ca876d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=807306998ab04eed81227e6d6198b71e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:56.501393 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9e979-7649-4354-8442-8d625ca876d6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:56.547672 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b9c9e979-7649-4354-8442-8d625ca876d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807306998ab04eed81227e6d6198b71e', 'request_id': 'req-b9c9e979-7649-4354-8442-8d625ca876d6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:56.555205 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b9c9e979-7649-4354-8442-8d625ca876d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807306998ab04eed81227e6d6198b71e', 'request_id': 'req-b9c9e979-7649-4354-8442-8d625ca876d6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:56.561591 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b9c9e979-7649-4354-8442-8d625ca876d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807306998ab04eed81227e6d6198b71e', 'request_id': 'req-b9c9e979-7649-4354-8442-8d625ca876d6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:56.572237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b9c9e979-7649-4354-8442-8d625ca876d6 admin admin] The token cache is being invalidate because project 807306998ab04eed81227e6d6198b71e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:51:56.572528 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b9c9e979-7649-4354-8442-8d625ca876d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:56.573157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b9c9e979-7649-4354-8442-8d625ca876d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:56.574975 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1376/2776] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:51:56 2022] DELETE /identity/v3/projects/807306998ab04eed81227e6d6198b71e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:52:06.228842 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:52:06.569076 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:52:28.096851 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b534d-6c77-440f-9fc8-bb3203793b9c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:28.098256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ab4b534d-6c77-440f-9fc8-bb3203793b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:28.155901 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b534d-6c77-440f-9fc8-bb3203793b9c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:28.203118 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446a958-c685-4f8b-aa57-9a47a5d6dd76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:28.203772 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446a958-c685-4f8b-aa57-9a47a5d6dd76 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:28.204097 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446a958-c685-4f8b-aa57-9a47a5d6dd76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:28.204382 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446a958-c685-4f8b-aa57-9a47a5d6dd76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:28.206203 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f446a958-c685-4f8b-aa57-9a47a5d6dd76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:28.275892 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446a958-c685-4f8b-aa57-9a47a5d6dd76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:28.277364 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446a958-c685-4f8b-aa57-9a47a5d6dd76 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:28.288734 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1401/2777] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:52:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:52:29.460182 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9e979-7649-4354-8442-8d625ca876d6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:29.461564 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b9c9e979-7649-4354-8442-8d625ca876d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:29.474406 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9e979-7649-4354-8442-8d625ca876d6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:29.478175 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252f88f-aa9b-4934-b267-23bba77ef316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:29.478946 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252f88f-aa9b-4934-b267-23bba77ef316 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:29.479236 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252f88f-aa9b-4934-b267-23bba77ef316 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:29.479521 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252f88f-aa9b-4934-b267-23bba77ef316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:29.481355 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8252f88f-aa9b-4934-b267-23bba77ef316 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:29.494773 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252f88f-aa9b-4934-b267-23bba77ef316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:29.496196 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252f88f-aa9b-4934-b267-23bba77ef316 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:29.507292 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1377/2778] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:52:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:52:38.283403 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=74 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:52:39.502234 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=6 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:09.092331 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446a958-c685-4f8b-aa57-9a47a5d6dd76 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:09.094190 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f446a958-c685-4f8b-aa57-9a47a5d6dd76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:09.123183 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446a958-c685-4f8b-aa57-9a47a5d6dd76 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:09.131744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18e354-72f7-4173-86ba-6857891a564c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:09.132533 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18e354-72f7-4173-86ba-6857891a564c service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:09.132832 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18e354-72f7-4173-86ba-6857891a564c service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:09.133105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18e354-72f7-4173-86ba-6857891a564c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:09.135154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6d18e354-72f7-4173-86ba-6857891a564c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:09.150948 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18e354-72f7-4173-86ba-6857891a564c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:09.152639 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18e354-72f7-4173-86ba-6857891a564c service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:09.164690 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1402/2779] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:53:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:12.441598 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c2030-54ae-4521-b007-4b1a4bd74ada None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:12.442138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c2030-54ae-4521-b007-4b1a4bd74ada None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:12.442138 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c2030-54ae-4521-b007-4b1a4bd74ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:12.459377 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f48c2030-54ae-4521-b007-4b1a4bd74ada None None] MFA Rules not processed for user `2d4104cb17d645a5bc766a15f863fbdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:12.460560 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f48c2030-54ae-4521-b007-4b1a4bd74ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:12.516473 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1378/2780] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:53:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:13.112762 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18e354-72f7-4173-86ba-6857891a564c service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:13.114257 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6d18e354-72f7-4173-86ba-6857891a564c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:13.185965 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18e354-72f7-4173-86ba-6857891a564c service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:13.191147 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8caa4c-41e6-4e0c-b8f9-c40485bd8c19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ffef7640dd1487ab2ea91fc0f4be9e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:13.191803 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8caa4c-41e6-4e0c-b8f9-c40485bd8c19 service placement] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:13.192094 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8caa4c-41e6-4e0c-b8f9-c40485bd8c19 service placement] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:13.192379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8caa4c-41e6-4e0c-b8f9-c40485bd8c19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:13.194165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0a8caa4c-41e6-4e0c-b8f9-c40485bd8c19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:13.205517 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8caa4c-41e6-4e0c-b8f9-c40485bd8c19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:13.207656 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8caa4c-41e6-4e0c-b8f9-c40485bd8c19 service placement] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:13.218418 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1403/2781] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:53:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:15.034358 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c2030-54ae-4521-b007-4b1a4bd74ada None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:15.044723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c2030-54ae-4521-b007-4b1a4bd74ada None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:15.048486 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1ca38-4b3f-46c1-97be-65d190520a64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:15.049239 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1ca38-4b3f-46c1-97be-65d190520a64 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:15.049593 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1ca38-4b3f-46c1-97be-65d190520a64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:15.049935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1ca38-4b3f-46c1-97be-65d190520a64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:15.051991 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-03a1ca38-4b3f-46c1-97be-65d190520a64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:15.062917 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1ca38-4b3f-46c1-97be-65d190520a64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:15.064510 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1ca38-4b3f-46c1-97be-65d190520a64 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:15.073850 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1379/2782] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:53:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:20.945661 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8caa4c-41e6-4e0c-b8f9-c40485bd8c19 service placement] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:20.960616 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8caa4c-41e6-4e0c-b8f9-c40485bd8c19 service placement] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:20.967014 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05516e5b-2e8e-43b6-a787-a141ed3d57cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:20.967684 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05516e5b-2e8e-43b6-a787-a141ed3d57cf service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:20.967974 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05516e5b-2e8e-43b6-a787-a141ed3d57cf service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:20.968273 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05516e5b-2e8e-43b6-a787-a141ed3d57cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:20.970119 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-05516e5b-2e8e-43b6-a787-a141ed3d57cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:20.983664 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05516e5b-2e8e-43b6-a787-a141ed3d57cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:20.985270 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05516e5b-2e8e-43b6-a787-a141ed3d57cf service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:20.996970 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1404/2783] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:53:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:25.069867 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=31 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:30.991797 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=44 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:20.339670 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1ca38-4b3f-46c1-97be-65d190520a64 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:20.396382 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1ca38-4b3f-46c1-97be-65d190520a64 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:20.402365 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81515cd7-dfe1-4e85-a015-e487a5906e88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ffef7640dd1487ab2ea91fc0f4be9e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:20.403068 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81515cd7-dfe1-4e85-a015-e487a5906e88 service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:20.403363 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81515cd7-dfe1-4e85-a015-e487a5906e88 service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:20.403691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81515cd7-dfe1-4e85-a015-e487a5906e88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:20.405820 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-81515cd7-dfe1-4e85-a015-e487a5906e88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:20.425177 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05516e5b-2e8e-43b6-a787-a141ed3d57cf service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:20.427369 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-05516e5b-2e8e-43b6-a787-a141ed3d57cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:20.443079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81515cd7-dfe1-4e85-a015-e487a5906e88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:20.444852 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81515cd7-dfe1-4e85-a015-e487a5906e88 service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:20.455330 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1380/2784] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:54:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:20.582823 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05516e5b-2e8e-43b6-a787-a141ed3d57cf service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:20.588098 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911ba96-9712-4213-a7e5-291e373f4e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:20.588983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911ba96-9712-4213-a7e5-291e373f4e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:20.589270 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911ba96-9712-4213-a7e5-291e373f4e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:20.589554 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911ba96-9712-4213-a7e5-291e373f4e7f admin admin] PATH_INFO: `/v3/users/2d4104cb17d645a5bc766a15f863fbdd` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:20.590884 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911ba96-9712-4213-a7e5-291e373f4e7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4104cb17d645a5bc766a15f863fbdd)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:20.592781 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911ba96-9712-4213-a7e5-291e373f4e7f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:20.640830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2911ba96-9712-4213-a7e5-291e373f4e7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4104cb17d645a5bc766a15f863fbdd'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:20.653268 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2911ba96-9712-4213-a7e5-291e373f4e7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4104cb17d645a5bc766a15f863fbdd'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:20.654010 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2911ba96-9712-4213-a7e5-291e373f4e7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4104cb17d645a5bc766a15f863fbdd'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:20.661989 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2911ba96-9712-4213-a7e5-291e373f4e7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4104cb17d645a5bc766a15f863fbdd'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:20.662658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2911ba96-9712-4213-a7e5-291e373f4e7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4104cb17d645a5bc766a15f863fbdd'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:20.676549 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1405/2785] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:54:20 2022] DELETE /identity/v3/users/2d4104cb17d645a5bc766a15f863fbdd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:20.852570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81515cd7-dfe1-4e85-a015-e487a5906e88 service placement] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:20.863698 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81515cd7-dfe1-4e85-a015-e487a5906e88 service placement] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:20.923803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320da4a-3a6b-46bd-abe7-057dce7d890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:20.924680 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320da4a-3a6b-46bd-abe7-057dce7d890e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:20.924970 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320da4a-3a6b-46bd-abe7-057dce7d890e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:20.925250 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320da4a-3a6b-46bd-abe7-057dce7d890e admin admin] PATH_INFO: `/v3/projects/4cb9553124384391a6d901dc791071ea` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:20.926426 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320da4a-3a6b-46bd-abe7-057dce7d890e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb9553124384391a6d901dc791071ea)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:20.928373 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320da4a-3a6b-46bd-abe7-057dce7d890e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:20.976841 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4320da4a-3a6b-46bd-abe7-057dce7d890e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb9553124384391a6d901dc791071ea', 'request_id': 'req-4320da4a-3a6b-46bd-abe7-057dce7d890e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:20.984878 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4320da4a-3a6b-46bd-abe7-057dce7d890e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb9553124384391a6d901dc791071ea', 'request_id': 'req-4320da4a-3a6b-46bd-abe7-057dce7d890e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:20.991386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4320da4a-3a6b-46bd-abe7-057dce7d890e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb9553124384391a6d901dc791071ea', 'request_id': 'req-4320da4a-3a6b-46bd-abe7-057dce7d890e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:21.002115 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4320da4a-3a6b-46bd-abe7-057dce7d890e admin admin] The token cache is being invalidate because project 4cb9553124384391a6d901dc791071ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:21.002401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4320da4a-3a6b-46bd-abe7-057dce7d890e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:21.003097 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4320da4a-3a6b-46bd-abe7-057dce7d890e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:21.004647 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1381/2786] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:54:20 2022] DELETE /identity/v3/projects/4cb9553124384391a6d901dc791071ea => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:54:21.009667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7cc3d-ba1b-4bcc-a822-92279dc944d3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:21.009955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7cc3d-ba1b-4bcc-a822-92279dc944d3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:21.010263 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7cc3d-ba1b-4bcc-a822-92279dc944d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:21.038718 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:21.059859 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d5e7cc3d-ba1b-4bcc-a822-92279dc944d3 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:21.061082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d5e7cc3d-ba1b-4bcc-a822-92279dc944d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:21.120632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1406/2787] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:21.128255 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616266d5-e473-4c7c-a0bd-99e2c4c65a79 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:21.128607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616266d5-e473-4c7c-a0bd-99e2c4c65a79 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:21.128900 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616266d5-e473-4c7c-a0bd-99e2c4c65a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:21.147354 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-616266d5-e473-4c7c-a0bd-99e2c4c65a79 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:21.148545 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-616266d5-e473-4c7c-a0bd-99e2c4c65a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:21.156912 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1382/2788] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:21.161640 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7cc3d-ba1b-4bcc-a822-92279dc944d3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:21.171286 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7cc3d-ba1b-4bcc-a822-92279dc944d3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:21.176520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381568c3-6391-46cf-be18-f494d3d5bcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:21.177180 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381568c3-6391-46cf-be18-f494d3d5bcb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:21.177476 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381568c3-6391-46cf-be18-f494d3d5bcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:21.177755 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381568c3-6391-46cf-be18-f494d3d5bcb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:21.178482 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381568c3-6391-46cf-be18-f494d3d5bcb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:54:21.178833 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381568c3-6391-46cf-be18-f494d3d5bcb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:21.180437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381568c3-6391-46cf-be18-f494d3d5bcb0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:21.191858 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1407/2789] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:54:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:54:21.196248 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616266d5-e473-4c7c-a0bd-99e2c4c65a79 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:21.205692 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616266d5-e473-4c7c-a0bd-99e2c4c65a79 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:21.210351 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33f60a-e4e8-4c16-8b8d-8b588dd9591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:21.211050 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33f60a-e4e8-4c16-8b8d-8b588dd9591b admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:21.211339 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33f60a-e4e8-4c16-8b8d-8b588dd9591b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:21.211621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33f60a-e4e8-4c16-8b8d-8b588dd9591b admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:21.212307 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33f60a-e4e8-4c16-8b8d-8b588dd9591b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:21.214218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33f60a-e4e8-4c16-8b8d-8b588dd9591b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:21.236912 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:21.244774 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1383/2790] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:54:21 2022] POST /identity/v3/projects => generated 374 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:21.248697 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381568c3-6391-46cf-be18-f494d3d5bcb0 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:21.258904 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381568c3-6391-46cf-be18-f494d3d5bcb0 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:21.315159 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3829b7-226c-47bb-b142-6b9aeadc8283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:21.315744 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3829b7-226c-47bb-b142-6b9aeadc8283 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:21.316028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3829b7-226c-47bb-b142-6b9aeadc8283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:21.316304 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3829b7-226c-47bb-b142-6b9aeadc8283 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:21.316997 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3829b7-226c-47bb-b142-6b9aeadc8283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:21.318923 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3829b7-226c-47bb-b142-6b9aeadc8283 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:21.338497 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1408/2791] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:54:21 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:54:21.342684 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33f60a-e4e8-4c16-8b8d-8b588dd9591b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:21.353529 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33f60a-e4e8-4c16-8b8d-8b588dd9591b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:21.358830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780b496-ee58-424c-ab76-0183a3596a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:21.359508 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780b496-ee58-424c-ab76-0183a3596a0a admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:21.359796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780b496-ee58-424c-ab76-0183a3596a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:21.360095 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780b496-ee58-424c-ab76-0183a3596a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:21.361540 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780b496-ee58-424c-ab76-0183a3596a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:21.363211 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780b496-ee58-424c-ab76-0183a3596a0a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:21.374599 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1384/2792] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:21 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:21.379152 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3829b7-226c-47bb-b142-6b9aeadc8283 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:21.389282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3829b7-226c-47bb-b142-6b9aeadc8283 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:21.393877 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca741e-b873-4e75-92e3-542a430536a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:21.394531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca741e-b873-4e75-92e3-542a430536a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:21.394849 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca741e-b873-4e75-92e3-542a430536a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:21.395127 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca741e-b873-4e75-92e3-542a430536a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:21.395854 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca741e-b873-4e75-92e3-542a430536a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:21.397454 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca741e-b873-4e75-92e3-542a430536a3 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:21.408248 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1409/2793] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:21 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:21.412287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780b496-ee58-424c-ab76-0183a3596a0a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:21.422106 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780b496-ee58-424c-ab76-0183a3596a0a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:21.427323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f0df1-85e4-46ec-a7e1-299c1f684e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:21.428204 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f0df1-85e4-46ec-a7e1-299c1f684e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:21.428492 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f0df1-85e4-46ec-a7e1-299c1f684e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:21.428815 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f0df1-85e4-46ec-a7e1-299c1f684e3d admin admin] PATH_INFO: `/v3/projects/e5d393f7491f4ccba5a6658f7db838f7/users/3875eba69eed4a39a8f51ea34f72d6c1/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:21.443435 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f0df1-85e4-46ec-a7e1-299c1f684e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d393f7491f4ccba5a6658f7db838f7, user_id=3875eba69eed4a39a8f51ea34f72d6c1, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:21.446080 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f0df1-85e4-46ec-a7e1-299c1f684e3d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:21.460201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1385/2794] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:54:21 2022] PUT /identity/v3/projects/e5d393f7491f4ccba5a6658f7db838f7/users/3875eba69eed4a39a8f51ea34f72d6c1/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:21.471661 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af5653-f33e-4124-9553-bef0b12be223 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:21.472176 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af5653-f33e-4124-9553-bef0b12be223 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:21.472313 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af5653-f33e-4124-9553-bef0b12be223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:21.500365 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-21af5653-f33e-4124-9553-bef0b12be223 None None] MFA Rules not processed for user `3875eba69eed4a39a8f51ea34f72d6c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:21.502124 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-21af5653-f33e-4124-9553-bef0b12be223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:21.547897 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:21.566884 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1410/2795] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:21.577765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f0df1-85e4-46ec-a7e1-299c1f684e3d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:21.579471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ea5f0df1-85e4-46ec-a7e1-299c1f684e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:21.652809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f0df1-85e4-46ec-a7e1-299c1f684e3d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:21.658316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e3315-f69c-4736-b75b-b623b5a85501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0043a7d5877f41de905afe6bef355867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:21.658992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e3315-f69c-4736-b75b-b623b5a85501 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:21.659279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e3315-f69c-4736-b75b-b623b5a85501 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:21.659626 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e3315-f69c-4736-b75b-b623b5a85501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:21.667458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e3315-f69c-4736-b75b-b623b5a85501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:21.669035 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e3315-f69c-4736-b75b-b623b5a85501 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:21.678790 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1386/2796] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:54:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:24.353309 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af5653-f33e-4124-9553-bef0b12be223 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:24.414708 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af5653-f33e-4124-9553-bef0b12be223 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:24.419132 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac36319-2237-4c41-9f0e-1f8cc1438f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:24.419998 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac36319-2237-4c41-9f0e-1f8cc1438f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:24.420282 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac36319-2237-4c41-9f0e-1f8cc1438f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:24.420560 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac36319-2237-4c41-9f0e-1f8cc1438f21 admin admin] PATH_INFO: `/v3/users/3875eba69eed4a39a8f51ea34f72d6c1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:24.421727 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac36319-2237-4c41-9f0e-1f8cc1438f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3875eba69eed4a39a8f51ea34f72d6c1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:24.424181 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac36319-2237-4c41-9f0e-1f8cc1438f21 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:24.471252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0ac36319-2237-4c41-9f0e-1f8cc1438f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3875eba69eed4a39a8f51ea34f72d6c1'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:24.483514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0ac36319-2237-4c41-9f0e-1f8cc1438f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3875eba69eed4a39a8f51ea34f72d6c1'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:24.484199 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0ac36319-2237-4c41-9f0e-1f8cc1438f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3875eba69eed4a39a8f51ea34f72d6c1'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:24.491478 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0ac36319-2237-4c41-9f0e-1f8cc1438f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3875eba69eed4a39a8f51ea34f72d6c1'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:24.492144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0ac36319-2237-4c41-9f0e-1f8cc1438f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3875eba69eed4a39a8f51ea34f72d6c1'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:24.504165 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1411/2797] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:54:24 2022] DELETE /identity/v3/users/3875eba69eed4a39a8f51ea34f72d6c1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:24.509185 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e65e55-400d-4cd6-b351-52d2d182f870 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:24.509723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e65e55-400d-4cd6-b351-52d2d182f870 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:24.509723 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e65e55-400d-4cd6-b351-52d2d182f870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:24.528186 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f4e65e55-400d-4cd6-b351-52d2d182f870 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:24.529397 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f4e65e55-400d-4cd6-b351-52d2d182f870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:24.588940 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1387/2798] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:24.599216 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac36319-2237-4c41-9f0e-1f8cc1438f21 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:24.600654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0ac36319-2237-4c41-9f0e-1f8cc1438f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:24.679138 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac36319-2237-4c41-9f0e-1f8cc1438f21 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:24.682825 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da5c62-a60e-4963-b86f-ed0625e11d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:24.683468 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da5c62-a60e-4963-b86f-ed0625e11d67 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:24.683750 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da5c62-a60e-4963-b86f-ed0625e11d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:24.684025 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da5c62-a60e-4963-b86f-ed0625e11d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:24.690039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:24.694820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da5c62-a60e-4963-b86f-ed0625e11d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:24.696748 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da5c62-a60e-4963-b86f-ed0625e11d67 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:24.707346 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1412/2799] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:54:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:24.989621 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e65e55-400d-4cd6-b351-52d2d182f870 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:24.991085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f4e65e55-400d-4cd6-b351-52d2d182f870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:25.005853 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e65e55-400d-4cd6-b351-52d2d182f870 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:25.011314 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45aaef5-b7ce-4628-8e9c-c97f835a457c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:25.012286 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45aaef5-b7ce-4628-8e9c-c97f835a457c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:25.012574 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45aaef5-b7ce-4628-8e9c-c97f835a457c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:25.012854 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45aaef5-b7ce-4628-8e9c-c97f835a457c admin admin] PATH_INFO: `/v3/projects/e5d393f7491f4ccba5a6658f7db838f7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:25.014063 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45aaef5-b7ce-4628-8e9c-c97f835a457c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d393f7491f4ccba5a6658f7db838f7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:25.016201 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45aaef5-b7ce-4628-8e9c-c97f835a457c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:25.063847 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:25.067526 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c45aaef5-b7ce-4628-8e9c-c97f835a457c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d393f7491f4ccba5a6658f7db838f7', 'request_id': 'req-c45aaef5-b7ce-4628-8e9c-c97f835a457c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:25.075799 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c45aaef5-b7ce-4628-8e9c-c97f835a457c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d393f7491f4ccba5a6658f7db838f7', 'request_id': 'req-c45aaef5-b7ce-4628-8e9c-c97f835a457c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:25.083485 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c45aaef5-b7ce-4628-8e9c-c97f835a457c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d393f7491f4ccba5a6658f7db838f7', 'request_id': 'req-c45aaef5-b7ce-4628-8e9c-c97f835a457c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:25.094280 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c45aaef5-b7ce-4628-8e9c-c97f835a457c admin admin] The token cache is being invalidate because project e5d393f7491f4ccba5a6658f7db838f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:25.094583 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c45aaef5-b7ce-4628-8e9c-c97f835a457c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:25.095234 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c45aaef5-b7ce-4628-8e9c-c97f835a457c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:25.096785 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1388/2800] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:54:24 2022] DELETE /identity/v3/projects/e5d393f7491f4ccba5a6658f7db838f7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:25.101645 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c707ae-57c3-4b31-b165-0767d7e07769 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:25.104735 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c707ae-57c3-4b31-b165-0767d7e07769 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:25.105070 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c707ae-57c3-4b31-b165-0767d7e07769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:25.137698 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-15c707ae-57c3-4b31-b165-0767d7e07769 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:25.138948 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-15c707ae-57c3-4b31-b165-0767d7e07769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:25.198887 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1413/2801] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:25.207195 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3e52c-465b-4eb4-a8ca-7e4f734ba0b1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:25.207544 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3e52c-465b-4eb4-a8ca-7e4f734ba0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:25.207830 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3e52c-465b-4eb4-a8ca-7e4f734ba0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:25.227243 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b6e3e52c-465b-4eb4-a8ca-7e4f734ba0b1 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:25.228459 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b6e3e52c-465b-4eb4-a8ca-7e4f734ba0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:25.237142 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1389/2802] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:25.241367 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c707ae-57c3-4b31-b165-0767d7e07769 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:25.251385 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c707ae-57c3-4b31-b165-0767d7e07769 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:25.256639 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475be35-4ea7-4737-beaf-e2b02b9ac6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:25.257492 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475be35-4ea7-4737-beaf-e2b02b9ac6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:25.257634 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475be35-4ea7-4737-beaf-e2b02b9ac6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:25.257853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475be35-4ea7-4737-beaf-e2b02b9ac6c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:25.258599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475be35-4ea7-4737-beaf-e2b02b9ac6c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:54:25.259049 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475be35-4ea7-4737-beaf-e2b02b9ac6c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:25.260648 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475be35-4ea7-4737-beaf-e2b02b9ac6c4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:25.272181 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1414/2803] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:54:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:54:25.276446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3e52c-465b-4eb4-a8ca-7e4f734ba0b1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:25.285958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3e52c-465b-4eb4-a8ca-7e4f734ba0b1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:25.290657 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c4b72-2c0b-4600-9a40-e2bfc9ac8ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:25.291338 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c4b72-2c0b-4600-9a40-e2bfc9ac8ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:25.291625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c4b72-2c0b-4600-9a40-e2bfc9ac8ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:25.291959 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c4b72-2c0b-4600-9a40-e2bfc9ac8ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:25.292606 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c4b72-2c0b-4600-9a40-e2bfc9ac8ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:25.294519 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c4b72-2c0b-4600-9a40-e2bfc9ac8ff5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:25.320432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1390/2804] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:54:25 2022] POST /identity/v3/projects => generated 382 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:25.324602 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475be35-4ea7-4737-beaf-e2b02b9ac6c4 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:25.334739 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475be35-4ea7-4737-beaf-e2b02b9ac6c4 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:25.393433 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3463a-32c7-4765-a237-448a08660e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:25.394109 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3463a-32c7-4765-a237-448a08660e0a admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:25.394400 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3463a-32c7-4765-a237-448a08660e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:25.394725 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3463a-32c7-4765-a237-448a08660e0a admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:25.395430 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3463a-32c7-4765-a237-448a08660e0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:25.397354 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3463a-32c7-4765-a237-448a08660e0a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:25.418463 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1415/2805] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:54:25 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:25.422350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c4b72-2c0b-4600-9a40-e2bfc9ac8ff5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:25.433131 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c4b72-2c0b-4600-9a40-e2bfc9ac8ff5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:25.437743 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efda6ec-5ce1-4084-85ca-ad43f14f2799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:25.438407 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efda6ec-5ce1-4084-85ca-ad43f14f2799 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:25.438734 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efda6ec-5ce1-4084-85ca-ad43f14f2799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:25.439017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efda6ec-5ce1-4084-85ca-ad43f14f2799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:25.440367 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efda6ec-5ce1-4084-85ca-ad43f14f2799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:25.441950 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efda6ec-5ce1-4084-85ca-ad43f14f2799 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:25.452471 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1391/2806] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:25 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:25.456419 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3463a-32c7-4765-a237-448a08660e0a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:25.466269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3463a-32c7-4765-a237-448a08660e0a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:25.470922 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f7feb-9379-4c91-880e-6b2c1d84ef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:25.471581 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f7feb-9379-4c91-880e-6b2c1d84ef5b admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:25.471867 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f7feb-9379-4c91-880e-6b2c1d84ef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:25.472143 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f7feb-9379-4c91-880e-6b2c1d84ef5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:25.472863 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f7feb-9379-4c91-880e-6b2c1d84ef5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:25.474439 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f7feb-9379-4c91-880e-6b2c1d84ef5b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:25.485020 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1416/2807] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:25 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:25.490141 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efda6ec-5ce1-4084-85ca-ad43f14f2799 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:25.500033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efda6ec-5ce1-4084-85ca-ad43f14f2799 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:25.505401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c6dc3-ed99-48c8-9cfe-f494e0c65990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:25.506321 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c6dc3-ed99-48c8-9cfe-f494e0c65990 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:25.506639 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c6dc3-ed99-48c8-9cfe-f494e0c65990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:25.506923 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c6dc3-ed99-48c8-9cfe-f494e0c65990 admin admin] PATH_INFO: `/v3/projects/02f7c64bbc124458a0cbcf85ca6c851d/users/4ec09f5045094bb58aa485fa0185117f/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:25.522663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c6dc3-ed99-48c8-9cfe-f494e0c65990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02f7c64bbc124458a0cbcf85ca6c851d, user_id=4ec09f5045094bb58aa485fa0185117f, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:25.525902 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c6dc3-ed99-48c8-9cfe-f494e0c65990 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:25.538558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1392/2808] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:54:25 2022] PUT /identity/v3/projects/02f7c64bbc124458a0cbcf85ca6c851d/users/4ec09f5045094bb58aa485fa0185117f/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:25.549245 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5fa46-c643-4415-af8f-b9e74a1de9c3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:25.549537 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5fa46-c643-4415-af8f-b9e74a1de9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:25.549818 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5fa46-c643-4415-af8f-b9e74a1de9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:25.576674 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-90e5fa46-c643-4415-af8f-b9e74a1de9c3 None None] MFA Rules not processed for user `4ec09f5045094bb58aa485fa0185117f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:25.578023 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-90e5fa46-c643-4415-af8f-b9e74a1de9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:25.618945 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:25.644074 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1417/2809] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:25.648786 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c6dc3-ed99-48c8-9cfe-f494e0c65990 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:25.709230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c6dc3-ed99-48c8-9cfe-f494e0c65990 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:25.714297 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70876351-d6b2-4c2b-a7a1-b1885475e733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:25.714994 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70876351-d6b2-4c2b-a7a1-b1885475e733 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:25.715281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70876351-d6b2-4c2b-a7a1-b1885475e733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:25.715559 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70876351-d6b2-4c2b-a7a1-b1885475e733 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:25.716261 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70876351-d6b2-4c2b-a7a1-b1885475e733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:25.718154 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70876351-d6b2-4c2b-a7a1-b1885475e733 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:25.744728 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1393/2810] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:54:25 2022] POST /identity/v3/projects => generated 380 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:54:25.748556 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5fa46-c643-4415-af8f-b9e74a1de9c3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:25.759133 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5fa46-c643-4415-af8f-b9e74a1de9c3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:25.815293 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84907bbf-0565-4650-87a2-8a1a9353a5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:25.815968 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84907bbf-0565-4650-87a2-8a1a9353a5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:25.816258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84907bbf-0565-4650-87a2-8a1a9353a5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:25.816539 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84907bbf-0565-4650-87a2-8a1a9353a5a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:25.817242 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84907bbf-0565-4650-87a2-8a1a9353a5a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:25.819196 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84907bbf-0565-4650-87a2-8a1a9353a5a7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:25.841037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1418/2811] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:54:25 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:25.842859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70876351-d6b2-4c2b-a7a1-b1885475e733 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:25.853686 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70876351-d6b2-4c2b-a7a1-b1885475e733 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:25.858460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a04bb8-495d-4a90-ae6b-b77b562aa29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:25.859148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a04bb8-495d-4a90-ae6b-b77b562aa29a admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:25.859432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a04bb8-495d-4a90-ae6b-b77b562aa29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:25.859707 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a04bb8-495d-4a90-ae6b-b77b562aa29a admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:25.860427 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a04bb8-495d-4a90-ae6b-b77b562aa29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:25.862792 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a04bb8-495d-4a90-ae6b-b77b562aa29a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:25.873472 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1394/2812] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:25 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:25.877478 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84907bbf-0565-4650-87a2-8a1a9353a5a7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:25.887691 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84907bbf-0565-4650-87a2-8a1a9353a5a7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:25.892368 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d8752-b708-4710-a2b1-f1e9430eb5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:25.893255 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d8752-b708-4710-a2b1-f1e9430eb5a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:25.893542 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d8752-b708-4710-a2b1-f1e9430eb5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:25.893823 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d8752-b708-4710-a2b1-f1e9430eb5a4 admin admin] PATH_INFO: `/v3/projects/5b2b51e52a86492082ba760cdafdc230/users/f7ab2c3db0ce47179f4cc74c2c1a23ef/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:25.909166 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d8752-b708-4710-a2b1-f1e9430eb5a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2b51e52a86492082ba760cdafdc230, user_id=f7ab2c3db0ce47179f4cc74c2c1a23ef, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:25.911955 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d8752-b708-4710-a2b1-f1e9430eb5a4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:25.925441 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1419/2813] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:54:25 2022] PUT /identity/v3/projects/5b2b51e52a86492082ba760cdafdc230/users/f7ab2c3db0ce47179f4cc74c2c1a23ef/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:54:25.929453 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a04bb8-495d-4a90-ae6b-b77b562aa29a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:25.939482 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a04bb8-495d-4a90-ae6b-b77b562aa29a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:25.981064 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:25.999178 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd40482-e642-4318-802c-286969ecb0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:25.999793 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd40482-e642-4318-802c-286969ecb0be admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:26.000078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd40482-e642-4318-802c-286969ecb0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:26.000357 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd40482-e642-4318-802c-286969ecb0be admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:26.001109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd40482-e642-4318-802c-286969ecb0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:26.003302 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd40482-e642-4318-802c-286969ecb0be admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:26.014358 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1395/2814] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:25 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:26.018659 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d8752-b708-4710-a2b1-f1e9430eb5a4 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:26.028877 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d8752-b708-4710-a2b1-f1e9430eb5a4 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:26.033435 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abea49-dcb7-444f-9a0d-8971ac8b1957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:26.034297 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abea49-dcb7-444f-9a0d-8971ac8b1957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:26.034609 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abea49-dcb7-444f-9a0d-8971ac8b1957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:26.034894 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abea49-dcb7-444f-9a0d-8971ac8b1957 admin admin] PATH_INFO: `/v3/projects/5b2b51e52a86492082ba760cdafdc230/users/f7ab2c3db0ce47179f4cc74c2c1a23ef/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:26.036860 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abea49-dcb7-444f-9a0d-8971ac8b1957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2b51e52a86492082ba760cdafdc230, user_id=f7ab2c3db0ce47179f4cc74c2c1a23ef, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:26.039639 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abea49-dcb7-444f-9a0d-8971ac8b1957 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:26.051725 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1420/2815] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:54:26 2022] PUT /identity/v3/projects/5b2b51e52a86492082ba760cdafdc230/users/f7ab2c3db0ce47179f4cc74c2c1a23ef/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:26.063167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aabea6-5c4b-44e8-8d2e-0c87bba22aa3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:26.063460 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aabea6-5c4b-44e8-8d2e-0c87bba22aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:26.063740 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aabea6-5c4b-44e8-8d2e-0c87bba22aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:26.093000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d5aabea6-5c4b-44e8-8d2e-0c87bba22aa3 None None] MFA Rules not processed for user `f7ab2c3db0ce47179f4cc74c2c1a23ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:26.094210 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d5aabea6-5c4b-44e8-8d2e-0c87bba22aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:26.163706 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1396/2816] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:26.175460 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abea49-dcb7-444f-9a0d-8971ac8b1957 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:26.177230 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c0abea49-dcb7-444f-9a0d-8971ac8b1957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:26.234901 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abea49-dcb7-444f-9a0d-8971ac8b1957 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:26.239145 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8eb9c-45ee-4fb9-b940-bbc68f4b3941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:26.239770 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8eb9c-45ee-4fb9-b940-bbc68f4b3941 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:26.240060 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8eb9c-45ee-4fb9-b940-bbc68f4b3941 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:26.240345 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8eb9c-45ee-4fb9-b940-bbc68f4b3941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:26.249443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8eb9c-45ee-4fb9-b940-bbc68f4b3941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:26.250975 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8eb9c-45ee-4fb9-b940-bbc68f4b3941 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:26.260793 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1421/2817] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:54:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:26.333154 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aabea6-5c4b-44e8-8d2e-0c87bba22aa3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:26.343058 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aabea6-5c4b-44e8-8d2e-0c87bba22aa3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:26.347287 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706feb55-3d20-4806-a61b-2ce2ca8f7c79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:26.347933 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706feb55-3d20-4806-a61b-2ce2ca8f7c79 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:26.348221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706feb55-3d20-4806-a61b-2ce2ca8f7c79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:26.348501 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706feb55-3d20-4806-a61b-2ce2ca8f7c79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:26.406719 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706feb55-3d20-4806-a61b-2ce2ca8f7c79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:26.408701 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706feb55-3d20-4806-a61b-2ce2ca8f7c79 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:26.417726 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1397/2818] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:54:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:32.284529 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8eb9c-45ee-4fb9-b940-bbc68f4b3941 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:32.323594 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:32.347231 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8eb9c-45ee-4fb9-b940-bbc68f4b3941 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:32.352254 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe49d1-16c2-4dc1-95ac-9147277816b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:32.353135 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe49d1-16c2-4dc1-95ac-9147277816b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:32.353421 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe49d1-16c2-4dc1-95ac-9147277816b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:32.353702 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe49d1-16c2-4dc1-95ac-9147277816b9 admin admin] PATH_INFO: `/v3/users/4ec09f5045094bb58aa485fa0185117f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:32.354911 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe49d1-16c2-4dc1-95ac-9147277816b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ec09f5045094bb58aa485fa0185117f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:32.356869 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe49d1-16c2-4dc1-95ac-9147277816b9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:32.405973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4bfe49d1-16c2-4dc1-95ac-9147277816b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ec09f5045094bb58aa485fa0185117f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:32.418271 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4bfe49d1-16c2-4dc1-95ac-9147277816b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ec09f5045094bb58aa485fa0185117f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:32.418954 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4bfe49d1-16c2-4dc1-95ac-9147277816b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ec09f5045094bb58aa485fa0185117f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:32.426448 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4bfe49d1-16c2-4dc1-95ac-9147277816b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ec09f5045094bb58aa485fa0185117f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:32.427946 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4bfe49d1-16c2-4dc1-95ac-9147277816b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ec09f5045094bb58aa485fa0185117f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:32.440513 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1422/2819] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:54:32 2022] DELETE /identity/v3/users/4ec09f5045094bb58aa485fa0185117f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:54:32.445327 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4f1ff-75a5-4562-b5d4-377823a31078 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:32.445846 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4f1ff-75a5-4562-b5d4-377823a31078 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:32.445981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4f1ff-75a5-4562-b5d4-377823a31078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:32.463400 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-16c4f1ff-75a5-4562-b5d4-377823a31078 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:32.464607 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-16c4f1ff-75a5-4562-b5d4-377823a31078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:32.523261 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1398/2820] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:32.532825 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe49d1-16c2-4dc1-95ac-9147277816b9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:32.534228 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4bfe49d1-16c2-4dc1-95ac-9147277816b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:32.592068 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe49d1-16c2-4dc1-95ac-9147277816b9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:32.595813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfff9e-70dd-4c7a-b6ca-85e3f251c1dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:32.596471 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfff9e-70dd-4c7a-b6ca-85e3f251c1dd service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:32.596764 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfff9e-70dd-4c7a-b6ca-85e3f251c1dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:32.597047 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfff9e-70dd-4c7a-b6ca-85e3f251c1dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:32.607242 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfff9e-70dd-4c7a-b6ca-85e3f251c1dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:32.609038 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfff9e-70dd-4c7a-b6ca-85e3f251c1dd service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:32.619611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1423/2821] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:32.886806 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4f1ff-75a5-4562-b5d4-377823a31078 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:32.888293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-16c4f1ff-75a5-4562-b5d4-377823a31078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:32.897321 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:32.901859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4f1ff-75a5-4562-b5d4-377823a31078 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:32.907094 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38215bf-dc88-4faa-a523-0f6681bf8764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:32.907974 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38215bf-dc88-4faa-a523-0f6681bf8764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:32.908261 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38215bf-dc88-4faa-a523-0f6681bf8764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:32.908539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38215bf-dc88-4faa-a523-0f6681bf8764 admin admin] PATH_INFO: `/v3/projects/02f7c64bbc124458a0cbcf85ca6c851d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:32.909769 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38215bf-dc88-4faa-a523-0f6681bf8764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02f7c64bbc124458a0cbcf85ca6c851d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:32.912360 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38215bf-dc88-4faa-a523-0f6681bf8764 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:32.959773 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d38215bf-dc88-4faa-a523-0f6681bf8764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02f7c64bbc124458a0cbcf85ca6c851d', 'request_id': 'req-d38215bf-dc88-4faa-a523-0f6681bf8764'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:32.967148 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d38215bf-dc88-4faa-a523-0f6681bf8764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02f7c64bbc124458a0cbcf85ca6c851d', 'request_id': 'req-d38215bf-dc88-4faa-a523-0f6681bf8764'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:32.973323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d38215bf-dc88-4faa-a523-0f6681bf8764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02f7c64bbc124458a0cbcf85ca6c851d', 'request_id': 'req-d38215bf-dc88-4faa-a523-0f6681bf8764'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:32.984536 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d38215bf-dc88-4faa-a523-0f6681bf8764 admin admin] The token cache is being invalidate because project 02f7c64bbc124458a0cbcf85ca6c851d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:32.984825 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d38215bf-dc88-4faa-a523-0f6681bf8764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:32.985465 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d38215bf-dc88-4faa-a523-0f6681bf8764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:32.987075 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1399/2822] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:54:32 2022] DELETE /identity/v3/projects/02f7c64bbc124458a0cbcf85ca6c851d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:32.991608 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfff9e-70dd-4c7a-b6ca-85e3f251c1dd service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:33.001349 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfff9e-70dd-4c7a-b6ca-85e3f251c1dd service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:33.052405 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:33.059161 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d20913-1a24-4406-ba3f-6396816e967f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:33.060459 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d20913-1a24-4406-ba3f-6396816e967f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:33.060808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d20913-1a24-4406-ba3f-6396816e967f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:33.061092 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d20913-1a24-4406-ba3f-6396816e967f admin admin] PATH_INFO: `/v3/users/f7ab2c3db0ce47179f4cc74c2c1a23ef` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:33.062557 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d20913-1a24-4406-ba3f-6396816e967f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ab2c3db0ce47179f4cc74c2c1a23ef)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:33.064821 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d20913-1a24-4406-ba3f-6396816e967f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:33.112341 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-13d20913-1a24-4406-ba3f-6396816e967f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ab2c3db0ce47179f4cc74c2c1a23ef'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:33.124061 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-13d20913-1a24-4406-ba3f-6396816e967f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ab2c3db0ce47179f4cc74c2c1a23ef'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:33.124719 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-13d20913-1a24-4406-ba3f-6396816e967f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ab2c3db0ce47179f4cc74c2c1a23ef'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:33.132857 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-13d20913-1a24-4406-ba3f-6396816e967f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ab2c3db0ce47179f4cc74c2c1a23ef'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:33.133820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-13d20913-1a24-4406-ba3f-6396816e967f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ab2c3db0ce47179f4cc74c2c1a23ef'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:33.147892 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1424/2823] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:54:32 2022] DELETE /identity/v3/users/f7ab2c3db0ce47179f4cc74c2c1a23ef => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:33.441958 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38215bf-dc88-4faa-a523-0f6681bf8764 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:33.444539 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d38215bf-dc88-4faa-a523-0f6681bf8764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:33.457174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38215bf-dc88-4faa-a523-0f6681bf8764 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:33.520992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715202be-e4f1-43bd-847f-35bc6f730ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:33.521866 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715202be-e4f1-43bd-847f-35bc6f730ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:33.522149 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715202be-e4f1-43bd-847f-35bc6f730ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:33.522421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715202be-e4f1-43bd-847f-35bc6f730ffb admin admin] PATH_INFO: `/v3/projects/5b2b51e52a86492082ba760cdafdc230` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:33.523714 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715202be-e4f1-43bd-847f-35bc6f730ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2b51e52a86492082ba760cdafdc230)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:33.525646 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715202be-e4f1-43bd-847f-35bc6f730ffb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:33.580206 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-715202be-e4f1-43bd-847f-35bc6f730ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2b51e52a86492082ba760cdafdc230', 'request_id': 'req-715202be-e4f1-43bd-847f-35bc6f730ffb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:33.588073 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-715202be-e4f1-43bd-847f-35bc6f730ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2b51e52a86492082ba760cdafdc230', 'request_id': 'req-715202be-e4f1-43bd-847f-35bc6f730ffb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:33.595387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-715202be-e4f1-43bd-847f-35bc6f730ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2b51e52a86492082ba760cdafdc230', 'request_id': 'req-715202be-e4f1-43bd-847f-35bc6f730ffb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:33.606388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-715202be-e4f1-43bd-847f-35bc6f730ffb admin admin] The token cache is being invalidate because project 5b2b51e52a86492082ba760cdafdc230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:33.606702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-715202be-e4f1-43bd-847f-35bc6f730ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:33.607361 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-715202be-e4f1-43bd-847f-35bc6f730ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:33.609171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1400/2824] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:54:33 2022] DELETE /identity/v3/projects/5b2b51e52a86492082ba760cdafdc230 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:33.614860 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74e16c-6a24-40f3-a43d-61c706fa860f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:33.615378 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74e16c-6a24-40f3-a43d-61c706fa860f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:33.615813 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74e16c-6a24-40f3-a43d-61c706fa860f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:33.636226 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2a74e16c-6a24-40f3-a43d-61c706fa860f None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:33.637443 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2a74e16c-6a24-40f3-a43d-61c706fa860f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:33.701960 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1425/2825] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:33.710153 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4580d68-ee3d-416e-bffc-9507b10d8642 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:33.710617 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4580d68-ee3d-416e-bffc-9507b10d8642 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:33.710907 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4580d68-ee3d-416e-bffc-9507b10d8642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:33.730018 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c4580d68-ee3d-416e-bffc-9507b10d8642 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:33.731293 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c4580d68-ee3d-416e-bffc-9507b10d8642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:33.740467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1401/2826] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:33.745520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74e16c-6a24-40f3-a43d-61c706fa860f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:33.756906 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74e16c-6a24-40f3-a43d-61c706fa860f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:33.762037 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd4b1e-43ee-42ac-93f8-e003ab4644c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:33.762776 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd4b1e-43ee-42ac-93f8-e003ab4644c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:33.763172 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd4b1e-43ee-42ac-93f8-e003ab4644c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:33.763328 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd4b1e-43ee-42ac-93f8-e003ab4644c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:33.764040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd4b1e-43ee-42ac-93f8-e003ab4644c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:54:33.764353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd4b1e-43ee-42ac-93f8-e003ab4644c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:33.765973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd4b1e-43ee-42ac-93f8-e003ab4644c9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:33.779207 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1426/2827] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:54:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:54:33.784034 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4580d68-ee3d-416e-bffc-9507b10d8642 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:33.794324 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4580d68-ee3d-416e-bffc-9507b10d8642 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:33.799288 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2a3ae-6d47-476b-80df-68fc8f8d9215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:33.799994 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2a3ae-6d47-476b-80df-68fc8f8d9215 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:33.800281 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2a3ae-6d47-476b-80df-68fc8f8d9215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:33.800584 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2a3ae-6d47-476b-80df-68fc8f8d9215 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:33.801283 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2a3ae-6d47-476b-80df-68fc8f8d9215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:33.803888 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2a3ae-6d47-476b-80df-68fc8f8d9215 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:33.812890 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:33.832789 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1402/2828] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:54:33 2022] POST /identity/v3/projects => generated 368 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:33.837649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd4b1e-43ee-42ac-93f8-e003ab4644c9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:33.847545 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd4b1e-43ee-42ac-93f8-e003ab4644c9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:33.905327 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edb0c8-f502-49e2-bee1-a6022f75cde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:33.906003 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edb0c8-f502-49e2-bee1-a6022f75cde7 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:33.906294 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edb0c8-f502-49e2-bee1-a6022f75cde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:33.906591 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edb0c8-f502-49e2-bee1-a6022f75cde7 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:33.907292 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edb0c8-f502-49e2-bee1-a6022f75cde7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:33.909207 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edb0c8-f502-49e2-bee1-a6022f75cde7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:33.917839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:33.930993 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1427/2829] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:54:33 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:33.935049 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2a3ae-6d47-476b-80df-68fc8f8d9215 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:33.946498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2a3ae-6d47-476b-80df-68fc8f8d9215 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:33.951298 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2550a-4f38-48a0-ae27-50a351d98853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:33.952016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2550a-4f38-48a0-ae27-50a351d98853 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:33.952257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2550a-4f38-48a0-ae27-50a351d98853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:33.952538 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2550a-4f38-48a0-ae27-50a351d98853 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:33.953262 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2550a-4f38-48a0-ae27-50a351d98853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:33.954892 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2550a-4f38-48a0-ae27-50a351d98853 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:33.965649 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1403/2830] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:33 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:33.969597 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edb0c8-f502-49e2-bee1-a6022f75cde7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:33.979742 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edb0c8-f502-49e2-bee1-a6022f75cde7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:33.984667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4781f0-c036-4966-baa6-0cc58b34aeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:33.985324 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4781f0-c036-4966-baa6-0cc58b34aeda admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:33.985611 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4781f0-c036-4966-baa6-0cc58b34aeda admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:33.985894 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4781f0-c036-4966-baa6-0cc58b34aeda admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:33.986658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4781f0-c036-4966-baa6-0cc58b34aeda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:33.988287 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4781f0-c036-4966-baa6-0cc58b34aeda admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:33.998376 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1428/2831] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:33 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:34.002359 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2550a-4f38-48a0-ae27-50a351d98853 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:34.013059 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2550a-4f38-48a0-ae27-50a351d98853 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:34.017718 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe404af-6bb7-48b8-b818-e85167f27a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:34.018625 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe404af-6bb7-48b8-b818-e85167f27a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:34.018948 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe404af-6bb7-48b8-b818-e85167f27a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:34.019230 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe404af-6bb7-48b8-b818-e85167f27a50 admin admin] PATH_INFO: `/v3/projects/184181802fba4af19edb7fc413b59186/users/a8f7cf25c14a4525b6d60c8bdf0db10b/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:34.034092 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe404af-6bb7-48b8-b818-e85167f27a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=184181802fba4af19edb7fc413b59186, user_id=a8f7cf25c14a4525b6d60c8bdf0db10b, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:34.037261 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe404af-6bb7-48b8-b818-e85167f27a50 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:34.049696 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1404/2832] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:54:34 2022] PUT /identity/v3/projects/184181802fba4af19edb7fc413b59186/users/a8f7cf25c14a4525b6d60c8bdf0db10b/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:54:34.061237 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81bd61-7f2c-4d5b-bcb8-31eb8c9f6554 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:34.061531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81bd61-7f2c-4d5b-bcb8-31eb8c9f6554 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:34.061816 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81bd61-7f2c-4d5b-bcb8-31eb8c9f6554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:34.087372 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6a81bd61-7f2c-4d5b-bcb8-31eb8c9f6554 None None] MFA Rules not processed for user `a8f7cf25c14a4525b6d60c8bdf0db10b`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:34.088577 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6a81bd61-7f2c-4d5b-bcb8-31eb8c9f6554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:34.152546 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1429/2833] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:34.157029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe404af-6bb7-48b8-b818-e85167f27a50 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:34.219319 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe404af-6bb7-48b8-b818-e85167f27a50 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:34.224195 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404a1dd-bd61-47fa-9f4f-358711a1db53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:34.224859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404a1dd-bd61-47fa-9f4f-358711a1db53 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:34.225143 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404a1dd-bd61-47fa-9f4f-358711a1db53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:34.225420 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404a1dd-bd61-47fa-9f4f-358711a1db53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:34.226105 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404a1dd-bd61-47fa-9f4f-358711a1db53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:34.228022 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404a1dd-bd61-47fa-9f4f-358711a1db53 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:34.253343 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1405/2834] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:54:34 2022] POST /identity/v3/projects => generated 370 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:34.258128 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81bd61-7f2c-4d5b-bcb8-31eb8c9f6554 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:34.268613 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81bd61-7f2c-4d5b-bcb8-31eb8c9f6554 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:34.324816 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864fbf5-fffd-40ec-b53b-5f551502a3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:34.325484 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864fbf5-fffd-40ec-b53b-5f551502a3ec admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:34.325767 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864fbf5-fffd-40ec-b53b-5f551502a3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:34.326043 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864fbf5-fffd-40ec-b53b-5f551502a3ec admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:34.326772 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864fbf5-fffd-40ec-b53b-5f551502a3ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:34.328655 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864fbf5-fffd-40ec-b53b-5f551502a3ec admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:34.348125 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1430/2835] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:54:34 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:54:34.352337 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404a1dd-bd61-47fa-9f4f-358711a1db53 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:34.363589 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404a1dd-bd61-47fa-9f4f-358711a1db53 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:34.368886 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97836444-5433-4c2b-b970-503c40d0704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:34.369570 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97836444-5433-4c2b-b970-503c40d0704a admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:34.369854 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97836444-5433-4c2b-b970-503c40d0704a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:34.370135 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97836444-5433-4c2b-b970-503c40d0704a admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:34.370899 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97836444-5433-4c2b-b970-503c40d0704a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:34.372506 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97836444-5433-4c2b-b970-503c40d0704a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:34.384387 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1406/2836] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:34 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:34.388617 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864fbf5-fffd-40ec-b53b-5f551502a3ec admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:34.398711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864fbf5-fffd-40ec-b53b-5f551502a3ec admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:34.403461 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb77f9-849d-44ac-b5ad-0be744805ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:34.404343 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb77f9-849d-44ac-b5ad-0be744805ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:34.404632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb77f9-849d-44ac-b5ad-0be744805ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:34.404914 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb77f9-849d-44ac-b5ad-0be744805ad5 admin admin] PATH_INFO: `/v3/projects/4650e5bbf0d44fe09b7d1d63f55b7073/users/cceeee9eb4354c4f9198c220974a1b94/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:34.419603 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb77f9-849d-44ac-b5ad-0be744805ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4650e5bbf0d44fe09b7d1d63f55b7073, user_id=cceeee9eb4354c4f9198c220974a1b94, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:34.422246 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb77f9-849d-44ac-b5ad-0be744805ad5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:34.436312 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1431/2837] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:54:34 2022] PUT /identity/v3/projects/4650e5bbf0d44fe09b7d1d63f55b7073/users/cceeee9eb4354c4f9198c220974a1b94/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:34.440326 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97836444-5433-4c2b-b970-503c40d0704a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:34.451110 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97836444-5433-4c2b-b970-503c40d0704a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:34.510338 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb2348-e49e-4441-86fe-7b1892c911bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:34.511087 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb2348-e49e-4441-86fe-7b1892c911bd admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:34.511332 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb2348-e49e-4441-86fe-7b1892c911bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:34.511615 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb2348-e49e-4441-86fe-7b1892c911bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:34.512346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb2348-e49e-4441-86fe-7b1892c911bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:34.513943 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb2348-e49e-4441-86fe-7b1892c911bd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:34.524485 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1407/2838] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:34 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:34.528665 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb77f9-849d-44ac-b5ad-0be744805ad5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:34.539654 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb77f9-849d-44ac-b5ad-0be744805ad5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:34.544337 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548da82-cc3a-4c22-9282-0a891d2d6e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:34.545218 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548da82-cc3a-4c22-9282-0a891d2d6e1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:34.545508 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548da82-cc3a-4c22-9282-0a891d2d6e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:34.545791 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548da82-cc3a-4c22-9282-0a891d2d6e1d admin admin] PATH_INFO: `/v3/projects/4650e5bbf0d44fe09b7d1d63f55b7073/users/cceeee9eb4354c4f9198c220974a1b94/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:34.547836 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548da82-cc3a-4c22-9282-0a891d2d6e1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4650e5bbf0d44fe09b7d1d63f55b7073, user_id=cceeee9eb4354c4f9198c220974a1b94, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:34.551354 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548da82-cc3a-4c22-9282-0a891d2d6e1d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:34.562409 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1432/2839] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:54:34 2022] PUT /identity/v3/projects/4650e5bbf0d44fe09b7d1d63f55b7073/users/cceeee9eb4354c4f9198c220974a1b94/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:34.573522 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ca850-318b-431a-a728-1524c1be997d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:34.573849 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ca850-318b-431a-a728-1524c1be997d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:34.574135 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ca850-318b-431a-a728-1524c1be997d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:34.603191 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cd4ca850-318b-431a-a728-1524c1be997d None None] MFA Rules not processed for user `cceeee9eb4354c4f9198c220974a1b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:34.604411 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cd4ca850-318b-431a-a728-1524c1be997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:34.617894 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:34.688468 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1408/2840] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:34.701045 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548da82-cc3a-4c22-9282-0a891d2d6e1d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:34.702898 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4548da82-cc3a-4c22-9282-0a891d2d6e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:34.734482 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:34.765298 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548da82-cc3a-4c22-9282-0a891d2d6e1d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:34.768987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770cf17-ca8a-47bc-94c3-3ceea274031c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:34.769633 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770cf17-ca8a-47bc-94c3-3ceea274031c service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:34.769917 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770cf17-ca8a-47bc-94c3-3ceea274031c service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:34.770193 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770cf17-ca8a-47bc-94c3-3ceea274031c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:34.780017 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770cf17-ca8a-47bc-94c3-3ceea274031c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:34.781472 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770cf17-ca8a-47bc-94c3-3ceea274031c service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:34.791363 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1433/2841] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:54:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:34.842668 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ca850-318b-431a-a728-1524c1be997d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:34.844623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cd4ca850-318b-431a-a728-1524c1be997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:34.858084 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ca850-318b-431a-a728-1524c1be997d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:34.862157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ead059-f884-4a8e-b4c8-48b81c207c1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:34.862873 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ead059-f884-4a8e-b4c8-48b81c207c1d service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:34.863157 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ead059-f884-4a8e-b4c8-48b81c207c1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:34.863458 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ead059-f884-4a8e-b4c8-48b81c207c1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:34.922321 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ead059-f884-4a8e-b4c8-48b81c207c1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:34.923884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ead059-f884-4a8e-b4c8-48b81c207c1d service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:34.934829 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1409/2842] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:54:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:38.213067 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770cf17-ca8a-47bc-94c3-3ceea274031c service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:38.274205 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770cf17-ca8a-47bc-94c3-3ceea274031c service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:38.278733 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdda039-bf1c-4c9a-ad77-cdb3681b7bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:38.279605 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdda039-bf1c-4c9a-ad77-cdb3681b7bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:38.279895 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdda039-bf1c-4c9a-ad77-cdb3681b7bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:38.280173 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdda039-bf1c-4c9a-ad77-cdb3681b7bd5 admin admin] PATH_INFO: `/v3/users/a8f7cf25c14a4525b6d60c8bdf0db10b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:38.281356 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdda039-bf1c-4c9a-ad77-cdb3681b7bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8f7cf25c14a4525b6d60c8bdf0db10b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:38.283325 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdda039-bf1c-4c9a-ad77-cdb3681b7bd5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:38.328325 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2cdda039-bf1c-4c9a-ad77-cdb3681b7bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8f7cf25c14a4525b6d60c8bdf0db10b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:38.340264 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2cdda039-bf1c-4c9a-ad77-cdb3681b7bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8f7cf25c14a4525b6d60c8bdf0db10b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:38.340921 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2cdda039-bf1c-4c9a-ad77-cdb3681b7bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8f7cf25c14a4525b6d60c8bdf0db10b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:38.347988 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2cdda039-bf1c-4c9a-ad77-cdb3681b7bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8f7cf25c14a4525b6d60c8bdf0db10b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:38.348588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2cdda039-bf1c-4c9a-ad77-cdb3681b7bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8f7cf25c14a4525b6d60c8bdf0db10b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:38.361728 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1434/2843] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:54:38 2022] DELETE /identity/v3/users/a8f7cf25c14a4525b6d60c8bdf0db10b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:38.366966 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26828747-0393-43cb-adb0-7d27277f1d73 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:38.367484 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26828747-0393-43cb-adb0-7d27277f1d73 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:38.367594 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26828747-0393-43cb-adb0-7d27277f1d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:38.385915 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-26828747-0393-43cb-adb0-7d27277f1d73 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:38.387145 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-26828747-0393-43cb-adb0-7d27277f1d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:38.445180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1410/2844] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:38.455200 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdda039-bf1c-4c9a-ad77-cdb3681b7bd5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:38.456609 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2cdda039-bf1c-4c9a-ad77-cdb3681b7bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:38.512857 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:38.518876 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdda039-bf1c-4c9a-ad77-cdb3681b7bd5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:38.523102 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40981f94-ab98-4115-b19b-67d7590a703e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:38.523960 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40981f94-ab98-4115-b19b-67d7590a703e service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:38.524258 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40981f94-ab98-4115-b19b-67d7590a703e service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:38.524660 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40981f94-ab98-4115-b19b-67d7590a703e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:38.533766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40981f94-ab98-4115-b19b-67d7590a703e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:38.535260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40981f94-ab98-4115-b19b-67d7590a703e service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:38.545380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1435/2845] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:38.833840 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26828747-0393-43cb-adb0-7d27277f1d73 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:38.835542 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-26828747-0393-43cb-adb0-7d27277f1d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:38.848475 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26828747-0393-43cb-adb0-7d27277f1d73 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:38.853757 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352221fd-7814-4804-aeb2-d768090d1d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:38.854653 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352221fd-7814-4804-aeb2-d768090d1d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:38.854943 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352221fd-7814-4804-aeb2-d768090d1d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:38.855222 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352221fd-7814-4804-aeb2-d768090d1d67 admin admin] PATH_INFO: `/v3/projects/184181802fba4af19edb7fc413b59186` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:38.856462 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352221fd-7814-4804-aeb2-d768090d1d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=184181802fba4af19edb7fc413b59186)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:38.858395 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352221fd-7814-4804-aeb2-d768090d1d67 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:38.903752 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:38.907840 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-352221fd-7814-4804-aeb2-d768090d1d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '184181802fba4af19edb7fc413b59186', 'request_id': 'req-352221fd-7814-4804-aeb2-d768090d1d67'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:38.915072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-352221fd-7814-4804-aeb2-d768090d1d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '184181802fba4af19edb7fc413b59186', 'request_id': 'req-352221fd-7814-4804-aeb2-d768090d1d67'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:38.921378 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-352221fd-7814-4804-aeb2-d768090d1d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '184181802fba4af19edb7fc413b59186', 'request_id': 'req-352221fd-7814-4804-aeb2-d768090d1d67'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:38.932167 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-352221fd-7814-4804-aeb2-d768090d1d67 admin admin] The token cache is being invalidate because project 184181802fba4af19edb7fc413b59186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:38.932457 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-352221fd-7814-4804-aeb2-d768090d1d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:38.933102 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-352221fd-7814-4804-aeb2-d768090d1d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:38.934663 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1411/2846] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:54:38 2022] DELETE /identity/v3/projects/184181802fba4af19edb7fc413b59186 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:38.938561 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40981f94-ab98-4115-b19b-67d7590a703e service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:38.948908 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40981f94-ab98-4115-b19b-67d7590a703e service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:39.004096 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3ef23-9642-4f87-bfe2-c3abf953a4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:39.004972 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3ef23-9642-4f87-bfe2-c3abf953a4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:39.005260 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3ef23-9642-4f87-bfe2-c3abf953a4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:39.005634 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3ef23-9642-4f87-bfe2-c3abf953a4b5 admin admin] PATH_INFO: `/v3/users/cceeee9eb4354c4f9198c220974a1b94` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:39.007771 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3ef23-9642-4f87-bfe2-c3abf953a4b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cceeee9eb4354c4f9198c220974a1b94)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:39.009760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3ef23-9642-4f87-bfe2-c3abf953a4b5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:39.056135 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d7a3ef23-9642-4f87-bfe2-c3abf953a4b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cceeee9eb4354c4f9198c220974a1b94'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:39.067983 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d7a3ef23-9642-4f87-bfe2-c3abf953a4b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cceeee9eb4354c4f9198c220974a1b94'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:39.068664 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d7a3ef23-9642-4f87-bfe2-c3abf953a4b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cceeee9eb4354c4f9198c220974a1b94'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:39.075905 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d7a3ef23-9642-4f87-bfe2-c3abf953a4b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cceeee9eb4354c4f9198c220974a1b94'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:39.076566 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d7a3ef23-9642-4f87-bfe2-c3abf953a4b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cceeee9eb4354c4f9198c220974a1b94'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:39.088763 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1436/2847] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:54:38 2022] DELETE /identity/v3/users/cceeee9eb4354c4f9198c220974a1b94 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:39.356190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352221fd-7814-4804-aeb2-d768090d1d67 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:39.357634 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-352221fd-7814-4804-aeb2-d768090d1d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:39.371102 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352221fd-7814-4804-aeb2-d768090d1d67 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:39.430309 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06700b-8c1f-4bcc-afd4-f45757e17b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:39.431221 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06700b-8c1f-4bcc-afd4-f45757e17b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:39.431506 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06700b-8c1f-4bcc-afd4-f45757e17b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:39.431787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06700b-8c1f-4bcc-afd4-f45757e17b2a admin admin] PATH_INFO: `/v3/projects/4650e5bbf0d44fe09b7d1d63f55b7073` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:39.432976 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06700b-8c1f-4bcc-afd4-f45757e17b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4650e5bbf0d44fe09b7d1d63f55b7073)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:39.434931 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06700b-8c1f-4bcc-afd4-f45757e17b2a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:39.481914 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ab06700b-8c1f-4bcc-afd4-f45757e17b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4650e5bbf0d44fe09b7d1d63f55b7073', 'request_id': 'req-ab06700b-8c1f-4bcc-afd4-f45757e17b2a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:39.489128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ab06700b-8c1f-4bcc-afd4-f45757e17b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4650e5bbf0d44fe09b7d1d63f55b7073', 'request_id': 'req-ab06700b-8c1f-4bcc-afd4-f45757e17b2a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:39.496189 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ab06700b-8c1f-4bcc-afd4-f45757e17b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4650e5bbf0d44fe09b7d1d63f55b7073', 'request_id': 'req-ab06700b-8c1f-4bcc-afd4-f45757e17b2a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:39.507187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ab06700b-8c1f-4bcc-afd4-f45757e17b2a admin admin] The token cache is being invalidate because project 4650e5bbf0d44fe09b7d1d63f55b7073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:39.507475 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ab06700b-8c1f-4bcc-afd4-f45757e17b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:39.508109 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ab06700b-8c1f-4bcc-afd4-f45757e17b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:39.509640 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1412/2848] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:54:39 2022] DELETE /identity/v3/projects/4650e5bbf0d44fe09b7d1d63f55b7073 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:39.514586 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bce88b-cdbc-41ce-b611-869ec6411b2b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:39.515065 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bce88b-cdbc-41ce-b611-869ec6411b2b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:39.515186 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bce88b-cdbc-41ce-b611-869ec6411b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:39.534105 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d1bce88b-cdbc-41ce-b611-869ec6411b2b None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:39.535278 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d1bce88b-cdbc-41ce-b611-869ec6411b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:39.593543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1437/2849] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:54:39.601778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e474d7a-36e5-41a8-a2ee-6954599c2651 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:39.602077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e474d7a-36e5-41a8-a2ee-6954599c2651 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:39.602386 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e474d7a-36e5-41a8-a2ee-6954599c2651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:39.621159 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7e474d7a-36e5-41a8-a2ee-6954599c2651 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:39.622371 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7e474d7a-36e5-41a8-a2ee-6954599c2651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:39.630275 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1413/2850] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:39.634462 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bce88b-cdbc-41ce-b611-869ec6411b2b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:39.644112 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bce88b-cdbc-41ce-b611-869ec6411b2b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:39.649760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688a69a-1ec9-49c4-9b8f-4296c53356ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:39.650411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688a69a-1ec9-49c4-9b8f-4296c53356ca admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:39.650738 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688a69a-1ec9-49c4-9b8f-4296c53356ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:39.651042 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688a69a-1ec9-49c4-9b8f-4296c53356ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:39.651766 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688a69a-1ec9-49c4-9b8f-4296c53356ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:54:39.652075 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688a69a-1ec9-49c4-9b8f-4296c53356ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:39.653667 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688a69a-1ec9-49c4-9b8f-4296c53356ca admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:39.656067 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:39.667731 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1438/2851] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:54:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:54:39.671801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e474d7a-36e5-41a8-a2ee-6954599c2651 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:39.681284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e474d7a-36e5-41a8-a2ee-6954599c2651 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:39.686013 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874a8ce-139f-4481-a7bd-d7da463e6e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:39.686710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874a8ce-139f-4481-a7bd-d7da463e6e5b admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:39.687000 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874a8ce-139f-4481-a7bd-d7da463e6e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:39.687279 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874a8ce-139f-4481-a7bd-d7da463e6e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:39.687977 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874a8ce-139f-4481-a7bd-d7da463e6e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:39.689880 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874a8ce-139f-4481-a7bd-d7da463e6e5b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:39.719113 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1414/2852] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:54:39 2022] POST /identity/v3/projects => generated 378 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:39.720307 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688a69a-1ec9-49c4-9b8f-4296c53356ca admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:39.731032 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688a69a-1ec9-49c4-9b8f-4296c53356ca admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:39.785940 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dde3a-23ad-4332-a0a0-e5db8bec9360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:39.786531 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dde3a-23ad-4332-a0a0-e5db8bec9360 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:39.786853 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dde3a-23ad-4332-a0a0-e5db8bec9360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:39.787632 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dde3a-23ad-4332-a0a0-e5db8bec9360 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:39.788317 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8dde3a-23ad-4332-a0a0-e5db8bec9360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:39.790234 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8dde3a-23ad-4332-a0a0-e5db8bec9360 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:39.813885 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1439/2853] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:54:39 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:39.815155 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874a8ce-139f-4481-a7bd-d7da463e6e5b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:39.827469 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874a8ce-139f-4481-a7bd-d7da463e6e5b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:39.832437 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c6a0a-7b99-4775-b2c0-46bf9989e2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:39.833119 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c6a0a-7b99-4775-b2c0-46bf9989e2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:39.833408 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c6a0a-7b99-4775-b2c0-46bf9989e2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:39.833691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c6a0a-7b99-4775-b2c0-46bf9989e2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:39.834455 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c6a0a-7b99-4775-b2c0-46bf9989e2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:39.836091 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c6a0a-7b99-4775-b2c0-46bf9989e2e1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:39.846914 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1415/2854] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:39 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:39.851506 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dde3a-23ad-4332-a0a0-e5db8bec9360 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:39.861862 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dde3a-23ad-4332-a0a0-e5db8bec9360 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:39.867423 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4fef1-9df1-4cd9-8ae8-c8e4dc5e2a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:39.868091 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4fef1-9df1-4cd9-8ae8-c8e4dc5e2a9d admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:39.868379 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4fef1-9df1-4cd9-8ae8-c8e4dc5e2a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:39.868664 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4fef1-9df1-4cd9-8ae8-c8e4dc5e2a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:39.869392 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4fef1-9df1-4cd9-8ae8-c8e4dc5e2a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:39.871028 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4fef1-9df1-4cd9-8ae8-c8e4dc5e2a9d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:39.880981 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1440/2855] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:39 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:39.885041 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c6a0a-7b99-4775-b2c0-46bf9989e2e1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:39.895050 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c6a0a-7b99-4775-b2c0-46bf9989e2e1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:39.899878 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101fd19-2630-4055-a3c4-b2441c2fb637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:39.900745 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101fd19-2630-4055-a3c4-b2441c2fb637 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:39.901032 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101fd19-2630-4055-a3c4-b2441c2fb637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:39.901314 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101fd19-2630-4055-a3c4-b2441c2fb637 admin admin] PATH_INFO: `/v3/projects/4b870ad5e9544fbe8015363292733f09/users/dabb34fcc3444f9398caecb4e60ea1f4/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:39.916405 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101fd19-2630-4055-a3c4-b2441c2fb637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b870ad5e9544fbe8015363292733f09, user_id=dabb34fcc3444f9398caecb4e60ea1f4, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:39.919187 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101fd19-2630-4055-a3c4-b2441c2fb637 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:39.927029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:39.934538 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1416/2856] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:54:39 2022] PUT /identity/v3/projects/4b870ad5e9544fbe8015363292733f09/users/dabb34fcc3444f9398caecb4e60ea1f4/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:39.945664 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcea17-f7cd-49a6-a1e6-27cce8b1a736 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:39.945987 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcea17-f7cd-49a6-a1e6-27cce8b1a736 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:39.946269 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcea17-f7cd-49a6-a1e6-27cce8b1a736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:39.972005 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9dbcea17-f7cd-49a6-a1e6-27cce8b1a736 None None] MFA Rules not processed for user `dabb34fcc3444f9398caecb4e60ea1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:39.973212 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9dbcea17-f7cd-49a6-a1e6-27cce8b1a736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:40.035720 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1441/2857] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:40.040864 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101fd19-2630-4055-a3c4-b2441c2fb637 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:40.102007 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101fd19-2630-4055-a3c4-b2441c2fb637 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:40.106682 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e3abe-1dde-4374-b278-7fd56119f421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:40.107350 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e3abe-1dde-4374-b278-7fd56119f421 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:40.107636 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e3abe-1dde-4374-b278-7fd56119f421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:40.107916 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e3abe-1dde-4374-b278-7fd56119f421 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:40.108608 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e3abe-1dde-4374-b278-7fd56119f421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:40.110788 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e3abe-1dde-4374-b278-7fd56119f421 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:40.137725 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1417/2858] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:54:40 2022] POST /identity/v3/projects => generated 378 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:40.142139 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcea17-f7cd-49a6-a1e6-27cce8b1a736 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:40.153464 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcea17-f7cd-49a6-a1e6-27cce8b1a736 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:40.210361 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef165c-01aa-4a14-9930-31c5ff5c8b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:40.211060 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef165c-01aa-4a14-9930-31c5ff5c8b2f admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:40.211351 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef165c-01aa-4a14-9930-31c5ff5c8b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:40.211630 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef165c-01aa-4a14-9930-31c5ff5c8b2f admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:40.212324 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef165c-01aa-4a14-9930-31c5ff5c8b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:40.214253 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef165c-01aa-4a14-9930-31c5ff5c8b2f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:40.222974 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:40.234694 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1442/2859] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:54:40 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:40.238976 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e3abe-1dde-4374-b278-7fd56119f421 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:40.249528 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e3abe-1dde-4374-b278-7fd56119f421 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:40.254303 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f20d0c-b6e6-40c4-b9a2-918b4717dc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:40.255029 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f20d0c-b6e6-40c4-b9a2-918b4717dc13 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:40.255316 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f20d0c-b6e6-40c4-b9a2-918b4717dc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:40.255623 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f20d0c-b6e6-40c4-b9a2-918b4717dc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:40.256356 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f20d0c-b6e6-40c4-b9a2-918b4717dc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:40.257992 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f20d0c-b6e6-40c4-b9a2-918b4717dc13 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:40.268945 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1418/2860] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:40 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:40.273727 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef165c-01aa-4a14-9930-31c5ff5c8b2f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:40.284106 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef165c-01aa-4a14-9930-31c5ff5c8b2f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:40.289348 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af600c2a-c872-40de-b630-ac93b8014fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:40.290212 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af600c2a-c872-40de-b630-ac93b8014fac admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:40.290500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af600c2a-c872-40de-b630-ac93b8014fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:40.290812 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af600c2a-c872-40de-b630-ac93b8014fac admin admin] PATH_INFO: `/v3/projects/c10c136d8f67449096a28255bd9b204e/users/3b45b7eccff64efdaa2df57a620929b3/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:40.305344 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af600c2a-c872-40de-b630-ac93b8014fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10c136d8f67449096a28255bd9b204e, user_id=3b45b7eccff64efdaa2df57a620929b3, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:40.308002 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af600c2a-c872-40de-b630-ac93b8014fac admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:40.320714 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1443/2861] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:54:40 2022] PUT /identity/v3/projects/c10c136d8f67449096a28255bd9b204e/users/3b45b7eccff64efdaa2df57a620929b3/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:40.324747 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f20d0c-b6e6-40c4-b9a2-918b4717dc13 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:40.335198 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f20d0c-b6e6-40c4-b9a2-918b4717dc13 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:40.391750 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4868220-7687-459a-8165-ce0eecaed83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:40.392432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4868220-7687-459a-8165-ce0eecaed83c admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:40.392724 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4868220-7687-459a-8165-ce0eecaed83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:40.393008 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4868220-7687-459a-8165-ce0eecaed83c admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:40.393737 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4868220-7687-459a-8165-ce0eecaed83c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:40.395377 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4868220-7687-459a-8165-ce0eecaed83c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:40.405799 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1419/2862] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:40 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:40.410082 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af600c2a-c872-40de-b630-ac93b8014fac admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:40.421435 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af600c2a-c872-40de-b630-ac93b8014fac admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:40.425966 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0369d6-fddf-4bda-afa5-2aa69df1d5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:40.426952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0369d6-fddf-4bda-afa5-2aa69df1d5c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:40.427238 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0369d6-fddf-4bda-afa5-2aa69df1d5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:40.427520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0369d6-fddf-4bda-afa5-2aa69df1d5c9 admin admin] PATH_INFO: `/v3/projects/c10c136d8f67449096a28255bd9b204e/users/3b45b7eccff64efdaa2df57a620929b3/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:40.429475 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0369d6-fddf-4bda-afa5-2aa69df1d5c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10c136d8f67449096a28255bd9b204e, user_id=3b45b7eccff64efdaa2df57a620929b3, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:40.432155 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0369d6-fddf-4bda-afa5-2aa69df1d5c9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:40.442352 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1444/2863] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:54:40 2022] PUT /identity/v3/projects/c10c136d8f67449096a28255bd9b204e/users/3b45b7eccff64efdaa2df57a620929b3/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:40.452467 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75c968-0abf-4b43-a6e1-85295a253fad None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:40.452765 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75c968-0abf-4b43-a6e1-85295a253fad None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:40.453051 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75c968-0abf-4b43-a6e1-85295a253fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:40.480095 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cb75c968-0abf-4b43-a6e1-85295a253fad None None] MFA Rules not processed for user `3b45b7eccff64efdaa2df57a620929b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:40.481346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cb75c968-0abf-4b43-a6e1-85295a253fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:40.540868 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:40.551776 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1420/2864] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:40.562746 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0369d6-fddf-4bda-afa5-2aa69df1d5c9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:40.564488 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5d0369d6-fddf-4bda-afa5-2aa69df1d5c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:40.622055 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0369d6-fddf-4bda-afa5-2aa69df1d5c9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:40.625812 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd26ab-ffcf-49bb-97ca-3cbe9d4e38c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:40.626457 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd26ab-ffcf-49bb-97ca-3cbe9d4e38c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:40.626769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd26ab-ffcf-49bb-97ca-3cbe9d4e38c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:40.627046 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd26ab-ffcf-49bb-97ca-3cbe9d4e38c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:40.682790 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd26ab-ffcf-49bb-97ca-3cbe9d4e38c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:40.684353 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd26ab-ffcf-49bb-97ca-3cbe9d4e38c8 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:40.693928 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1445/2865] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:54:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:42.048325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75c968-0abf-4b43-a6e1-85295a253fad None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:42.049777 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cb75c968-0abf-4b43-a6e1-85295a253fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:42.062525 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75c968-0abf-4b43-a6e1-85295a253fad None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:42.066105 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed22f11-e346-43b5-b6a2-309b962d0a2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:42.066791 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed22f11-e346-43b5-b6a2-309b962d0a2a service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:42.067078 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed22f11-e346-43b5-b6a2-309b962d0a2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:42.067355 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed22f11-e346-43b5-b6a2-309b962d0a2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:42.076409 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed22f11-e346-43b5-b6a2-309b962d0a2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:42.077834 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed22f11-e346-43b5-b6a2-309b962d0a2a service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:42.087429 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1421/2866] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:54:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:45.819658 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd26ab-ffcf-49bb-97ca-3cbe9d4e38c8 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:45.881213 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd26ab-ffcf-49bb-97ca-3cbe9d4e38c8 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:45.885864 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492648a2-928d-42ba-b859-baa95ae511ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:45.886763 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492648a2-928d-42ba-b859-baa95ae511ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:45.887047 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492648a2-928d-42ba-b859-baa95ae511ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:45.887319 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492648a2-928d-42ba-b859-baa95ae511ec admin admin] PATH_INFO: `/v3/users/dabb34fcc3444f9398caecb4e60ea1f4` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:45.888487 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492648a2-928d-42ba-b859-baa95ae511ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=dabb34fcc3444f9398caecb4e60ea1f4)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:45.890400 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492648a2-928d-42ba-b859-baa95ae511ec admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:45.902835 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:DELETE=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:45.938431 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-492648a2-928d-42ba-b859-baa95ae511ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dabb34fcc3444f9398caecb4e60ea1f4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:45.950096 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-492648a2-928d-42ba-b859-baa95ae511ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dabb34fcc3444f9398caecb4e60ea1f4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:45.950786 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-492648a2-928d-42ba-b859-baa95ae511ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dabb34fcc3444f9398caecb4e60ea1f4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:45.957851 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-492648a2-928d-42ba-b859-baa95ae511ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dabb34fcc3444f9398caecb4e60ea1f4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:45.958535 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-492648a2-928d-42ba-b859-baa95ae511ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dabb34fcc3444f9398caecb4e60ea1f4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:45.970787 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1446/2867] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:54:45 2022] DELETE /identity/v3/users/dabb34fcc3444f9398caecb4e60ea1f4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:45.975786 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e587c-4522-4223-aaaa-735af2ec3c98 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:45.976249 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e587c-4522-4223-aaaa-735af2ec3c98 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:45.976366 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e587c-4522-4223-aaaa-735af2ec3c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:45.994133 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-226e587c-4522-4223-aaaa-735af2ec3c98 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:45.995378 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-226e587c-4522-4223-aaaa-735af2ec3c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:46.053037 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1422/2868] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:46.063411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492648a2-928d-42ba-b859-baa95ae511ec admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:46.064878 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-492648a2-928d-42ba-b859-baa95ae511ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:46.121973 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492648a2-928d-42ba-b859-baa95ae511ec admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:46.125636 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733d6b3-ef7a-4131-ac35-58a0d63ad6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:46.126286 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733d6b3-ef7a-4131-ac35-58a0d63ad6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:46.126593 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733d6b3-ef7a-4131-ac35-58a0d63ad6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:46.126889 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733d6b3-ef7a-4131-ac35-58a0d63ad6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:46.136309 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733d6b3-ef7a-4131-ac35-58a0d63ad6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:46.137838 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733d6b3-ef7a-4131-ac35-58a0d63ad6b5 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:46.148021 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1447/2869] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:54:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:46.415848 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e587c-4522-4223-aaaa-735af2ec3c98 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:46.417362 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-226e587c-4522-4223-aaaa-735af2ec3c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:46.429556 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e587c-4522-4223-aaaa-735af2ec3c98 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:46.434951 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beae491-fcc3-4f81-b164-f33e233a92bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:46.435826 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beae491-fcc3-4f81-b164-f33e233a92bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:46.436107 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beae491-fcc3-4f81-b164-f33e233a92bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:46.436801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beae491-fcc3-4f81-b164-f33e233a92bb admin admin] PATH_INFO: `/v3/projects/4b870ad5e9544fbe8015363292733f09` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:46.437578 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beae491-fcc3-4f81-b164-f33e233a92bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b870ad5e9544fbe8015363292733f09)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:46.439547 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beae491-fcc3-4f81-b164-f33e233a92bb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:46.486710 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5beae491-fcc3-4f81-b164-f33e233a92bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b870ad5e9544fbe8015363292733f09', 'request_id': 'req-5beae491-fcc3-4f81-b164-f33e233a92bb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:46.494106 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5beae491-fcc3-4f81-b164-f33e233a92bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b870ad5e9544fbe8015363292733f09', 'request_id': 'req-5beae491-fcc3-4f81-b164-f33e233a92bb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:46.500345 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5beae491-fcc3-4f81-b164-f33e233a92bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b870ad5e9544fbe8015363292733f09', 'request_id': 'req-5beae491-fcc3-4f81-b164-f33e233a92bb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:46.511324 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5beae491-fcc3-4f81-b164-f33e233a92bb admin admin] The token cache is being invalidate because project 4b870ad5e9544fbe8015363292733f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:46.511618 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5beae491-fcc3-4f81-b164-f33e233a92bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:46.512273 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5beae491-fcc3-4f81-b164-f33e233a92bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:46.513870 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1423/2870] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:54:46 2022] DELETE /identity/v3/projects/4b870ad5e9544fbe8015363292733f09 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:46.517809 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733d6b3-ef7a-4131-ac35-58a0d63ad6b5 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:46.528004 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733d6b3-ef7a-4131-ac35-58a0d63ad6b5 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:46.586120 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445aa69-208d-410e-a42d-346b0b3b5e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:46.586976 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445aa69-208d-410e-a42d-346b0b3b5e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:46.587264 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445aa69-208d-410e-a42d-346b0b3b5e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:46.587543 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445aa69-208d-410e-a42d-346b0b3b5e40 admin admin] PATH_INFO: `/v3/users/3b45b7eccff64efdaa2df57a620929b3` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:46.588748 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445aa69-208d-410e-a42d-346b0b3b5e40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b45b7eccff64efdaa2df57a620929b3)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:46.590726 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445aa69-208d-410e-a42d-346b0b3b5e40 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:46.626961 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:46.638175 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d445aa69-208d-410e-a42d-346b0b3b5e40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b45b7eccff64efdaa2df57a620929b3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:46.650481 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d445aa69-208d-410e-a42d-346b0b3b5e40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b45b7eccff64efdaa2df57a620929b3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:46.651224 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d445aa69-208d-410e-a42d-346b0b3b5e40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b45b7eccff64efdaa2df57a620929b3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:46.658548 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d445aa69-208d-410e-a42d-346b0b3b5e40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b45b7eccff64efdaa2df57a620929b3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:46.659191 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d445aa69-208d-410e-a42d-346b0b3b5e40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b45b7eccff64efdaa2df57a620929b3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:46.671381 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1448/2871] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:54:46 2022] DELETE /identity/v3/users/3b45b7eccff64efdaa2df57a620929b3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:46.954111 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beae491-fcc3-4f81-b164-f33e233a92bb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:46.955558 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5beae491-fcc3-4f81-b164-f33e233a92bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:46.970330 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beae491-fcc3-4f81-b164-f33e233a92bb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:47.030171 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f33817-861d-43fc-992d-7ade56e70e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:47.031079 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f33817-861d-43fc-992d-7ade56e70e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:47.031366 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f33817-861d-43fc-992d-7ade56e70e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:47.031641 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f33817-861d-43fc-992d-7ade56e70e5f admin admin] PATH_INFO: `/v3/projects/c10c136d8f67449096a28255bd9b204e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:47.032817 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f33817-861d-43fc-992d-7ade56e70e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c10c136d8f67449096a28255bd9b204e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:47.034766 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f33817-861d-43fc-992d-7ade56e70e5f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:47.041750 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:47.081691 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-98f33817-861d-43fc-992d-7ade56e70e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c10c136d8f67449096a28255bd9b204e', 'request_id': 'req-98f33817-861d-43fc-992d-7ade56e70e5f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:47.089227 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-98f33817-861d-43fc-992d-7ade56e70e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c10c136d8f67449096a28255bd9b204e', 'request_id': 'req-98f33817-861d-43fc-992d-7ade56e70e5f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:47.095502 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-98f33817-861d-43fc-992d-7ade56e70e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c10c136d8f67449096a28255bd9b204e', 'request_id': 'req-98f33817-861d-43fc-992d-7ade56e70e5f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:47.106614 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-98f33817-861d-43fc-992d-7ade56e70e5f admin admin] The token cache is being invalidate because project c10c136d8f67449096a28255bd9b204e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:47.106902 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-98f33817-861d-43fc-992d-7ade56e70e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:47.107534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-98f33817-861d-43fc-992d-7ade56e70e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:47.109044 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1424/2872] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:54:46 2022] DELETE /identity/v3/projects/c10c136d8f67449096a28255bd9b204e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:47.114325 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e5320-3fc5-46d2-a0ca-007cff79a926 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:47.114830 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e5320-3fc5-46d2-a0ca-007cff79a926 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:47.114965 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e5320-3fc5-46d2-a0ca-007cff79a926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:47.132261 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-529e5320-3fc5-46d2-a0ca-007cff79a926 None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:47.133411 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-529e5320-3fc5-46d2-a0ca-007cff79a926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:47.191559 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1449/2873] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:47.200432 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a0e73-f241-49cc-941d-6c1986905cca None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:47.200724 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a0e73-f241-49cc-941d-6c1986905cca None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:47.201003 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a0e73-f241-49cc-941d-6c1986905cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:47.220385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a25a0e73-f241-49cc-941d-6c1986905cca None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:47.221592 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a25a0e73-f241-49cc-941d-6c1986905cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:47.230588 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1425/2874] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:47.234990 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e5320-3fc5-46d2-a0ca-007cff79a926 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:47.245252 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e5320-3fc5-46d2-a0ca-007cff79a926 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:47.250311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98b30f-cac6-4733-b99e-0161e3bb0ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:47.251022 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98b30f-cac6-4733-b99e-0161e3bb0ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:47.251311 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98b30f-cac6-4733-b99e-0161e3bb0ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:47.251593 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98b30f-cac6-4733-b99e-0161e3bb0ca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:47.252319 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98b30f-cac6-4733-b99e-0161e3bb0ca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:54:47.252631 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98b30f-cac6-4733-b99e-0161e3bb0ca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:47.254284 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98b30f-cac6-4733-b99e-0161e3bb0ca3 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:47.266445 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1450/2875] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:54:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:54:47.271180 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a0e73-f241-49cc-941d-6c1986905cca None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:47.281284 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a0e73-f241-49cc-941d-6c1986905cca None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:47.286307 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db7435-4156-4a25-b2d9-a59d8ea3add0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:47.286985 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db7435-4156-4a25-b2d9-a59d8ea3add0 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:47.287269 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db7435-4156-4a25-b2d9-a59d8ea3add0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:47.287543 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db7435-4156-4a25-b2d9-a59d8ea3add0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:47.288289 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db7435-4156-4a25-b2d9-a59d8ea3add0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:47.290228 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db7435-4156-4a25-b2d9-a59d8ea3add0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:47.316417 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1426/2876] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:54:47 2022] POST /identity/v3/projects => generated 390 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:47.321197 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98b30f-cac6-4733-b99e-0161e3bb0ca3 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:47.331349 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98b30f-cac6-4733-b99e-0161e3bb0ca3 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:47.389595 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad58249-6473-42c4-9ea8-90ba57dfdb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:47.390210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad58249-6473-42c4-9ea8-90ba57dfdb4e admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:47.390500 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad58249-6473-42c4-9ea8-90ba57dfdb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:47.390812 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad58249-6473-42c4-9ea8-90ba57dfdb4e admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:47.391522 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad58249-6473-42c4-9ea8-90ba57dfdb4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:47.393446 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad58249-6473-42c4-9ea8-90ba57dfdb4e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:47.413018 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1451/2877] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:54:47 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:47.417251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db7435-4156-4a25-b2d9-a59d8ea3add0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:47.427687 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db7435-4156-4a25-b2d9-a59d8ea3add0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:47.432483 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02813bc5-69a0-4282-b87e-05b751801fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:47.433141 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02813bc5-69a0-4282-b87e-05b751801fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:47.433424 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02813bc5-69a0-4282-b87e-05b751801fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:47.433700 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02813bc5-69a0-4282-b87e-05b751801fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:47.434425 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02813bc5-69a0-4282-b87e-05b751801fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:47.436056 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02813bc5-69a0-4282-b87e-05b751801fe9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:47.447034 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1427/2878] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:47 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:47.451232 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad58249-6473-42c4-9ea8-90ba57dfdb4e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:47.461778 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad58249-6473-42c4-9ea8-90ba57dfdb4e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:47.466257 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331d481-ddef-42ca-b82c-20380108001e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:47.467210 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331d481-ddef-42ca-b82c-20380108001e admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:47.467496 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331d481-ddef-42ca-b82c-20380108001e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:47.467775 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331d481-ddef-42ca-b82c-20380108001e admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:47.468492 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331d481-ddef-42ca-b82c-20380108001e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:47.470081 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331d481-ddef-42ca-b82c-20380108001e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:47.480277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1452/2879] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:47 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:47.484323 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02813bc5-69a0-4282-b87e-05b751801fe9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:47.494748 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02813bc5-69a0-4282-b87e-05b751801fe9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:47.499428 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1dff9-a64d-4c21-accc-485b133bb606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:47.500388 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1dff9-a64d-4c21-accc-485b133bb606 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:47.500678 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1dff9-a64d-4c21-accc-485b133bb606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:47.500956 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1dff9-a64d-4c21-accc-485b133bb606 admin admin] PATH_INFO: `/v3/projects/bfa1a7dce9874c25b21ecbc9796fdb9b/users/37898b764251430fbb30f618dc51d573/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:47.515935 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1dff9-a64d-4c21-accc-485b133bb606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa1a7dce9874c25b21ecbc9796fdb9b, user_id=37898b764251430fbb30f618dc51d573, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:47.518660 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1dff9-a64d-4c21-accc-485b133bb606 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:47.532675 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1428/2880] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:54:47 2022] PUT /identity/v3/projects/bfa1a7dce9874c25b21ecbc9796fdb9b/users/37898b764251430fbb30f618dc51d573/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:54:47.542947 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d067eb0-4337-4f6f-9b55-6bc67c20ea8f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:47.543248 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d067eb0-4337-4f6f-9b55-6bc67c20ea8f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:47.543529 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d067eb0-4337-4f6f-9b55-6bc67c20ea8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:47.569891 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2d067eb0-4337-4f6f-9b55-6bc67c20ea8f None None] MFA Rules not processed for user `37898b764251430fbb30f618dc51d573`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:47.571137 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2d067eb0-4337-4f6f-9b55-6bc67c20ea8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:47.576251 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:47.635789 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1453/2881] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:47.640368 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1dff9-a64d-4c21-accc-485b133bb606 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:47.701938 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1dff9-a64d-4c21-accc-485b133bb606 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:47.706562 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a381e-6836-4309-875d-fdf5b4040107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:47.707251 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a381e-6836-4309-875d-fdf5b4040107 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:47.707534 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a381e-6836-4309-875d-fdf5b4040107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:47.707810 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a381e-6836-4309-875d-fdf5b4040107 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:47.708503 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a381e-6836-4309-875d-fdf5b4040107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:47.710446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a381e-6836-4309-875d-fdf5b4040107 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:47.734497 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1429/2882] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:54:47 2022] POST /identity/v3/projects => generated 388 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:54:47.739055 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d067eb0-4337-4f6f-9b55-6bc67c20ea8f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:47.750237 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d067eb0-4337-4f6f-9b55-6bc67c20ea8f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:47.806092 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1feadf-bd09-4cf4-9422-44f05ca98246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:47.806800 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1feadf-bd09-4cf4-9422-44f05ca98246 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:47.807086 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1feadf-bd09-4cf4-9422-44f05ca98246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:47.807374 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1feadf-bd09-4cf4-9422-44f05ca98246 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:47.808078 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1feadf-bd09-4cf4-9422-44f05ca98246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:47.810018 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1feadf-bd09-4cf4-9422-44f05ca98246 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:47.828974 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1454/2883] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:54:47 2022] POST /identity/v3/users => generated 301 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:54:47.832965 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a381e-6836-4309-875d-fdf5b4040107 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:47.843778 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a381e-6836-4309-875d-fdf5b4040107 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:47.848401 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322bd7b-9973-40c7-9ccd-37e8fad9333d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:47.849066 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322bd7b-9973-40c7-9ccd-37e8fad9333d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:47.849354 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322bd7b-9973-40c7-9ccd-37e8fad9333d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:47.849640 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322bd7b-9973-40c7-9ccd-37e8fad9333d admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:47.851128 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322bd7b-9973-40c7-9ccd-37e8fad9333d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:47.852747 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322bd7b-9973-40c7-9ccd-37e8fad9333d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:47.863934 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1430/2884] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:47 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:47.868054 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1feadf-bd09-4cf4-9422-44f05ca98246 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:47.877919 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1feadf-bd09-4cf4-9422-44f05ca98246 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:47.882477 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf789a5-a65d-42ec-9b67-25ae4ca68583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:47.883449 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf789a5-a65d-42ec-9b67-25ae4ca68583 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:47.883732 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf789a5-a65d-42ec-9b67-25ae4ca68583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:47.884008 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf789a5-a65d-42ec-9b67-25ae4ca68583 admin admin] PATH_INFO: `/v3/projects/c31f08717d0847d08af170510c020cff/users/a2429ba6c6be471eaea68787233da950/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:47.898865 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf789a5-a65d-42ec-9b67-25ae4ca68583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31f08717d0847d08af170510c020cff, user_id=a2429ba6c6be471eaea68787233da950, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:47.901677 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf789a5-a65d-42ec-9b67-25ae4ca68583 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:47.915389 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1455/2885] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:54:47 2022] PUT /identity/v3/projects/c31f08717d0847d08af170510c020cff/users/a2429ba6c6be471eaea68787233da950/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:47.919557 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322bd7b-9973-40c7-9ccd-37e8fad9333d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:47.925866 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:47.929809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322bd7b-9973-40c7-9ccd-37e8fad9333d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:47.988257 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3fcd8-3f2f-4c9a-950a-24e879790d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:47.988931 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3fcd8-3f2f-4c9a-950a-24e879790d0e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:47.989218 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3fcd8-3f2f-4c9a-950a-24e879790d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:47.989496 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3fcd8-3f2f-4c9a-950a-24e879790d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:47.990212 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3fcd8-3f2f-4c9a-950a-24e879790d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:47.991840 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3fcd8-3f2f-4c9a-950a-24e879790d0e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:48.001682 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1431/2886] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:47 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:48.005823 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf789a5-a65d-42ec-9b67-25ae4ca68583 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:48.016644 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf789a5-a65d-42ec-9b67-25ae4ca68583 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:48.021329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5a5b8-5b02-426c-b540-4c5ff655a85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:48.022209 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5a5b8-5b02-426c-b540-4c5ff655a85a admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:48.023144 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5a5b8-5b02-426c-b540-4c5ff655a85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:48.023429 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5a5b8-5b02-426c-b540-4c5ff655a85a admin admin] PATH_INFO: `/v3/projects/c31f08717d0847d08af170510c020cff/users/a2429ba6c6be471eaea68787233da950/roles/1393d128d39b4649b6cd71b6609846cb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:48.025430 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5a5b8-5b02-426c-b540-4c5ff655a85a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31f08717d0847d08af170510c020cff, user_id=a2429ba6c6be471eaea68787233da950, role_id=1393d128d39b4649b6cd71b6609846cb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:48.028121 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5a5b8-5b02-426c-b540-4c5ff655a85a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:48.038423 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1456/2887] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:54:48 2022] PUT /identity/v3/projects/c31f08717d0847d08af170510c020cff/users/a2429ba6c6be471eaea68787233da950/roles/1393d128d39b4649b6cd71b6609846cb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:48.048694 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a6ec4-c085-4e91-b752-9e5f987734c2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:48.049203 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a6ec4-c085-4e91-b752-9e5f987734c2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:48.049308 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a6ec4-c085-4e91-b752-9e5f987734c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:48.076551 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-417a6ec4-c085-4e91-b752-9e5f987734c2 None None] MFA Rules not processed for user `a2429ba6c6be471eaea68787233da950`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:48.077769 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-417a6ec4-c085-4e91-b752-9e5f987734c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:48.145082 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1432/2888] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:48.156301 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5a5b8-5b02-426c-b540-4c5ff655a85a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:48.158048 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c9a5a5b8-5b02-426c-b540-4c5ff655a85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:48.216544 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5a5b8-5b02-426c-b540-4c5ff655a85a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:48.220285 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578395d4-478c-4f1d-839d-66f96964a8c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:48.220934 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578395d4-478c-4f1d-839d-66f96964a8c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:48.221226 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578395d4-478c-4f1d-839d-66f96964a8c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:48.221514 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578395d4-478c-4f1d-839d-66f96964a8c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:48.230464 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578395d4-478c-4f1d-839d-66f96964a8c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:48.231924 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578395d4-478c-4f1d-839d-66f96964a8c1 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:48.241525 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1457/2889] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:54:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:48.369588 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a6ec4-c085-4e91-b752-9e5f987734c2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:48.431541 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a6ec4-c085-4e91-b752-9e5f987734c2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:48.436383 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11054998-b100-426e-bae8-698cf0f3c94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:48.437263 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11054998-b100-426e-bae8-698cf0f3c94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:48.437548 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11054998-b100-426e-bae8-698cf0f3c94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:48.437825 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11054998-b100-426e-bae8-698cf0f3c94d admin admin] PATH_INFO: `/v3/users/37898b764251430fbb30f618dc51d573` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:48.439033 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11054998-b100-426e-bae8-698cf0f3c94d admin admin] RBAC: Authorizing `identity:delete_user(user_id=37898b764251430fbb30f618dc51d573)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:48.440969 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11054998-b100-426e-bae8-698cf0f3c94d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:48.470586 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:48.490168 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-11054998-b100-426e-bae8-698cf0f3c94d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37898b764251430fbb30f618dc51d573'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:48.490851 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-11054998-b100-426e-bae8-698cf0f3c94d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37898b764251430fbb30f618dc51d573'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:48.498214 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-11054998-b100-426e-bae8-698cf0f3c94d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37898b764251430fbb30f618dc51d573'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:48.498915 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-11054998-b100-426e-bae8-698cf0f3c94d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37898b764251430fbb30f618dc51d573'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:48.506704 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-11054998-b100-426e-bae8-698cf0f3c94d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37898b764251430fbb30f618dc51d573'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:48.524160 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1433/2890] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:54:48 2022] DELETE /identity/v3/users/37898b764251430fbb30f618dc51d573 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:48.528681 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac7843-b045-477f-a672-f37bf493d00e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:48.528960 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac7843-b045-477f-a672-f37bf493d00e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:48.529246 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac7843-b045-477f-a672-f37bf493d00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:48.535041 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:48.548468 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c9ac7843-b045-477f-a672-f37bf493d00e None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:48.549675 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c9ac7843-b045-477f-a672-f37bf493d00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:48.608302 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1458/2891] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:48.618843 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11054998-b100-426e-bae8-698cf0f3c94d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:48.620282 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-11054998-b100-426e-bae8-698cf0f3c94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:48.676814 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11054998-b100-426e-bae8-698cf0f3c94d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:48.681005 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d441a-2161-4227-aac9-821cb652d2b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:48.681714 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d441a-2161-4227-aac9-821cb652d2b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:48.681937 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d441a-2161-4227-aac9-821cb652d2b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:48.682216 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d441a-2161-4227-aac9-821cb652d2b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:48.691355 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d441a-2161-4227-aac9-821cb652d2b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:48.692779 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d441a-2161-4227-aac9-821cb652d2b6 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:48.703559 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1434/2892] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:54:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:48.971066 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac7843-b045-477f-a672-f37bf493d00e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:48.972487 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c9ac7843-b045-477f-a672-f37bf493d00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:48.985455 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac7843-b045-477f-a672-f37bf493d00e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:48.990428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229d4fb-6438-49f9-8c74-9196df5c3434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:48.992003 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229d4fb-6438-49f9-8c74-9196df5c3434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:48.992428 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229d4fb-6438-49f9-8c74-9196df5c3434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:48.992565 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229d4fb-6438-49f9-8c74-9196df5c3434 admin admin] PATH_INFO: `/v3/projects/bfa1a7dce9874c25b21ecbc9796fdb9b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:48.993771 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229d4fb-6438-49f9-8c74-9196df5c3434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa1a7dce9874c25b21ecbc9796fdb9b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:48.995738 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229d4fb-6438-49f9-8c74-9196df5c3434 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:49.041960 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7229d4fb-6438-49f9-8c74-9196df5c3434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa1a7dce9874c25b21ecbc9796fdb9b', 'request_id': 'req-7229d4fb-6438-49f9-8c74-9196df5c3434'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:49.048111 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7229d4fb-6438-49f9-8c74-9196df5c3434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa1a7dce9874c25b21ecbc9796fdb9b', 'request_id': 'req-7229d4fb-6438-49f9-8c74-9196df5c3434'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:49.053703 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7229d4fb-6438-49f9-8c74-9196df5c3434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa1a7dce9874c25b21ecbc9796fdb9b', 'request_id': 'req-7229d4fb-6438-49f9-8c74-9196df5c3434'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:49.066925 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7229d4fb-6438-49f9-8c74-9196df5c3434 admin admin] The token cache is being invalidate because project bfa1a7dce9874c25b21ecbc9796fdb9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:49.067218 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7229d4fb-6438-49f9-8c74-9196df5c3434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:49.067839 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7229d4fb-6438-49f9-8c74-9196df5c3434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:49.069371 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1459/2893] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:54:48 2022] DELETE /identity/v3/projects/bfa1a7dce9874c25b21ecbc9796fdb9b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:49.074016 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d441a-2161-4227-aac9-821cb652d2b6 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:49.083498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d441a-2161-4227-aac9-821cb652d2b6 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:49.139815 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56882d8-d02b-48fd-88dc-fb0c7b31c9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:49.140700 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56882d8-d02b-48fd-88dc-fb0c7b31c9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:49.140988 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56882d8-d02b-48fd-88dc-fb0c7b31c9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:49.141270 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56882d8-d02b-48fd-88dc-fb0c7b31c9ab admin admin] PATH_INFO: `/v3/users/a2429ba6c6be471eaea68787233da950` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:49.142498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56882d8-d02b-48fd-88dc-fb0c7b31c9ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2429ba6c6be471eaea68787233da950)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:49.144498 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56882d8-d02b-48fd-88dc-fb0c7b31c9ab admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:49.189767 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d56882d8-d02b-48fd-88dc-fb0c7b31c9ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2429ba6c6be471eaea68787233da950'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:49.190421 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d56882d8-d02b-48fd-88dc-fb0c7b31c9ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2429ba6c6be471eaea68787233da950'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:49.192444 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:49.198311 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d56882d8-d02b-48fd-88dc-fb0c7b31c9ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2429ba6c6be471eaea68787233da950'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:49.199404 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d56882d8-d02b-48fd-88dc-fb0c7b31c9ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2429ba6c6be471eaea68787233da950'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:49.207456 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d56882d8-d02b-48fd-88dc-fb0c7b31c9ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2429ba6c6be471eaea68787233da950'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:49.225174 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1435/2894] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:54:49 2022] DELETE /identity/v3/users/a2429ba6c6be471eaea68787233da950 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:49.490895 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229d4fb-6438-49f9-8c74-9196df5c3434 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:49.492921 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7229d4fb-6438-49f9-8c74-9196df5c3434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:49.515515 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229d4fb-6438-49f9-8c74-9196df5c3434 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:49.573176 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d769c0c-7200-48de-8997-68231b493011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:49.573866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d769c0c-7200-48de-8997-68231b493011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:49.574148 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d769c0c-7200-48de-8997-68231b493011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:49.574424 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d769c0c-7200-48de-8997-68231b493011 admin admin] PATH_INFO: `/v3/projects/c31f08717d0847d08af170510c020cff` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:49.575649 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d769c0c-7200-48de-8997-68231b493011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31f08717d0847d08af170510c020cff)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:49.577550 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d769c0c-7200-48de-8997-68231b493011 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:49.608160 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:49.625059 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3d769c0c-7200-48de-8997-68231b493011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31f08717d0847d08af170510c020cff', 'request_id': 'req-3d769c0c-7200-48de-8997-68231b493011'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:49.631189 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3d769c0c-7200-48de-8997-68231b493011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31f08717d0847d08af170510c020cff', 'request_id': 'req-3d769c0c-7200-48de-8997-68231b493011'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:49.636836 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3d769c0c-7200-48de-8997-68231b493011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31f08717d0847d08af170510c020cff', 'request_id': 'req-3d769c0c-7200-48de-8997-68231b493011'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:49.648588 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3d769c0c-7200-48de-8997-68231b493011 admin admin] The token cache is being invalidate because project c31f08717d0847d08af170510c020cff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:49.648874 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3d769c0c-7200-48de-8997-68231b493011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:49.649490 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3d769c0c-7200-48de-8997-68231b493011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:49.651076 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1460/2895] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:54:49 2022] DELETE /identity/v3/projects/c31f08717d0847d08af170510c020cff => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:49.656026 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fae360-c64e-4e92-ad51-8b6b9f98374b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:49.656325 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fae360-c64e-4e92-ad51-8b6b9f98374b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:49.656615 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fae360-c64e-4e92-ad51-8b6b9f98374b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:49.675809 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-66fae360-c64e-4e92-ad51-8b6b9f98374b None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:49.677017 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-66fae360-c64e-4e92-ad51-8b6b9f98374b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:49.736633 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1436/2896] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:49.796738 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3aa1f-df95-444f-928b-ab04afdc120f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:49.797031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3aa1f-df95-444f-928b-ab04afdc120f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:49.797314 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3aa1f-df95-444f-928b-ab04afdc120f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:49.815980 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-71d3aa1f-df95-444f-928b-ab04afdc120f None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:49.817216 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-71d3aa1f-df95-444f-928b-ab04afdc120f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:49.825949 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1461/2897] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:49.830237 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fae360-c64e-4e92-ad51-8b6b9f98374b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:49.840537 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fae360-c64e-4e92-ad51-8b6b9f98374b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:49.845057 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5799fd-01e9-41f8-b65e-e3b99e102be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:49.845717 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5799fd-01e9-41f8-b65e-e3b99e102be3 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:49.845996 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5799fd-01e9-41f8-b65e-e3b99e102be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:49.846269 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5799fd-01e9-41f8-b65e-e3b99e102be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:49.847022 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5799fd-01e9-41f8-b65e-e3b99e102be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:54:49.847330 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5799fd-01e9-41f8-b65e-e3b99e102be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:49.848903 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5799fd-01e9-41f8-b65e-e3b99e102be3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:49.860489 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1437/2898] 10.222.0.110 () {58 vars in 1157 bytes} [Thu May 26 16:54:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:54:49.864970 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3aa1f-df95-444f-928b-ab04afdc120f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:49.874325 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3aa1f-df95-444f-928b-ab04afdc120f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:49.878969 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5b334-61db-49c6-96ba-634b005d1a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:49.879621 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5b334-61db-49c6-96ba-634b005d1a55 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:49.879909 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5b334-61db-49c6-96ba-634b005d1a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:49.880305 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5b334-61db-49c6-96ba-634b005d1a55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:49.881009 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5b334-61db-49c6-96ba-634b005d1a55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:49.883437 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5b334-61db-49c6-96ba-634b005d1a55 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:49.909638 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1462/2899] 10.222.0.110 () {60 vars in 1157 bytes} [Thu May 26 16:54:49 2022] POST /identity/v3/projects => generated 374 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:49.913721 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5799fd-01e9-41f8-b65e-e3b99e102be3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:49.924567 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5799fd-01e9-41f8-b65e-e3b99e102be3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:49.980726 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4268bb-555f-4626-b88c-2b2bdffd9a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:49.981422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4268bb-555f-4626-b88c-2b2bdffd9a1d admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:49.981702 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4268bb-555f-4626-b88c-2b2bdffd9a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:49.981980 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4268bb-555f-4626-b88c-2b2bdffd9a1d admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:49.982696 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4268bb-555f-4626-b88c-2b2bdffd9a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:49.984612 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4268bb-555f-4626-b88c-2b2bdffd9a1d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:50.005701 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1438/2900] 10.222.0.110 () {60 vars in 1148 bytes} [Thu May 26 16:54:49 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:54:50.010487 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5b334-61db-49c6-96ba-634b005d1a55 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:50.020698 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5b334-61db-49c6-96ba-634b005d1a55 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:50.025270 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b313cd5-5164-4b67-b4e1-9769cb73a142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:50.026408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b313cd5-5164-4b67-b4e1-9769cb73a142 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:50.026408 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b313cd5-5164-4b67-b4e1-9769cb73a142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:50.026686 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b313cd5-5164-4b67-b4e1-9769cb73a142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:50.027420 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b313cd5-5164-4b67-b4e1-9769cb73a142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:50.029380 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b313cd5-5164-4b67-b4e1-9769cb73a142 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:50.039937 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1463/2901] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:50 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:50.043877 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4268bb-555f-4626-b88c-2b2bdffd9a1d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:50.054225 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4268bb-555f-4626-b88c-2b2bdffd9a1d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:50.058862 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770890a3-1903-4cb7-a474-dad25ef81438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:50.059515 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770890a3-1903-4cb7-a474-dad25ef81438 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:50.059796 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770890a3-1903-4cb7-a474-dad25ef81438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:50.060072 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770890a3-1903-4cb7-a474-dad25ef81438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:50.060787 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770890a3-1903-4cb7-a474-dad25ef81438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:50.062362 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770890a3-1903-4cb7-a474-dad25ef81438 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:50.072677 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1439/2902] 10.222.0.110 () {58 vars in 1126 bytes} [Thu May 26 16:54:50 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:50.076820 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b313cd5-5164-4b67-b4e1-9769cb73a142 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:50.086737 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b313cd5-5164-4b67-b4e1-9769cb73a142 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:50.091329 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae619235-36fc-4d98-965b-5483b9ddcd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:50.092200 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae619235-36fc-4d98-965b-5483b9ddcd7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:50.092490 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae619235-36fc-4d98-965b-5483b9ddcd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:50.092769 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae619235-36fc-4d98-965b-5483b9ddcd7d admin admin] PATH_INFO: `/v3/projects/4bec78c637ef4cc79a78d00444826781/users/3911f4e690fc412cbe991d1f5b943174/roles/1fdf01beb7394da2a4ea549a7d1bccf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:50.107182 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae619235-36fc-4d98-965b-5483b9ddcd7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bec78c637ef4cc79a78d00444826781, user_id=3911f4e690fc412cbe991d1f5b943174, role_id=1fdf01beb7394da2a4ea549a7d1bccf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:50.109913 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae619235-36fc-4d98-965b-5483b9ddcd7d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:50.124479 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1464/2903] 10.222.0.110 () {60 vars in 1487 bytes} [Thu May 26 16:54:50 2022] PUT /identity/v3/projects/4bec78c637ef4cc79a78d00444826781/users/3911f4e690fc412cbe991d1f5b943174/roles/1fdf01beb7394da2a4ea549a7d1bccf1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:50.129610 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8254e-c6ef-4bb4-8f3c-54e696b0112c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:50.130077 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8254e-c6ef-4bb4-8f3c-54e696b0112c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:50.130205 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8254e-c6ef-4bb4-8f3c-54e696b0112c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:50.148346 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-eda8254e-c6ef-4bb4-8f3c-54e696b0112c None None] MFA Rules not processed for user `eff5fc4521044d4aa5829e339b10b23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:50.149565 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-eda8254e-c6ef-4bb4-8f3c-54e696b0112c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:50.179724 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:50.211381 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1440/2904] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:54:50.221074 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae619235-36fc-4d98-965b-5483b9ddcd7d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:50.222824 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ae619235-36fc-4d98-965b-5483b9ddcd7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:50.280147 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae619235-36fc-4d98-965b-5483b9ddcd7d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:50.283745 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91397b-9b66-4054-bc0a-d5d5111f6651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:50.284395 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91397b-9b66-4054-bc0a-d5d5111f6651 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:50.284682 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91397b-9b66-4054-bc0a-d5d5111f6651 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:50.284962 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91397b-9b66-4054-bc0a-d5d5111f6651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:50.294866 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91397b-9b66-4054-bc0a-d5d5111f6651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:50.296298 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91397b-9b66-4054-bc0a-d5d5111f6651 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:50.306243 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1465/2905] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:50.918448 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bba8c-7781-4068-9a5e-a2a83fc3bf3c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:50.918800 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bba8c-7781-4068-9a5e-a2a83fc3bf3c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:50.919085 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bba8c-7781-4068-9a5e-a2a83fc3bf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:50.948495 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e07bba8c-7781-4068-9a5e-a2a83fc3bf3c None None] MFA Rules not processed for user `3911f4e690fc412cbe991d1f5b943174`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:50.949801 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e07bba8c-7781-4068-9a5e-a2a83fc3bf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:51.017385 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1441/2906] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:51.029507 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91397b-9b66-4054-bc0a-d5d5111f6651 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:51.030953 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bb91397b-9b66-4054-bc0a-d5d5111f6651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:51.092277 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91397b-9b66-4054-bc0a-d5d5111f6651 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:51.095901 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fac7f6-ae42-44d0-9ce9-54bc704a2aaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac42de1401441c0a3d4e7239e9b020e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:51.096551 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fac7f6-ae42-44d0-9ce9-54bc704a2aaa service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:51.096845 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fac7f6-ae42-44d0-9ce9-54bc704a2aaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:51.097128 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fac7f6-ae42-44d0-9ce9-54bc704a2aaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:51.106039 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fac7f6-ae42-44d0-9ce9-54bc704a2aaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:51.107503 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fac7f6-ae42-44d0-9ce9-54bc704a2aaa service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:51.111256 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:51.118651 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1466/2907] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:54:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:52.457554 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c7425-9d73-44a2-b7d7-8eaf6964de8e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:52.458064 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c7425-9d73-44a2-b7d7-8eaf6964de8e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:52.458163 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c7425-9d73-44a2-b7d7-8eaf6964de8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:52.476741 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5a6c7425-9d73-44a2-b7d7-8eaf6964de8e None None] MFA Rules not processed for user `3911f4e690fc412cbe991d1f5b943174`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:52.477957 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5a6c7425-9d73-44a2-b7d7-8eaf6964de8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:52.484859 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1442/2908] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:54:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:52.724274 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fac7f6-ae42-44d0-9ce9-54bc704a2aaa service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:52.733884 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fac7f6-ae42-44d0-9ce9-54bc704a2aaa service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:52.737760 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee975c19-9cbe-4856-9e1c-9cd9619f73ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2411c1c780449e1a24fecb747cc3761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:52.738401 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee975c19-9cbe-4856-9e1c-9cd9619f73ae service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:52.738754 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee975c19-9cbe-4856-9e1c-9cd9619f73ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:52.739040 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee975c19-9cbe-4856-9e1c-9cd9619f73ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:52.740829 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ee975c19-9cbe-4856-9e1c-9cd9619f73ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:52.750711 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee975c19-9cbe-4856-9e1c-9cd9619f73ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:52.752154 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee975c19-9cbe-4856-9e1c-9cd9619f73ae service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:52.761167 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1467/2909] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:54:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:02.471005 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=47 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:02.756722 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:05.487173 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36412d56-2fff-490f-b7e9-e1bd07976536 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:05.487674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36412d56-2fff-490f-b7e9-e1bd07976536 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:05.487777 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36412d56-2fff-490f-b7e9-e1bd07976536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:05.505972 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-36412d56-2fff-490f-b7e9-e1bd07976536 None None] MFA Rules not processed for user `3911f4e690fc412cbe991d1f5b943174`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:05.507566 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-36412d56-2fff-490f-b7e9-e1bd07976536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:05.515099 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1443/2910] 10.222.0.110 () {58 vars in 962 bytes} [Thu May 26 16:55:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:15.500674 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:21.383216 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eec514-2ba2-4b90-bdf2-bf2b43beb260 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:21.383645 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eec514-2ba2-4b90-bdf2-bf2b43beb260 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:21.383786 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eec514-2ba2-4b90-bdf2-bf2b43beb260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:21.448901 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-10eec514-2ba2-4b90-bdf2-bf2b43beb260 None None] MFA Rules not processed for user `ebf3257328b94092b544cb0dadb789c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:21.450136 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-10eec514-2ba2-4b90-bdf2-bf2b43beb260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:21.522532 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1468/2911] 10.222.0.110 () {58 vars in 1014 bytes} [Thu May 26 16:55:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:21.568433 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36412d56-2fff-490f-b7e9-e1bd07976536 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:21.569884 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-36412d56-2fff-490f-b7e9-e1bd07976536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:21.651202 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36412d56-2fff-490f-b7e9-e1bd07976536 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:21.657984 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99396cc8-9ded-4e86-865f-3bcf00905bff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4502c57e324c31a8bce12770a92371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:21.658671 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99396cc8-9ded-4e86-865f-3bcf00905bff service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:21.658983 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99396cc8-9ded-4e86-865f-3bcf00905bff service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:21.659261 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99396cc8-9ded-4e86-865f-3bcf00905bff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:21.667564 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99396cc8-9ded-4e86-865f-3bcf00905bff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:21.669706 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99396cc8-9ded-4e86-865f-3bcf00905bff service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:21.677817 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1444/2912] 10.222.0.110 () {60 vars in 1389 bytes} [Thu May 26 16:55:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:55:31.519714 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=47 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:31.674803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=36 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:36.207550 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987452f0-0606-4381-bfbc-3145e5f91aea None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:36.208393 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987452f0-0606-4381-bfbc-3145e5f91aea None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:36.208599 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987452f0-0606-4381-bfbc-3145e5f91aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:36.228615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-987452f0-0606-4381-bfbc-3145e5f91aea None None] MFA Rules not processed for user `ebf3257328b94092b544cb0dadb789c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:36.230129 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-987452f0-0606-4381-bfbc-3145e5f91aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:36.238197 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1469/2913] 10.222.0.110 () {58 vars in 972 bytes} [Thu May 26 16:55:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:36.250920 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99396cc8-9ded-4e86-865f-3bcf00905bff service swift] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:36.261793 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99396cc8-9ded-4e86-865f-3bcf00905bff service swift] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:36.267018 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00badd50-2062-4f3c-a582-443c88bf5f96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4502c57e324c31a8bce12770a92371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:36.267676 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00badd50-2062-4f3c-a582-443c88bf5f96 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:36.267967 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00badd50-2062-4f3c-a582-443c88bf5f96 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:36.268248 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00badd50-2062-4f3c-a582-443c88bf5f96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:36.277379 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00badd50-2062-4f3c-a582-443c88bf5f96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:36.279604 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00badd50-2062-4f3c-a582-443c88bf5f96 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:36.288190 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1445/2914] 10.222.0.110 () {60 vars in 1389 bytes} [Thu May 26 16:55:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:55:38.188090 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987452f0-0606-4381-bfbc-3145e5f91aea None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:38.200498 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987452f0-0606-4381-bfbc-3145e5f91aea None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:38.206031 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7d588-1bda-4d56-b6d8-2a6cdaa229fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:38.206952 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7d588-1bda-4d56-b6d8-2a6cdaa229fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:38.207239 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7d588-1bda-4d56-b6d8-2a6cdaa229fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:38.207520 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7d588-1bda-4d56-b6d8-2a6cdaa229fe admin admin] PATH_INFO: `/v3/users/3911f4e690fc412cbe991d1f5b943174` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:38.208745 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7d588-1bda-4d56-b6d8-2a6cdaa229fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3911f4e690fc412cbe991d1f5b943174)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:38.210723 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7d588-1bda-4d56-b6d8-2a6cdaa229fe admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:38.257596 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a2e7d588-1bda-4d56-b6d8-2a6cdaa229fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3911f4e690fc412cbe991d1f5b943174'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:38.269827 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a2e7d588-1bda-4d56-b6d8-2a6cdaa229fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3911f4e690fc412cbe991d1f5b943174'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:38.270510 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a2e7d588-1bda-4d56-b6d8-2a6cdaa229fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3911f4e690fc412cbe991d1f5b943174'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:38.277615 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a2e7d588-1bda-4d56-b6d8-2a6cdaa229fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3911f4e690fc412cbe991d1f5b943174'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:38.278220 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a2e7d588-1bda-4d56-b6d8-2a6cdaa229fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3911f4e690fc412cbe991d1f5b943174'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:38.290801 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1470/2915] 10.222.0.110 () {58 vars in 1228 bytes} [Thu May 26 16:55:38 2022] DELETE /identity/v3/users/3911f4e690fc412cbe991d1f5b943174 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:38.462494 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00badd50-2062-4f3c-a582-443c88bf5f96 service swift] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:38.473513 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00badd50-2062-4f3c-a582-443c88bf5f96 service swift] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:38.537422 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac1344-974f-4a84-b0e1-cf8dcfeedb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff5fc4521044d4aa5829e339b10b23f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd89de88c67114e9b9382e93ffe6a1176', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:38.539001 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac1344-974f-4a84-b0e1-cf8dcfeedb22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:38.539518 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac1344-974f-4a84-b0e1-cf8dcfeedb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:38.540014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac1344-974f-4a84-b0e1-cf8dcfeedb22 admin admin] PATH_INFO: `/v3/projects/4bec78c637ef4cc79a78d00444826781` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:38.542014 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac1344-974f-4a84-b0e1-cf8dcfeedb22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bec78c637ef4cc79a78d00444826781)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:38.544773 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac1344-974f-4a84-b0e1-cf8dcfeedb22 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:38.594492 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f2ac1344-974f-4a84-b0e1-cf8dcfeedb22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bec78c637ef4cc79a78d00444826781', 'request_id': 'req-f2ac1344-974f-4a84-b0e1-cf8dcfeedb22'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:38.601733 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f2ac1344-974f-4a84-b0e1-cf8dcfeedb22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bec78c637ef4cc79a78d00444826781', 'request_id': 'req-f2ac1344-974f-4a84-b0e1-cf8dcfeedb22'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:38.608012 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f2ac1344-974f-4a84-b0e1-cf8dcfeedb22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bec78c637ef4cc79a78d00444826781', 'request_id': 'req-f2ac1344-974f-4a84-b0e1-cf8dcfeedb22'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:38.618485 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f2ac1344-974f-4a84-b0e1-cf8dcfeedb22 admin admin] The token cache is being invalidate because project 4bec78c637ef4cc79a78d00444826781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:38.618803 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f2ac1344-974f-4a84-b0e1-cf8dcfeedb22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:38.619446 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f2ac1344-974f-4a84-b0e1-cf8dcfeedb22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:38.620981 dv-cinder-836072-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1446/2916] 10.222.0.110 () {58 vars in 1237 bytes} [Thu May 26 16:55:38 2022] DELETE /identity/v3/projects/4bec78c637ef4cc79a78d00444826781 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:48.287318 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:48.615332 dv-cinder-836072-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:35.825014 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7d588-1bda-4d56-b6d8-2a6cdaa229fe admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:35.826413 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a2e7d588-1bda-4d56-b6d8-2a6cdaa229fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:35.924547 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7d588-1bda-4d56-b6d8-2a6cdaa229fe admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:35.983149 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858bdac-f571-4fef-8b4e-1799d16bc2a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ffef7640dd1487ab2ea91fc0f4be9e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd33e1f400b3e46379d2a0abd05921181', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:35.983808 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858bdac-f571-4fef-8b4e-1799d16bc2a8 service placement] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:35.984096 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858bdac-f571-4fef-8b4e-1799d16bc2a8 service placement] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:35.984375 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858bdac-f571-4fef-8b4e-1799d16bc2a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:35.986670 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2858bdac-f571-4fef-8b4e-1799d16bc2a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:35.998601 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858bdac-f571-4fef-8b4e-1799d16bc2a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:36.000188 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858bdac-f571-4fef-8b4e-1799d16bc2a8 service placement] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:36.010645 dv-cinder-836072-5-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1471/2917] 10.222.0.110 () {60 vars in 1370 bytes} [Thu May 26 16:56:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:46.006419 dv-cinder-836072-5-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=67 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}